Dear Friends,
I am delighted to hear that a good number of Cabrini parishioners have decided to read Pope Leo’s full encyclical. Yay! I think I am covering the high points, but even better to read the full letter for yourselves. As you can see from my highlights, Pope Leo writes well and is not hard to understand. Here he addresses the use of AI in combat:
The Holy See has recently observed that the growing ease with which autonomous weapons systems can be deployed makes war more “feasible” and less subject to human control. This violates the principle that armed force should be used only as a last resort in cases of legitimate self-defense. For this reason, the development and use of AI in warfare must be subject to the most rigorous ethical constraints, to guarantee respect for human dignity and the sanctity of life and to avoid a race to develop such arms.
Sometimes there is talk of “artificial moral agents,” as if machines were able to distinguish between right and wrong with greater consistency than a human being. Yet moral judgment cannot be reduced to calculation, for it involves conscience, personal responsibility and the recognition of the other as a person. Therefore, it is not permissible to entrust lethal or otherwise irreversible decisions to artificial systems. No algorithm can make war morally acceptable. AI does not remove the intrinsic inhumanity of conflict; indeed it can only bring about conflict more quickly and render it more impersonal, lowering the threshold for resorting to violence, transforming defense into threat prediction and thus reducing victims to data. In this way, it will accustom us to the idea that violence is inevitable and needs only to be optimized. This does not diminish the importance of instilling, as far as possible, values and sound judgment into the artificial systems we build, so that they can contribute to a moral ecosystem in which humans are better able to listen to their own consciences, as well as allowing AI models to establish appropriate boundaries.
It is not enough to invoke a generic type of ethics. Concrete criteria for discernment must be established. The first such criterion concerns personal responsibility. When a decision to strike becomes automated or opaque, the risk of abdicating responsibility increases. For this reason, the chain of responsibility must be identifiable and verifiable; those who design, train, authorize and employ technology must be held accountable for their decisions. The second criterion pertains to the moral timeframe for making judgments. While AI tends to expedite the decision-making processes, speed and efficiency should never be the supreme motivating force for the irreversible decisions made in the context of war. The third criterion is the identification and protection of civilians. Any technology that facilitates attacks without seeing the face of human beings lowers the moral threshold of conflict. Target selection and the use of force must not confuse combatants and non-combatants, nor ignore the impact on defenseless populations.
These criteria give rise to certain non-negotiable requirements. First, all systems used in a war setting must guarantee the possibility of retracing and reconstructing decision-making processes, so that accountability and blame are not collapsed into “the machine.” Second, the decision to use lethal force cannot be delegated to opaque or automated processes, but must remain under effective, self-aware and responsible human control. Finally, it is imperative to establish a shared framework — also at the international level — in order to curb the technological arms race and ensure robust protection for civilians and the infrastructures necessary for their survival.
We are nearing the end of the letter. A little more in the weeks ahead.
Peace,
Fr. Damian