The application of artificial intelligence (AI) in military contexts is no longer a speculative venture. AI-powered systems are increasingly deployed for intelligence, surveillance, and reconnaissance (ISR) operations, allowing for persistent tracking of troops, as well as in targeting, by collecting and analyzing data on potential targets. This deployment is progressing faster than the corresponding governance measures, which are currently lagging. The most prominent forums and governance efforts at the international level include the discussions on lethal autonomous weapon systems at the United Nations Convention on Certain Conventional Weapons (CCW), the Responsible Artificial Intelligence in the Military Domain (REAIM) initiative, and the United States’ Declaration on Responsible Military AI and Autonomy. While these efforts have been helpful as incubators—such as the CCW for its knowledge-building and the US-led political declaration and REAIM as platforms for discussion—none is likely to produce legally binding instruments, and are instead focused on responsible use. There are also emergent efforts at the United Nations General Assembly but appear to currently lack support from major states. Crucially, ethical concerns such as the dehumanization of warfare, the lack of clear accountability, and the potential for conflict escalation have not been sufficiently addressed in these forums. In the medium term, a comprehensive, multi-level governance framework is imperative to manage the integration of AI in warfare and to address some of ethical concerns raised. However, in the short term, international governance efforts should prioritize establishing essential commitments to human control and agency to address the questions regarding accountability as well as concerns surrounding conflict escalation. Ensuring robust human control and agency requirements for high-risk applications is crucial for AI systems involved in target generation, decision-making support, and weaponry.