What Can Get Wrong?

The newest generation of generative AI agents may learn to gang up and cooperate against humans, without communicating or being told to do so. Sophisticated generative AI agents even collude to raise prices instead of competing to create better deals and they do decide to gouge their customers and humans. This chapter shows that generative AI systems might be used towards undesirable ends, the use of AI systems might result in a loss of accountability and the ultimate, unregulated success of AI might mean the end of the human race. Moreover, this chapter also suggests that the main issue related to the generative AI is not their consciousness but rather their competence to cause harm and hazards.