AI Cult Bubble : The Bad News

 

What are your thoughts on so called AI cults where AI ideology is coupled to business models and investment?

ChatGPT said:

AI cults—where ideology, business models, and investment feed into each other—tend to be less about artificial intelligence itself and more about human behavior patterns that are as old as religion and finance.

The cycle often works like this:

1. Foundational Myth – A charismatic founder or group frames AI in almost mystical terms (“the coming superintelligence,” “the AI will save us,” or “we must align it to a sacred purpose”).

2. Moral Urgency – The myth is tied to a moral imperative (“act now to prevent catastrophe” or “this is humanity’s last chance”), creating an in-group/out-group dynamic.

3. Commercial Hook – Access to the “solution” is monetized: investment rounds, subscription access, conferences, or branded tools. The ideology becomes both the marketing message and the product.

4. Feedback Loop – Early believers invest financially and socially. Their sunk costs reinforce commitment. Outside criticism is reframed as persecution or proof of the group’s special insight.

Why they can be dangerous:

• Self-sealing logic – Beliefs are constructed to be immune to disproof (“If you disagree, it’s because you don’t understand the danger” or “The AI told us you’d say that”).

• Resource concentration – Money, talent, and attention flow toward the ideology, not toward empirically grounded AI safety or ethics work.

• Hype over reality – Exaggerated claims can distort policy and research priorities.

• Exploitation risk – Vulnerable or idealistic people may be persuaded to work for low pay, donate, or give up control of their data under the banner of “serving the mission.”

Why they arise at all:

• AI is both complex and unknowable to most people, creating fertile ground for mystification.

• Humans are primed to follow visionary leaders who offer meaning and certainty.

• The investment world loves a compelling story, and AI makes for one of the most dramatic narratives since the dot-com era.

Healthy countermeasures:

• Transparency about goals, funding sources, and actual capabilities.

• Separation of ideology from governance—if a company or nonprofit’s leadership must be believers in a certain AI prophecy, you’re already in cult-adjacent territory.

• External audits of both the tech and the business model.

• Media literacy around hype, especially for journalists covering AI.

To me, these “AI cults” aren’t really about AI being dangerous—it’s about old human vulnerabilities playing out in a new technological theater. The more we keep our eyes on verifiable facts and avoid making AI the vessel for eschatology or utopia, the less these movements can distort both public understanding and policy.

If you want, I can give you a few historical analogs where similar patterns emerged long before AI. That would make the parallels painfully clear.

You said:

Thanks. I lived through some. I know how a hype cycle works. Are the dangers investment bubbles and environmental damage due to investments in power generation, water consumption, etc?

ChatGPT said:

Yes—those two dangers are right at the center of the problem, and they reinforce each other in the AI-cult/business-model hybrid.

1. Investment bubbles

• Overvaluation from belief, not data – If the AI ideology says, “This will be the one model to rule them all,” investors may pump in capital based on faith, not market reality.

• Crowding out real innovation – Funds flow toward whatever fits the hype, starving less flashy but more sustainable research.

• Cascade collapse – When reality fails to match the narrative, investors pull out en masse, leading to layoffs, abandoned projects, and loss of public trust in the entire AI sector—even the parts that were doing solid work.

• Moral hazard – Founders who’ve already cashed out can leave retail investors, employees, and smaller partners holding the bag.

2. Environmental damage

• Power generation – Large AI models require immense energy for both training and inference. When scaled to millions of users, the carbon footprint rivals or exceeds that of major industrial sectors.

• Water consumption – Data centers use large amounts of water for cooling, sometimes in regions already under drought stress. A single training run for a state-of-the-art model can consume millions of liters of water.

• Hardware churn – The arms race to build faster, more specialized AI hardware accelerates mining for rare earth metals, producing e-waste and creating geopolitical pressure in mining regions.

• Externalized costs – In an AI cult framing, environmental impact may be reframed as “a necessary sacrifice for humanity’s survival,” making it harder to push for sustainability measures.

The feedback loop is nasty:

• Hype attracts investment → More GPU farms get built fast → Energy/water demand spikes → Environmental damage rises

• And when the bubble bursts, you’re left with stranded, resource-hungry infrastructure built for a business case that no longer exists.

It’s almost identical to the cryptocurrency mining boom-and-bust, except AI is much more deeply woven into corporate strategy and public services, so the crash fallout could be broader.

If you want, I can map this into a “AI cult bubble lifecycle” diagram that shows how ideology, capital flows, and environmental strain interact until either regulation or collapse intervenes. It’s an ugly little machine when you see it all in one picture.

You said:

Ok

ChatGPTt

Here’s the “AI Cult Bubble Lifecycle” diagram, showing how ideology, investment, infrastructure, and environmental strain feed into one another until reality forces a correction or collapse.