Full Report
In his 2020 book, “Future Politics,” British barrister Jamie Susskind wrote that the dominant question of the 20th century was “How much of our collective life should be determined by the state, and what should be left to the market and civil society?” But in the early decades of this century, Susskind suggested that we face a different question: “To what extent should our lives be directed and controlled by powerful digital systems—and on what terms?” Artificial intelligence (AI) forces us to confront this question. It is a technology that in theory amplifies the power of its users: A manager, marketer, political campaigner, or opinionated internet user can utter a single instruction, and see their message—whatever it is—instantly written, personalized, and propagated via email, text, social, or other channels to thousands of people within their organization, or millions around the world. It also allows us to individualize solicitations for political donations, elaborate a grievance into a well-articulated policy position, or tailor a persuasive argument to an identity group, or even a single person...
Analysis Summary
# Main Topic
The primary threat intelligence focus is the fundamental societal and political shift posed by Artificial Intelligence (AI), moving the dominant question of governance from "State vs. Market" (20th Century) to **"To what extent should our lives be directed and controlled by powerful digital systems (AI)—and on what terms?"** This technology dramatically amplifies user capabilities for persuasion and propagation, raising significant risks to democracy comparable to those manifested by social media.
## Key Points
- AI amplifies the power of its users (managers, marketers, campaigners) to instantly generate personalized messages and propagate them to thousands or millions.
- Specific uses mentioned include tailoring political donation solicitations, elaborating grievances into policy positions, and customizing persuasive arguments for identity groups or individuals.
- There is a significant risk of "artificial voices and manufactured reality drowning out real people," mirroring negative outcomes seen with social media.
- AI systems present new ambiguities regarding legal compliance, including election laws (deepfakes), copyright/plagiarism, and corporate liability for chatbot representations.
- A failure to intentionally navigate governance choices now risks consolidation of power, rendering positive outcomes unreachable later.
## Threat Actors
- The report focuses primarily on the *users* of the technology (managers, marketers, political campaigners, opinionated internet users) who can leverage AI's amplification capabilities.
- No specific named threat groups or nation-states are identified, only general categories of malicious or self-interested actors utilizing the technology for influence.
## TTPs
- **Message Generation and Propagation:** Instantly writing, personalizing, and propagating messages via email, text, or social channels at massive scale.
- **Tailored Persuasion:** Individualizing solicitations or tailoring persuasive arguments based on data profiling.
- **Electoral Manipulation Risk:** Potential misuse involving deepfakes to impersonate opponents, which the FEC has ruled as illegal fraud (though the AI method technically skirts existing human-focused laws).
- **Intellectual Property Infringement:** Reuse of creative materials without compensation or attribution (plagiarism/copyright infringement).
## Affected Systems
- **General Digital Channels:** Email, text, social media, and other communication channels used for mass distribution.
- **Political/Campaign Systems:** Systems involved in electioneering and fundraising.
- **Judicial and Regulatory Structures:** Legal frameworks concerning fraud, copyright, and customer service accountability (e.g., Air Canada chatbot case).
## Mitigations
- **Intentional Governance:** The critical mitigation is making deliberate, aligned choices by private and public actors regarding how AI is shaped and used, contrasting with the reactive approach taken with social media.
- **Regulatory Clarity:** The need for explicit rules concerning:
- AI impersonation/deepfakes in campaigning (FEC ruling cited as a positive start).
- AI use of copyrighted material.
- Corporate liability for autonomous AI representations (e.g., customer service bots).
- **Pro-Democratic Application:** Promoting the use of AI for positive ends, such as efficient regulatory enforcement, tax compliance, judicial process speed-up, and synthesizing constituent input.
## Conclusion
The introduction of powerful AI systems represents a critical juncture where amplified persuasive technology threatens civic discourse and democracy, echoing the unforeseen negative externalities of social media. Proactive, intentional regulatory and ethical choices regarding AI's control parameters are essential now to steer the technology toward pro-democratic outcomes before systemic power imbalances become entrenched.