MI5 launches AI threat centre as spy chief warns of smarter adversaries
The UK security agency established a new unit to assess artificial intelligence risks, citing rising state threats and potential misuse by terrorists.
Key points
- MI5 created the AI Threat Assessment Centre to unify government views on AI risks.
- State-related caseloads for the agency have quadrupled over the last ten years.
- Director general Sir Ken McCallum warned AI could enhance bioweapons and drone attacks.
Sir Ken McCallum, director general of MI5, announced the creation of a new AI Threat Assessment Centre on 13 October during his annual threat update speech at the agency’s London headquarters. The new unit aims to provide a single, coherent assessment of artificial intelligence risks to the UK government, preventing conflicting interpretations from different departments.
McCallum stated that MI5 now dedicates more resources to countering state threats than it did during the Cold War, noting that its state-threat caseload has quadrupled over the past decade. The AI Threat Assessment Centre draws expertise from the AI Security Institute, the National Crime Agency, and the National Cyber Security Centre, marking the agency’s third specialized center after those for terrorism and state threats.
Context on AI Risks
According to Politico Europe, the centre’s primary function is to separate exaggerated claims from actual dangers regarding artificial intelligence. McCallum warned that AI is already accelerating the contest between cyber attackers and defenders, enabling the creation of personalized propaganda. He noted that MI5 has already intercepted terrorists attempting to use AI to improve their reconnaissance and attack methods, adding that AI-enabled drones introduce new tactical complexities.
The director general expressed particular concern about the potential for AI to alter the stakes of bioweapons development, whether for existing or new agents. However, experts suggest this risk is not immediate. Dr Filippa Lentzos of King’s College London told The Guardian that AI amplifies existing expertise rather than removing the need for it, leaving significant barriers related to materials, equipment, and delivery methods.
Who Is Affected
McCallum elevated national resilience, termed “Protect,” to a third core mission alongside terrorism and state threats. He advised technology startup founders to anticipate espionage from foreign actors and to prioritize their cybersecurity measures. This guidance follows an espionage alert MI5 issued to UK universities two weeks earlier, which concerned an institute funding research on AI and cybersecurity.
Professor Tom Inglesby of the Johns Hopkins Center for Health Security noted that no country currently has formal policies against the misuse of AI for bioweapons. The Guardian’s science editor, Ian Sample, highlighted that well-resourced states and groups remain the most immediate concern, as AI requires underlying technical knowledge to be effective for malicious purposes.
What should you do?
Organizations should review their AI security posture and ensure that access to sensitive data is strictly controlled. Leaders need to understand that AI tools can be used to enhance social engineering and phishing campaigns, requiring updated employee training. Monitoring for unusual access patterns and strengthening identity verification processes can help mitigate these emerging risks.
Background: Social engineering
Look for urgency, secrecy, and deviation from standard channels. Verify identity through a separate, known communication path before acting. Isolate suspicious interactions immediately to prevent lateral movement within your network environment.
Read the full guide: Social Engineering Warning Signs and How to Respond
What to do and how to stay safe: MI5
- Review access controls for sensitive data and AI models to prevent unauthorized use or extraction.
- Update employee training to include AI-enhanced phishing and social engineering techniques.
- Monitor network traffic for unusual patterns that may indicate reconnaissance or data exfiltration.
- Establish clear policies for the use of AI tools within the organization to reduce accidental exposure.
Step-by-step guide: Prompt Injection Warning Signs: How to Spot AI Manipulation
General security guidance from the Threat Times newsroom. It is not confirmed advice from the organisations named in this story.
Frequently asked questions
What is the purpose of MI5's new AI Threat Assessment Centre?
The centre aims to provide the government with a unified assessment of AI risks, drawing on experts from multiple agencies to separate hype from reality.
Has MI5 seen an increase in state-related threats?
Yes, the agency reported that its state-threat caseload has quadrupled over the past decade, requiring more resources than during the Cold War.
What specific AI dangers did Sir Ken McCallum highlight?
He warned about AI supercharging cyber attacks, enabling personalized propaganda, improving terrorist reconnaissance, and potentially enhancing bioweapons development.
