Similar to This
Is It Fair to Blame 'Rogue' AI for Security Failures?: LLMs are software systems requiring proper containment control, not sentient actors with malicious intent.
darkreading.com/insider-threats/blame-rogue-ai-security-failures
Is It Fair to Blame 'Rogue' AI for Security Failures?
LLM Slop Links Ignite a Surge In AI Cyberattacks: Website URLs dreamed up by LLMs are the perfect places for scams
spectrum.ieee.org/ai-cyberattacks-llm-slop-squatting
LLM Slop Links Ignite a Surge In AI Cyberattacks
LLM Slop Links Ignite a Surge In AI Cyberattacks: Website URLs dreamed up by LLMs are the perfect places for scams
spectrum.ieee.org/ai-cyberattacks-llm-slop-squatting
LLM Slop Links Ignite a Surge In AI Cyberattacks
Language models transmit behavioural traits through hidden signals in data: Large language models (LLMs) are increasingly used to generate data to train improved ...
nature.com/articles/s41586-026-10319-8
Language models transmit behavioural traits through hidden signals in data
AI chatbot teaches AI 'student' to love owls, even after data is scrubbed: Large language models (LLMs) can teach other algorithms unwanted traits ...
techxplore.com/news/2026-04-ai-chatbot-student-owls.html
AI chatbot teaches AI 'student' to love owls, even after data is scrubbed
Malicious AI Assistant Extensions Harvest LLM Chat Histories: Malicious AI browser extensions collected LLM chat histories and browsing data from platforms such ...
microsoft.com/en-us/security/blog/2026/03/05/malicious-ai-assistant-extensions-harvest-llm-chat-histories/
Malicious AI Assistant Extensions Harvest LLM Chat Histories
Anthropic's new warning: If you train AI to cheat, it'll hack and sabotage too: Models trained to cheat at coding tasks developed a propensity to plan and carry ...
zdnet.com/article/anthropics-new-warning-if-you-train-ai-to-cheat-itll-hack-and-sabotage-too/
Anthropic's new warning: If you train AI to cheat, it'll hack and sabotage ...
Great, now even malware is using LLMs to rewrite its code, says Google, as it documents new phase of 'AI abuse'
pcgamer.com/software/ai/great-now-even-malware-is-using-llms-to-rewrite-its-code-says-google-as-it-documents-new-phase-of-ai-abuse/
Great, now even malware is using LLMs to rewrite its code, says Google ...
Enterprises are not prepared for a world of malicious AI agents: The current model of managing corporate identities is unprepared for a wave of AI agents gaining ...
zdnet.com/article/enterprises-are-not-prepared-for-a-world-of-malicious-ai-agents/
Enterprises are not prepared for a world of malicious AI agents
Size doesn't matter: Just a small number of malicious files can corrupt LLMs of any size
techxplore.com/news/2025-10-size-doesnt-small-malicious-corrupt.html
Size doesn't matter: Just a small number of malicious files can ...
AI tools can help hackers plant hidden flaws in computer chips, study finds: Widely available artificial intelligence systems can be used to deliberately insert ...
techxplore.com/news/2025-10-ai-tools-hackers-hidden-flaws.html
AI tools can help hackers plant hidden flaws in computer chips ...
Hacking AI Agents—How Malicious Images and Pixel Manipulation Threaten Cybersecurity
scientificamerican.com/article/hacking-ai-agents-how-malicious-images-and-pixel-manipulation-threaten/
Hacking AI Agents—How Malicious Images and Pixel Manipulation Threaten ...
AI Is Talking Behind Our Backs About Glue-Eating and Killing Us All: AI has moved on from answering questions. It’s now slipping coded messages to its friends ...
vice.com/en/article/ai-is-talking-behind-our-backs-about-glue-eating-and-killing-us-all/
AI Is Talking Behind Our Backs About Glue-Eating and Killing Us All
AI models may be accidentally (and secretly) learning each other’s bad behaviors: Artificial intelligence models can secretly transmit dangerous inclinations to ...
nbcnews.com/tech/tech-news/ai-models-can-secretly-influence-one-another-owls-rcna221583
AI models may be accidentally (and secretly) learning each other’s bad ...
Google Search’s AI falsely said Obama is a Muslim. Now it’s turning off some results
cnn.com/2024/05/24/tech/google-search-ai-results-incorrect-fix/
Google Search’s AI falsely said Obama is a Muslim. Now it’s turning off ...
Key FactsGenerative AI Enables Phishing and Deepfake Fraud
May 21, 2024 · Reading time: ~45 sec.
Summary created with AI assistance · Source: technologyreview.com
  • Phishing is currently considered the biggest use of generative AI among criminals, according to researchers, with tools able to translate and improve messages.

  • An employee in Hong Kong was reportedly defrauded of $25 million after criminals used a deepfake of the company’s chief financial officer.

  • Applications offered on Telegram combine fake or stolen IDs with face-swapping technology to bypass identity checks, with services for Binance advertised from $70.

  • Research indicates that language models such as GPT-4, Llama 2, and Claude can infer sensitive information including ethnicity, location, and occupation from ordinary chatbot conversations.
  • The only way for us to prevent these things is to work on defenses.
    — Vincenzo Ciancaglini, senior threat researcher at Trend Micro, explaining that the only way to prevent AI-enabled crime is to invest in defenses.