Evil Geniuses Attack, The LLM Forgettery, Character Consistency and More

by | News/Events

Evil Geniuses Attack, The LLM Forgettery, Character Consistency and More: image 1

Augmented Shelf | Issue 2 | March 19, 2024

Welcome to Augmented Shelf, a wrap-up of the week’s AI news, trends and research that are forging the future of work.

Evil Geniuses Vs. ChatDev

Evil Geniuses Attack, The LLM Forgettery, Character Consistency and More: image 2

To evaluate the vulnerability of LLM-based agents, researchers at Tsinghua University in Beijing, China, have introduced the Evil Geniuses attack method. Evil Geniuses autonomously generate malicious prompts related to the LLM agent’s original role using “Red-Blue” exercises to improve prompt aggressiveness while maintaining role similarity. When tested on agents like ChatDev, CAMEL, and MetaGPT, Evil Geniuses demonstrated high success rates in eliciting unintended harmful behaviors from the agents. This shows LLM-based agents can be manipulated to generate stealthy malicious content by exploiting their original roles and training.

Apple Buys DarwinAI

Evil Geniuses Attack, The LLM Forgettery, Character Consistency and More: image 3

Why did Apple buy AI systems operations trailblazer DarwinAI earlier this year? With innovations crucial for on-device AI rather than cloud reliance, the acquisition lines up with Apple’s growing focus on enhancing device performance and user experience through AI embedded directly into devices. And the notable addition of AI expert Alexander Wong from DarwinAI to Apple’s team is a clear move to strengthen its market position against competitive tech giants, especially with GenAI features slated for its upcoming iOS 18 and Xcode enhancements.

Ethan Mollick Reviews The Big 3

Evil Geniuses Attack, The LLM Forgettery, Character Consistency and More: image 4

In his latest One Useful Thing post, academic and AI influencer Ethan Mollick offers his take on the big 3 of AI at this moment: GPT-4, Claude 3 Opus, and Gemini Advanced. Mollick goes through each model’s unique characteristics (i.e., Claude 3 can be quite insightful) and their shared characteristics, (their shared, hauntingly lifelike interaction quality). With no instruction manuals in sight, Mollick argues that mastery of these LLMs lies in experiential learning. He ends by highlighting the new star of AI, the emerging concept of autonomous, goal-driven AI agents.

Forget Memory, LLMs Need a Forgettery

Evil Geniuses Attack, The LLM Forgettery, Character Consistency and More: image 5

What if language models could instantly learn new languages just by “forgetting” what they knew before? A novel AI model is turning that idea into reality. Researchers have pioneered “adaptive forgetting” to supercharge how AI language models learn and adapt. By strategically clearing an AI’s linguistic memory, then retraining it on new data, adaptive forgetting allows models to rapidly acquire new languages and reduce reliance on massive datasets. This mirrors human forgetting – discarding some details to solidify core knowledge.

Midjourney Introduces Character Consistency

Evil Geniuses Attack, The LLM Forgettery, Character Consistency and More: image 6

Midjourney’s latest “–cref” feature marks a leap forward in AI-generated art, providing creatives with a powerful tool for character consistency. By referencing a URL, users can maintain characters’ facial features, body type and clothing across a narrative sequence, while the “–cw” tag allows users to control the degree of variance from the original character in new images. Leveraging diffusion models, this update improves upon the generative AI’s capacity for narrative consistency. The ability to maintain character consistency in AI-generated imagery opens up new creative avenues and use cases for content creators, artists, and professionals in the entertainment industry, enhancing storytelling and visual coherence.

Augment Yourself 🤖

Evil Geniuses Attack, The LLM Forgettery, Character Consistency and More: image 7

Read more from Shelf

April 26, 2024Generative AI
Midjourney depiction of NLP applications in business and research Continuously Monitor Your RAG System to Neutralize Data Decay
Poor data quality is the largest hurdle for companies who embark on generative AI projects. If your LLMs don’t have access to the right information, they can’t possibly provide good responses to your users and customers. In the previous articles in this series, we spoke about data enrichment,...

By Vish Khanna

April 25, 2024Generative AI
Evil Geniuses Attack, The LLM Forgettery, Character Consistency and More: image 8 Fix RAG Content at the Source to Avoid Compromised AI Results
While Retrieval-Augmented Generation (RAG) significantly enhances the capabilities of large language models (LLMs) by pulling from vast sources of external data, they are not immune to the pitfalls of inaccurate or outdated information. In fact, according to recent industry analyses, one of the...

By Vish Khanna

April 25, 2024News/Events
AI Weekly Newsletter - Midjourney Depiction of Mona Lisa sitting with Lama Llama 3 Unveiled, Most Business Leaders Unprepared for GenAI Security, Mona Lisa Rapping …
The AI Weekly Breakthrough | Issue 7 | April 23, 2024 Welcome to The AI Weekly Breakthrough, a roundup of the news, technologies, and companies changing the way we work and live Mona Lisa Rapping: Microsoft’s VASA-1 Animates Art Researchers at Microsoft have developed VASA-1, an AI that...

By Oksana Zdrok

Evil Geniuses Attack, The LLM Forgettery, Character Consistency and More: image 9
The Definitive Guide to Improving Your Unstructured Data How to's, tips, and tactics for creating better LLM outputs