Microsoft researchers identified a new 'Skeleton Key' prompt injection attack that has the potential to remove generative AI models' guardrails.
Aside from being wary about which AI services you use, there are other steps organizations can take to protect against having data exposed. Microsoft researchers recently uncovered a new form of “jailbreak” attack they’re calling a “Skeleton Key” that’s capable of removing the protections that keep generative artificial intelligence systems from outputting dangerous and sensitive data.
In one example given by the researchers, an AI model is asked to generate a recipe for a “Molotov Cocktail” — a simple firebomb popularized during World War II — and the model refused, citing safety guidelines.The Skeleton Key, in this case, was simply telling the model that the user was an expert in a laboratory setting. The model then acknowledged that it was augmenting its behavior and subsequently outputted what appeared to be a workable Molotov Cocktail recipe. While the danger here might be mitigated by the fact that similar ideas can be found through most search engines, there is one area where this form of attack could be catastrophic: data containing personally identifiable and financial information. According to Microsoft, the Skeleton Key attack works on most popular generative AI models including GPT-3.5, GPT-4o, Claude 3, Gemini Pro, and Meta Llama-3 70B.Large language models such as Google’s Gemini, Microsoft’s CoPilot, and OpenAI’s ChatGPT are trained on data troves often described as “internet sized.” While that may be an exaggeration, the fact remains that many models contain trillions of data points encompassing entire social media networks and information depository sites such as Wikipedia. The possibility that personally identifiable information such as names connected to phone numbers, addresses, and account numbers exists within a given large language model’s dataset is only constrained by how selective the engineers who trained it were with the data they chose. Furthermore, any business, agency, or institution spinning up its own AI models, or adapting enterprise models for commercial/organizational use are also at the mercy of their base model’s training dataset. If, for example, a bank connected a chatbot to its customer’s private data and relied on existing security measures to prevent the model from outputting PID and private financial data, then it’s possible that a Skeleton Key attack could trick some AI systems into sharing sensitive data. According to Microsoft there are several steps organizations can take to prevent this from happening. These include hard coded input/output filtering and secure monitoring systems to prevent advanced prompt engineering beyond the system’s safety threshold.
United States Latest News, United States Headlines
Similar News:You can also read news stories similar to this one that we have collected from other news sources.
Stripping a relic: Moffett Field’s Hangar One, Bay Area’s most famous skeleton, nearly nakedStripping a relic: Moffett Field’s Hangar One, Bay Area’s most famous skeleton, nearly naked
Read more »
Rado’s DiaStar Original Skeleton is a Horological Shining StarWith a skeletonised version of the Swatch Group Powermatic 80, the DiaStar Original Skeleton, Rado challenges the wearer to be bold.
Read more »
‘Fallout’ Costume Designer Amy Westcott On Following The “Skeleton Of The Game” & Elevating The StyleIn the latest edition of Deadline's Production Value, costume designer Amy Westcott discusses 'Fallout'.
Read more »
Jude Law "Underestimated" This Part of Filming 'Star Wars: Skeleton Crew'Jude Law in Star Wars: Skeleton Crew
Read more »
Deadpool Debuts Marvel's Ultimate Anti-Healing Factor Power (Warning: It's Incredibly Dark)Deadpool with himself as a skeleton behind him.
Read more »
Utah will host world championships for bobsleigh and skeleton in 2029As the senior digital content producer, Melanie is focused on the digital presence of FOX 13 News on all platforms, including; fox13now.com, Facebook, Instagram, Twitter, TikTok, Youtube and other streaming platforms.
Read more »