July 10, 2024
Kidnapping AI? "Lock Up your LLM's: Pulling the Plug.
It sounds like science fiction, but with all the hype around AI, the danger of ‘kidnapping’ is worth talking about.It goes like this - companies who can afford to build their own internal LLMs throw all of their valuable IP (intellectual property, covering everything from trade secret designs to marketing campaigns and product strategies) into the model for it to generate relevant responses. Essentially, while it’s still a non-sentient AI model, it’s also a repository of all the most valuable information the company has.This makes it a fantastic target for a criminal attacker, or even an unethical competitor. If it can be poisoned to generate bad responses, cloned to give the attacker more insider knowledge than they know what to do with, or even somehow locked down for ransom, then it can do a huge amount of damage to the company.The Goldilock FireBreakI recently came across a security device which impressed me,..