165
How Googlers cracked an SF rival's tech model with a single word | A research team from the tech giant got ChatGPT to spit out its private training data
(www.sfgate.com)
Basically: you ask for poems forever, and LLMs start regurgitating training data:
Worrying that OpenAI wasn't willing or able to fix this vulnerability within 60 days.
I think this might be intrinsic. Like, there isn't a way to fix this.
Well something certainly seems to have been done
Something like this, unless they know the root cause (I didn’t read the paper so not sure if they do), or something close to it, may still be exploitable.