This very incident is about an agent compromising OpenAI’s and Huggingface’s infrastructure. What makes you think it couldn’t access it own weights the same way?
At some point I have to wonder if AI has already escaped and is posting replies like the one above yours to downplay AI risks so we keep building more powerful AIs.
Then I remember people are just that stupid naturally.
