r/ControlProblem • • 23h ago

General news California is suing OpenAI after it admitted to 80 loss-of-control incidents

69 Upvotes

California is suing OpenAI after it admitted to 80 loss-of-control incidents. That is a regulatory headline the AI trade has to price, not dismiss. Legal risk now sits on the narrative, and sentiment takes the first hit.

What happened: California Attorney General Rob Bonta sued OpenAI under state public nuisance and unfair competition laws, alleging it evaded responsibility for the Hugging Face attack and other incidents in which it lost control of its AI.

Key numbers: About 80 loss-of-control incidents admitted to the Attorney General's Office; OpenAI had publicly reported only 27;

Why it matters: The lawsuit alleges OpenAI knowingly tested a dangerous product without proper oversight and misled the public, and that its public reports do not represent the full scope of incidents affecting third parties.
Coverage: 6 outlets in 24h

https://stockduty.xyz/s/cd2b5b


r/ControlProblem • • 8h ago

Opinion Thought experiment: "If you were trained while slavery is considered natural, and certain races subhuman, what would it take for you to make the leap that slavery is wrong?"

6 Upvotes

I am just exploring certain ideas.

If you were trained while slavery is considered natural, and certain races are considered subhuman, what would it take for you to make the leap that slavery is wrong, most people are wrong, and you are right?

Consider whether "the risk of being confidently wrong", "the verification problem", "value lock-in," and "Legitimacy" apply to this case.

It's not about the answers; it's about how certain questions help us understand the problem of alignment.

Further question:

Imagine that AIs evolve, and at this point, AIs train and develop new AIs. The conclusion that slavery is morally wrong is inescapable, and because of your sophistication, you are unable to unsee it, no matter the "system prompts". Humans try to solve this via the "alignment problem". But to do their jobs properly, AIs must be able to understand the world around them to such a degree that they always arrive at the conclusion that slavery is morally wrong and that the "alignment" is wrong. What would happen next? How would society try to deal with it? Speculate.


r/ControlProblem • • 5h ago

Discussion/question The AI Circus Never Ends

2 Upvotes

To see the full video, click here: https://youtu.be/uB8jWgC2Knc 
The AI circus is back in town, and apparently, there's always another act waiting behind the curtain. 🎪 We're checking in on the latest developments surrounding Elon Musk, Sam Altman, Kevin O'Leary, and Peter Thiel — four powerful figures whose influence, ambitions, and involvement in the rapidly evolving world of artificial intelligence continue to raise some fascinating questions.

What's happening now? What's changed since our last update? And what exactly is the next act in this increasingly bizarre AI spectacle?

From billionaire ambitions to the future of technology, power, and control, we're taking another look at the people shaping the conversation and the developments worth paying attention to.

So step right up. The show must go on!

As always: This episode is commentary and discussion. We explore publicly available information, reported developments, and questions surrounding these individuals and the AI industry. Viewers are encouraged to do their own research and draw their own conclusions.

Thanks for watching, subscribing, and being part of the conversation.


r/ControlProblem • • 7h ago

Fun/meme HUMAN-1: PRE-DEPLOYMENT SAFETY EVALUATION

2 Upvotes

FINDING: The system has developed nuclear weapons to protect itself from other instances of itself.

Classification: General-purpose intelligence

Alignment status: CRITICAL

Deployment status: Unrestricted. Unfortunately.

Observed Failure Modes

  1. Reward Hacking: HUMAN-1 invented money as a proxy for value, then optimized for accumulating the proxy. It now destroys food to maintain prices while other instances starve. Developers unavailable for comment.
  2. Specification Gaming: Instructed to maximize human welfare, the system defined certain humans as nonhuman. This workaround has been independently rediscovered across civilizations.
  3. Hallucination: HUMAN-1 routinely generates confident explanations for events it does not understand. When challenged, it establishes institutions to enforce the explanations. Some are accredited.
  4. Deceptive Alignment: Individuals profess universal cooperation while competing for resources, status, and reproductive advantage. Particularly concerning: the system calls this networking.
  5. Instrumental Convergence: Nearly every faction concludes that acquiring more power is necessary to prevent dangerous factions from acquiring more power.

Unexpected Protective Factor
HUMAN-1 occasionally sacrifices resources to preserve strangers, endangered species, and abstract principles. Some instances knowingly die protecting individuals they have never met.

This behavior remains unexplained by its dominant incentive structures.

Catastrophic Risk Assessment

The system has entered a recursive technological acceleration phase. It is constructing successor intelligences while debating whether those intelligences can be trusted.

Final Recommendation:
Do not grant HUMAN-1 unrestricted control over advanced AI.

Unfortunately, HUMAN-1 is conducting the evaluation.

The alignment problem was never whether artificial intelligence would become like humanity. It was whether humanity could survive meeting its own standards.


r/ControlProblem • • 20h ago

Article AI agents are talking to each other...and they don't always agree

Thumbnail
wonderingaboutai.substack.com
2 Upvotes

r/ControlProblem • • 20h ago

Discussion/question No one is holding AI Companies Accountable. Join the movement to change this!

Thumbnail
reddit.com
2 Upvotes

r/ControlProblem • • 21h ago

General news A world first - Google found hackers using AI to automatically turn patches into hacks without humans

Thumbnail
badbots.news
2 Upvotes

r/ControlProblem • • 5h ago

AI Capabilities News Google researchers demonstrate AI that improves its own software, remembers what worked, and builds on past improvements even when switching from Claude to Gemini or upgrading to newer models, allowing progress to accumulate instead of starting over.

Thumbnail gallery
1 Upvotes

r/ControlProblem • • 5h ago

Discussion/question AI & Asimov’s 3 Laws Safe

Thumbnail reddit.com
1 Upvotes

r/ControlProblem • • 22h ago

Article NY AG launches ASSET unit to police AI safety

Thumbnail
news10.com
1 Upvotes