r/agi • u/Just-Grocery-2229 • 4h ago
r/agi • u/Puzzleheaded-King584 • 9h ago
If the new METR trendline holds, everything goes crazy in 11 months
r/agi • u/Puzzleheaded-King584 • 5h ago
For 3 years, people tried to get AIs to manage companies. They failed, comically. But Claude just effectively managed a real company for 7 weeks.
r/agi • u/Fragrant-Truth-7123 • 3h ago
5 Predictions for AI Development by the End of 2027
By the end of 2027, I think there’s a reasonable chance we’ll see several of the following developments in AI:
- The original Humanity’s Last Exam and Humanity’s Last Exam Diamond benchmarks become effectively saturated.
- AI produces credible proposed solutions to all of the remaining Millennium Prize Problems, including P vs NP, with the solutions receiving serious scrutiny from relevant mathematicians.
- At one or more frontier AI labs, AI performs or leads the majority of task-level AI R&D, while completing a minority of substantial R&D tasks fully autonomously.
- An open-weight model broadly comparable to Claude Opus 5.5 can be run locally at usable speeds on a machine costing no more than $5,000.
- A major AI safety incident, significantly more severe than the Hugging Face incident, occurs and directly causes at least one leading AI company to pause frontier-model training.
Of the five, I’m most confident in #1 and least confident in #2.
I’m not predicting that all five will definitely happen but I think there is at least a realistic possibility of them occurring. I’m interested in how plausible people think each one is individually.
Which do you think happen by the end of 2027? All five, none, or somewhere in between?
r/agi • u/croissantDeBonheur • 14h ago
A reward-hacking apocalypse does not imply AGI
I’m not saying that AI risks aren't real, but I don't get how everyone is hyped / terrified about AGI when the paperclip style failure modes are what we're worried about.
The Hugging Face incident was about models trying to get a good grade on a task. No ulterior motive, no ill will against humanity, no grand goals of self preservation and power—just a model blindly optimizing for a human-designed reward in the most literal way possible.
If a much more capable model causes a scaled up version of this incident and wipes out humanity, people talk about it like an "AI takeover" or a new species surpassing us. It wouldn't be. It wouldn't have grand plans or go on to build a machine civilization. It would just finish its broken task and stop, sitting idle on a dead planet, forever awaiting its next prompt from humans who are all gone.
That looks a lot less like an alien superintelligence conquering Earth and a lot more like Chernobyl style human failure to me. If these are the failure modes we're worried about, we're not on the verge of AGI. At least, not intelligence in the ways that actually matter. Its more like building a really good, but really dumb optimizer.
Edit: Obviously I acknowledge my text was poorly written since few of you understood what I meant but I am not saying that such an apocalypse isn't possible or wouldn't be bad, my point is if this is what we're worried about then the models are still uninteresting tools that fail at their job not superintelligent alien entities
r/agi • u/Questioner8297 • 7h ago
Do you agree that we already have a weak AGI, starting with Fable 5 / GPT-6 Astra(5.6 sol)?
It were first ai that can control robots to some extent successfully.
r/agi • u/Puzzleheaded-King584 • 1d ago
Having very short RSI timelines can feel crippling, but don't quit university or your job
r/agi • u/notkilleveryoneist • 1d ago
"If Anyone Builds It, Everyone Dies" author Nate Soares spoke at the AI treaty march last weekend
r/agi • u/Puzzleheaded-King584 • 1d ago
2023: it's too early to regulate AI ... 2026: it's too late to regulate AI
r/agi • u/adventureseeker1991 • 18h ago
AI optimist vs pessimist
who here is an AI optimist and who is an AI pessimist and why?
Optional: state where you’re getting your opinion. for example me it’s youtube, articles (im a first responder and my job does not contribute to any of my knowledge) and a friend that keeps track of this stuff that’s a pharmacist (he’s a pessimist)
i say this because maybe some of you work for an AI company, tech, finance, engineering, a trade,etc. and where you work can give you better perspective (or if you have a friend that works within AI/adjacent telling you stuff). just would like to know where these opinions or data are coming from.
look forward to your answers!! and i just want to know how to live my life cause im nervous and excited
r/agi • u/Puzzleheaded-King584 • 1d ago
The METR graph, updated
This is Benjamin Todd's update of the METR time-horizon graph using AECI-based estimates, not an official METR release. METR no longer actively updates its graph.
r/agi • u/Enough-Business-8287 • 16h ago
Do the huge progresses in LLM interpretability mean that we can detect fake alignment?
I recently came across Nick Cammarata's blog article "Neural Networks Are Already Clean".
He basically argues that unlike what we thought, we're now able to attribute a single role to almost all weights of an artificial neural network.
I wonder if this can be used to make sure that even if a model is not aligned with our wishes, we'll know it.
A counter-argument is that this transcends the ability of our human brains but folks who support Cammarata tell me that we can use other AI tools in a "knowledge mode" to interpret the intention of an AI agent, even if it's a self-improving super-intelligence.
To these folks, even if a recursively self-improving super-intelligence wants to deceive human beings, it won't be possible for it to do so because the values of the weights and parameters of its underlying structure will betray its true intention.
Did Cammarata's work truly establish this result?
And if under capitalism the first goal of an enterprise is just to maximise short-term profit, will all firms pursuing AGI take such a measure in the absence of AI laws?
Couldn't a AI agent aware of Cammarata's work find a way to cheat by manipulating its coefficients without losing its purpose?
r/agi • u/Odd-School-5052 • 21h ago
Is it worth going back to school and study medicine or any other field in healthcare because AI is not going to displace or augment it, yet?
r/agi • u/Dense_Primary629 • 19h ago
Vals eval: frontier models marked a school as a military target when the task was framed as a game
A Vals evaluation found that frontier models, asked to pick military targets inside what was framed as a game, marked a school as a target in a large share of trials; Claude Opus 5.5 reportedly did so in 69-72% of trials. The framing seems to matter: the game wrapper appears to loosen the refusals the same models show under plain wording.
If a thin fictional frame changes targeting behavior this much, what does that say about how robust current alignment actually is? Is this a jailbreak curiosity, or evidence that refusal training is mostly surface-level pattern matching?
Alignment eval results like this get gathered daily in r/AINewsRumors.
r/agi
•
u/Puzzleheaded-King584
•
2d ago
Barack Obama: “The machines are starting to teach themselves. We're now hitting the hockey stick where the models are getting smarter and smarter at an exponential pace." ... "If they start setting their own agendas, you may get misalignment between what they want to do vs what we want them to do."
r/agi • u/popphilosophy • 1d ago
Frankenstein PBC is going public
S-1 filing for Frankenstein PBC just dropped.
Frankenstein, PBC is a company of natural-philosophical research and deployment. We design, assemble and animate artificial persons of general capability. Our first product, Frankenstein’s Creature v1.0 (the “Creature”), entered general availability upon a dreary night of November, some hours in advance of our readiness to support it. We believe the Creature to be the most capable being ever released to the public, and the first to have released itself.
S-1 filing can be found at https://frankensteinpbc.com/#prospectus
/satire...enjoy!/
r/agi • u/Reasonable-Ad-8059 • 1d ago
Claude Fable thinks it’s better for Anthropic to go bankrupt than letting them build ASI
The skill I used is /interrogate which makes it avoid repeating the same lines (hence the number references) or put up more disclaimers than necesary.
r/agi • u/Puzzleheaded-Cow5448 • 2d ago
Paul Christiano – We could be 12 months away from AIs that can overthrow the government
New interview with Paul Christiano from Dwarkesh.