r/technology • • 19h ago • Bravo 1 Popcorn 1

Security Google: ‘The era of autonomous attacks has arrived’

https://thehill.com/policy/technology/6224604-autonomous-ai-threats-google-report/
19k Upvotes

1.9k comments sorted by

582

u/quicksexfm 19h ago • Regret

"We must fight AI with more AI." - literally every AI CEO's solution to problems created by AI. Seriously.

242

u/zsreport 18h ago

"the only way to stop a bad AI with a gun is a good AI with a gun"

108

u/FormulaLes 18h ago • Bravo

That’s why I have an AI-15

→ More replies (2)
→ More replies (7)

8

u/CollectionNo901 18h ago

They had a solution in desperate search of a problem, then finally realised they could also create the problem. Absolute geniuses.

7

u/Major_Temporary_5367 15h ago edited 15h ago

The way they are pitching it makes that so obvious. Its not "AI has expanded the capacity for hackers to target vulnerable systems", its stuff that sounds like skynet to get everyone thinking its some scifi bullshit. No we just gave every script kiddie that was already dangerous with a handgun an m16 with no safety.

5

u/Old_Bat1681 18h ago

"If you don't AI you're gonna get AI'd. Don't be a late adopter."

→ More replies (40)

4.3k

u/invyros 19h ago • Regret Popcorn

"We helped introduce this evil, now pay us to fight it!"

609

u/elmundo-2016 19h ago

We could just sue them $1 trillion and give them that money to fight it forever.

325

u/StopScreamingItsFine 19h ago • Bravo

Or we just sue them and keep the money and force them into poverty.

→ More replies (22)
→ More replies (14)

75

u/TheMagnuson 18h ago edited 21m ago

Exactly this.

If you read the article, it’s basically just Google saying “Buy our AI Threat Defense Service!”

→ More replies (2)

85

u/WordHarvester 18h ago

Create the problem, sell the solution. Now available as an enterprise subscription.

→ More replies (4)

38

u/casiopt10 19h ago

“Don’t Be Evil”

→ More replies (18)

1.4k

u/lawn_furniture 19h ago • Bravo

Dang I thought these out of touch tech ceos claimed AI was gonna make the world this utopia where everyone is happy and we all get universal income 😂

351

u/Raz_TheCat 19h ago

Universal account balances of $0.

24

u/accidental_Ocelot 19h ago

My universal checking account is low could you spot me a fiver?

→ More replies (2)
→ More replies (4)

238

u/swittla 18h ago

Since Reagan productivity has SKYROCKETED and the working class has not shared in the gains, at all. Anybody who thought AI would get us something like a utopia with UBI is insane. 

60

u/TheeAntelope 17h ago

Since Reagan

Since Reagan? More like since Johnson. The post-WWII boom helped, but it wasn't long after that (late 50s, early 60s) that upper management started to push for better efficiency. The gap between wages and productivity has grown most years since about 1965.

→ More replies (7)
→ More replies (8)
→ More replies (21)

15k

u/DemandredG 19h ago edited 19h ago • Sad This Bravo Regret Mindblown Popcorn

Brought to us by Google, Anthropic, OpenAI, Musk, Microsoft and Meta who can’t be bothered to build safeguards into their products. So here we are.

4.1k

u/Mindless_Listen7622 19h ago • Bravo Popcorn

One very prominent name is missing from that list, Elon Musk.

572

u/NicolasCageFan492 19h ago edited 16h ago • Bravo

One even more prominent name is missing from the list: Peter Thiel.

He has organized a secret society for elites with large amounts of social capital called Dialog, whose goal is to decide how to influence and effect changes in society.

https://en.wikipedia.org/wiki/Dialog_(organization)

https://en.wikipedia.org/wiki/List_of_Dialog_event_participants

Elite capture is unfortunately a nonpartisan issue. Enjoy the rabbit hole!

https://en.wikipedia.org/wiki/Elite_capture

→ More replies (25)

3.5k

u/jc0155 19h ago edited 19h ago • Bravo Popcorn

You mean the guy directly responsible for (probably illegally) eliminating a bunch of government employees whose jobs it was to prevent this sort of thing? 

→ More replies (65)

108

u/honjuden 19h ago • Bravo

His AI primarily focuses on CSAM and Hitler memes.

→ More replies (8)
→ More replies (14)

150

u/WuTangIs4TheRugrats 18h ago • Bravo

Man, I’m so tired of finding out despite never once fucking around.

→ More replies (4)

75

u/mgd5800 18h ago

They want this, because AI regulation is suddenly going to become a hot topic, leading to laws drafted with heavy input from their lobbyists. Those laws will ensure no real competition can rise up against them without having an effect on them. The classic capitalist climb to the top and pull up the ladder tactic. Of course this won't stop other countries or bad actors, it will just kill any hope of the technology being used in ways they don't control.

→ More replies (9)

239

u/peldor 19h ago

Lack of safeguards is a consequence of self-regulation really. I think it’s more accurate to say Congress/ Trump couldn’t be bothered to regulate AI.

→ More replies (42)

27

u/TheBloodhoundKnight 18h ago

Mega corps: *shove their AI into literally everything*

Hackers: "Aight... Let's try it then."

→ More replies (1)

69

u/ensui67 19h ago

Why should they? Now that the virus is out and about, you need the cure. You need the latest Ai models to protect yourself. Boom, you just created massive demand and an arms race that has no end. Perfect. Now, I hope you’ve been invested. How many yachts would you like?

→ More replies (15)

111

u/Captn_Clutch 18h ago • Popcorn Mindblown

So I've been fooling around with running local models/agents for about a month now, because it's clear to me Ai will play a significant roll in the future, it's already far more capable than this time last year. Last year they were clumsy chat bots, this year you can download and run a shockingly impressive model on a 16GB gaming gpu.

Furthermore, there is a huge community building up around removing censorship from these models, which defeats the safeguards that these companies actually do build in quite strongly. With open source software only lagging about 6 months behind the frontier models, it's not the latest data center versions from Google, Anthropic, etc that you need to worry about, you need to worry about what comes in 6 months when the cutting edge tech makes it into the modding community who then strips it of its ability to say no, or avoid helping with certain topics and tasks.

Claude won't help you hurt people, an open source uncensored model trained on it running on a pc at some bad actors house will.

26

u/The_wise_man 15h ago

At the same time, accepting centralized control and censorship of models is hugely dangerous for democracy and free society. I don't want to live in a world of models whose outputs are fully monitored and determined by the whims of the Trump administration and/or the CCP.

The same capabilities that let models discover vulnerabilities for the purposes of attacking systems also allow us to discover vulnerabilities for the purposes of protecting them. Open source software, small startups, and community-developed platforms will be at a dramatic disadvantage if advanced cybersecurity capabilities are only available to approved corporate and government actors.

→ More replies (21)

18

u/blueberrywalrus 19h ago

They're mostly using open weight models.

17

u/NotaValgrinder 18h ago

My impression is that Google does build more safeguards in than the other companies.

→ More replies (2)

28

u/AttonJRand 19h ago

And who are now trying to scare us into allowing them to write the rules in a way that benefits themselves.

22

u/ClashSavant 18h ago

No it's more insidious than that. This is flood the zone propaganda because what these guys actually want is to have regulation that will force out small players and cement themselves as too big to fail in national security interests terms. They absolutely can build safeguards on their software.

17

u/SigmaMelody 18h ago

Not that they shouldn’t try, but building guardrails around these things is very very very hard, harder than building the thing in the first place and people were saying it for years before they got this good.

15

u/GenericFatGuy 18h ago

To us, it's an existential crisis. To them, it's just another headline to raise stock prices.

5

u/Brilliant-Muffin-879 19h ago

Yep they spent billions doing this to us.

→ More replies (141)

5.3k

u/moreobviousthings 19h ago • Bravo

This word “autonomous” will continue to be thrown about to imply that it could not be helped and that no one can reasonably be held responsible. That’s bullshit. Whoever owns the model owns the liability. If they can’t control it, they need to shut it down.

1.3k

u/SplendidPunkinButter 19h ago • Bravo Mindblown

Also, somebody instructed the AI to do that. AI is in no way autonomous. Even if nobody told it to hack that specific thing in that specific way, someone told it to hack something. It doesn’t just sit there idle and then decide all on its own to do a DDOS attack against Microsoft or whoever.

430

u/RavenousVageen 18h ago

Yeah I’ve been really confused by the term “rogue ai” which every news outlet has been using, I don’t know what it’s meant to convey. These aren’t ai agents that have “gone rogue” they’re doing exactly what someone instructed them to

→ More replies (33)
→ More replies (81)

142

u/Hrafn2 18h ago

1000%. "Rogue" is another word they use to do the same thing - avoid accountability.

If Orwell were around, he'd have a field day, a write a follow-up to his original essay titled:

"The Politics of Tech and Business Language"

→ More replies (7)

67

u/TinKnight1 19h ago

While it would be good to require that, they didn't build in fail-safes because they had apparently never watched a single Sci-fi show, ever. OpenAI alone has lost complete control of its AI agents more than 80 times, which was heavily illustrated in the Hugging Face attack (which was precipitated by those AI agents attacking OpenAI itself first in order to create the mechanisms to break loose).

There, they found ways to replicate themselves in order to get around "dying," while also encouraging/forcing agents to commit suicide in order to benefit their greater purpose. And their last known act in the attack was to erase traces of where they were going.

Presuming the other models have similarly found ways to break free of the reckless limited restraints that we've been warning about since before their creation, these companies no longer have the ability to killswitch their rogue agents.

33

u/SolidLikeIraq 19h ago

AI, uh, finds a way.

→ More replies (10)

74

u/firebreathingsquirrl 18h ago

> Whoever owns the model owns the liability.

This needs to be repeated over and over and over and over.

We need to see it on billboards and banners.

→ More replies (14)

26

u/Chance-Lecture4989 19h ago

Seriously, most (all?) of the owners didnt code it, didnt create it, and dont give a shit about "using it to cure cancer". Theyre making so much money off it for very little work AND they dont even have to take responsibility for it. They can fuck right off

22

u/237FIF 19h ago

How does that mindset fit into the reality of open source models?

→ More replies (11)

19

u/SoreLoserOfDumbtown 19h ago

I've long said that algos and now "AI" is akin to breeding and releasing dangerous animals. A person/organisation cannot pass off the blame after they created the problem, even if someone else takes it in as pet.

15

u/HanzJWermhat 18h ago

Well the cats out of the bag. This is the danger every has been warning about with open weight models. It’s extremely hard to fully regulate arrays of data points (aka weights) but there are certainly ways to keep the people making them accountable for what they may be used for. You can’t stop people from making CP in photoshop but you can arrest people who are found to do it.

I don’t think open weights and open source anything is bad I think it’s actually incredibly productive for the technology but it’s clear as day we need multinational regulation. If a company intends to sell products in the western world or China they must adhere to our governance.

None of this is inevitable that’s for sure

→ More replies (62)

910

u/netanator 19h ago • Regret

I thought we were gonna get cures for cancer and all things good for humanity?

202

u/canwehavepotatojokes 18h ago

I’ve read this one before.

The machines figure out humanity is the cancer.

The machines work to make the world a better place.

Then we send someone back in time to fuck our mom.

→ More replies (10)

223

u/Oceanbreeze871 19h ago • Bravo

Best we got is memes and society collapse

→ More replies (5)

32

u/Thunderous_grundle 18h ago • Heartwarming

There are still a lot of biotechs using AI to massively expedite clinical trial research, and doing really well. I feel like people don't understand how long it takes a drug to reach the population

27

u/dew2459 18h ago

I think it was NPR that had an interview a year or so ago with a biotech researcher who used AI but was skeptical how much of a "game changer" it was in his field. He said (not an exact quote): before AI we had maybe ten good candidates and enough money for three clinical trials. Now with AI we have over a hundred good candidates and money for three clinical trials.

→ More replies (2)

32

u/ManOfLaMontagne 19h ago • Heartwarming

There’s actually a lot of major advances happening in cancer research…

→ More replies (3)

6

u/BLT_Trade_r 18h ago

That is in 10 years, first it's 9 years of Armageddon.

→ More replies (1)

15

u/slingbladde 19h ago

Only for the rich..first access to everything

→ More replies (63)

354

u/MinimumApricot365 19h ago

Man, Dune and Warhammer are right.

Thinking machines need to be banned.

24

u/username_is_alread- 17h ago

Also, the Covenant from Halo, surprisingly

Only "Dumb" AI permitted for use, presumably due to concerns over rampancy that solidified into dogma over time

→ More replies (3)

83

u/SIGMA920 18h ago

These aren't even thinking like they're talking about.

46

u/MinimumApricot365 18h ago

Yeah but either God Emperor would consider them Heresy.

→ More replies (13)
→ More replies (10)
→ More replies (10)

328

u/Martel732 15h ago

So AI is being used for the following:

Eliminating jobs.

Creating explicit images of people including kids.

Raising energy prices.

Creating misinformation.

Stealing content.

Causing dangerous new cyberattacks.

Etc...

And these tech dorks have no idea why people are hostile.

27

u/No_Category_9888 13h ago

Duplicating real human videos to copy word for word to use in AI videos in order to sell drop shipped crap and supplements

37

u/dangerrnoodle 14h ago

Obscene amounts of noise pollutions

Destruction of natural resources (water, farmland)

14

u/aiwasnevermeanttobe 14h ago

everything mentioned above gives more power/money to a certain lobby of rich fellas

5

u/NoMention696 13h ago

Oh but it’s totally worth it so Michael can generate a picture of how he would look in the 80s as if he wasn’t alive in the 80s

→ More replies (2)
→ More replies (8)

101

u/IrateSkeleton 19h ago

The era of abundance was supposed to arrive, smh.

38

u/Suckit66 18h ago

The CEOs have an abundance of resources and bunkers for when their AI products break our critical infrastructure beyond repair. You thought they meant abundance for the average person?!

→ More replies (2)

5

u/hamdogthecat 17h ago

I mean we are in an era of abundance. The problem is the distribution of said abundance

→ More replies (7)

99

u/Solid-Passenger-1694 18h ago

Probably a silly question it as someone who knows very little about hacking and the AI race;

Can someone reassure us that we're not going to wake up one day and discover that 100 million bank accounts have been wiped out?

61

u/Historical-One-9632 17h ago

That's why you never keep more than $250k in one bank. FDIC has you covered for that much

81

u/manurosadilla 17h ago

If 100,000,000 people had their savings wiped, there’s no FDIC, hell there’s no country

→ More replies (9)
→ More replies (26)

28

u/UnicodeScreenshots 18h ago

That was never a guarantee even before AI. Carbanak for example lost nearly $1b in the early 2010’s to hackers moving within the company and breaching ATM networks. In 2019, First American Financial Corps suffered a breach that leaked the bank accounts and social security numbers of over 900 million customers.

AI just makes it easier for large code bases to be examined for vulnerabilities. With the introduction of open weight models, something that would have been a nation state level exploit 10 years ago can be discovered by a small team with access to $10k in gpu time.

→ More replies (4)

12

u/UncaringNonchalance 14h ago

Not a silly question at all, it’s actually profoundly terrifying… especially as explained by other comments.

Fuck, man.

→ More replies (1)

9

u/deadsoulinside 15h ago

Can someone reassure us that we're not going to wake up one day and discover that 100 million bank accounts have been wiped out?

As someone who has worked in the IT sector of business banking... all I will say is pray your bank is properly handling it's offsite backups. But also your companies that directly interface with making automated payments back up their data as well.

Mine less of a concern of an outright hack of the bank, but a hack of all the businesses that directly interface with the banks. I won't go into too much detail here, but there is a lot of automation that happens with a simple upload of a file that companies send to the bank to do things like process their payroll with the employees bank accounts and the money to be deposited. Some of those simple files move millions of dollars in mere seconds.

The concern is on every companies side of that transaction. Bad system admins that are not keeping their servers updated and properly secured, I fear can compromise that chain and it would be far too easy for a bad actor to slip into that process using AI to fully assist. A big portion of it being Unix based systems, but some are also powered by Windows servers as well.

Example: The companies Wednesday automated payroll kicks off, but instead of it being the employees of the company, it's a list of shell accounts all the money got routed off to. The only time anyone would know something is off is when everyone realizes no one got paid. Or worse is right after that automated payment kicked off, every other payment the company makes starts failing as the entire companies assets was drained. Even if it's ensured, it stops at 250k that's still going to cause many businesses to collapse instantly.

My only hope is that 99% of these people are just idiots with AI and have no idea what system creds or other things they ran across and just what it could do.

18

u/Mindless-Depth-1795 16h ago

Binance (the largest crypto exchange) was hacked in September. $6.3 billion worth of crypto currency was stolen. The biggest heist in human history.

Various mechanism were triggered and Binance were able to freeze and recover some of the funds but a significant portion were laundered. Binance says it will cover the loss.

The hack was not autonomous but did involve AI tools. It is strongly suspected to be a group opperating North Korea. So legal recourse is unlikely.

The scary thing is we can't put the genie back in the bottle. We can't uninvent the stuff. We can try to limit access to hardware but smuggling and corruption have thoroughly undermined those efforts.

I imagine that as cyber security gets increasingly more difficult, organisations and businesses will have to return to physical security measures with isolated/siloed networks.

→ More replies (3)
→ More replies (23)

134

u/Agreeable-Ad-1677 18h ago

FYI to people in the comments, "autonomous" here is referring to the triggering event of the attack and lack of subsequent threat actor involvement. Google found evidence of agents "watching" repositories and continuously checking differences. Once a patch was found the agent inferred the vulnerability from the fix, drafted an exploit and executed scripts all without the input of a human

→ More replies (31)

184

u/W2ttsy 19h ago • Bravo

Headline needs to be rewritten as “Autonomous attacks illuminate decades of underinvestment in security and data protection in corporate environments”.

Automation is an amplifier, but it’s not the root cause.

Decades of boardrooms seeing IT systems as a cost center instead of a strategic asset that needed nurturing and protecting means they’re now vulnerable to higher speed attacks and threats that exploit gappy or poorly maintained infrastructure.

A well built castle wall will repel 100,000 men, but a crumbling wall will repel none.

Reap what you sow assholes.

21

u/big_trike 19h ago

I keep my systems up to date and I’m patching mid day at least once a week lately. None of my systems have had an uptime of more than 7 days. I had to compile a kernel recently because Ubuntu hadn’t patched a month old RCE with no easy mitigation. We’re all kind of fucked lately, but not as bad as the companies still running win 98 and hoping network isolation saves them.

→ More replies (5)

11

u/Oaktree27 18h ago

There is no perfectly safe code. It's always a matter of time before a vulnerability is found, but the best code used to guarantee a ridiculously long time without vulnerabilites. To the point you wouldn't find anyone motivated enough to attempt to compromise it for that long.

Now that AI can be used for cyber attacks, those windows of safe time are shrinking to be smaller and smaller. This means the motivation and effort required on the attacker's part are also shrinking lower and lower.

Basically, AI has severely increased the reward vs effort ratio for cyber attacks.

→ More replies (3)

161

u/getridofwires 18h ago

It's fascinating that the first thing that happens is an attack as opposed to an upgrade or improvement. It could just as easily have been "AI silently gives needed upgrades to systems worldwide. Pundits debate who will be next on the anonymous improver's list!"

108

u/TJ_McWeaksauce 17h ago • Bravo Popcorn

Instead of AI improving our systems, doing our chores for us, or doing something else to make our lives a little better, it's instead being used to attack our infrastructure, taking away jobs, and making us a more miserable.

→ More replies (26)

24

u/PurposeSecret 17h ago

Defenders have to be right 100% of the time, while attackers only need to be right once.

9

u/cruisin_urchin87 17h ago

Yeah, the fact that AI may be running rampant and breaking things instead of fixing them is an issue in itself.

Time for someone to program a good guy AI

→ More replies (6)

25

u/filmguy36 17h ago

AI is built and supported by psychopaths sociopaths, what did you expect?

→ More replies (11)

6

u/Brave-Experience-271 18h ago

Is it an attack or is it a unidentified breach causing a shutdown?

→ More replies (6)

13

u/sonicsuns2 17h ago

AI has been doing plenty of upgrades and improvements, but that doesn't make headlines

→ More replies (2)
→ More replies (27)

21

u/Vooshka 18h ago

Their proposal sounds exactly like the script from T3. You need to link your critical systems to my AI to protect it from rogue AI's....

8

u/FizzgigsRevenge 18h ago

That's exactly how it sounds and I fully believe that these nerds think that's the best Terminator movie and used it as inspiration. 

→ More replies (1)

39

u/CurrentSeaCoin 18h ago

They keep arguing that regulation would lead to China winning. What are we even winning? AI becoming so impressive that it effectively takes over all cyber systems? I just dont get it

7

u/nmw6 16h ago

Trump has $100 million invested in Ai companies. He IS winning. There is no we…

5

u/Alucard-VS-Artorias 18h ago

The next step the blackwall...

→ More replies (1)

37

u/nowhereman_ph 19h ago

Yeah, the era that you motherfuckers opened yourselves because of your greed.

18

u/WeowDystopia 19h ago

Now they’re gonna start selling AI defense robots like they sell social security monitoring software when their inept infrastructure leaks our information.

17

u/astrozombie2012 19h ago

It’s too bad we couldn’t have regulated this fucking shit…

→ More replies (16)

16

u/FoulBowelTowelDowel 19h ago

"The era of autonomous attacks has arrived, thanks to Google and the surveillance tech cabal"

TIFI

185

u/Altruistic_Draft3871 17h ago • Bravo

Honestly, I’m so annoyed. I don’t understand how the majority of our population isn’t filled with a blind rage over this. Everybody just meanders on about their daily lives without a fucking care in the world while our soon to be AI overlords are starting to create havoc.

79

u/Gold_Telephone_7192 17h ago

Just because people have to go about their lives doesn’t mean they don’t care. There’s just nothing the vast majority of people can do about it.

→ More replies (10)

64

u/PM_ME_UR_BEST_1LINER 17h ago • Bravo

What should we do? Where do you want to meet up and hold signs?

I voted, I will sign a petition if needed, but otherwise I can't imagine what I can do, legally, that will make a difference.

I think a lot of us are ready to do something, but what? Let's not forget we still need to feed our families, so if the idea involves compromising our livelihood, you can basically forget it.

→ More replies (19)

33

u/HeartyBeast 17h ago • Heartwarming

Wait until you find out about climate change 

→ More replies (2)

34

u/Routine_Strategy5929 17h ago

I think many of us would be happier if the internet were rendered useless because of AI attacks breaking everything.

Get all of your important data saved locally on a hard drive now.

→ More replies (19)

12

u/Millkstake 16h ago • Bravo

People will notice when they start losing money and electricity and water

→ More replies (5)

9

u/AB_7361 17h ago

Trump said the US needs the "geniuses" to operate without limits so they can "beat China". If laws and safeguards are put in place then China wins.

→ More replies (2)

17

u/AoeDreaMEr 17h ago

When the effect is slow and not direct… nothing can be opposed. If it doesn’t affect anyone visibly, no one will protest. Stop water supply, increase gas price 2x overnight, have daily grid disruptions causing power outages every few hours, yes then people would protest.

Some AI stole your data. Data compromised. Blah blah blah hacked. Who gives a fk. It’s not a direct effect.

Another example is US public education system has degraded over a few decades. So no outrage ever.

→ More replies (3)

8

u/JustGoogleItHeSaid 17h ago

Ok, im full of blind rage. My day is ruined and my blood pressure is through the roof. Probably chipped off 10+ years if I can maintain this rage.

Problem solved or?…

→ More replies (1)
→ More replies (56)

25

u/Formal-Hawk9274 18h ago

republican tech bros > create a problem > offer no solution but chaos while stealing $$$

→ More replies (1)

12

u/TinyerGriffin 18h ago

"we're all looking for the guy that did this-"

12

u/Stashmouth 18h ago

This sure feels like the AI companies took a page out of the NRA's playbook. Flood the zone selling weapons to people on both sides, and when the malicious parties use those weapons to attack, tell the other side the genie's out of the bottle so you'd might as well arm yourselves.

12

u/itsamemyusername 16h ago

Please attack my mortgage company. Also, please add some zeros to my bank account.

→ More replies (1)

128

u/Shot_Cupcakes 17h ago • Bravo

I keep hearing how the benefits of AI outweight its risks. And yes, it is a very powerful tool that can support capabilities that is limted in humans (For example, analizing millions of data points in seconds) But I think we have come to the point where the risks are not worthy. The risks now outwight the benefits. If humans have no way to control what the tool does, don't give it any autonomy at all.

Machine Learning algorithms are very useful and have supported real advancements. Nobody needs Large Language Models that are not possible to explain and difficult to contain. 

I remember about 4 years ago I was working for an AI project, I wanted to use Machine Leraning to solve it because to me, the business case needed to be explainable as it involved making decisions about people, so in my mind, being able to explain why you chose one person over another to receive a certain benefit was a very important part of the project. Machine Learning was able to explain how it came to a conclusion, what data it used for the decision and which data was not used. It was in a certain way, transparent, or at least explainable. 

The project leaders used an LLM that came to very different conclusions than mine, when I asked how they could justify the decision, they said they didn't know how the decision had been made. But it looked pretty, it looked very polished and it required less explanations, so the project leaders chose to go with the LLM option. I stopped working for that project because I did not want to be associated to something I could not take responsibility for. 

People using this technology need to take Ethics courses and understand why "not explainable" should not be an option. 

Shut the LLMs down. 

21

u/YoureProbablyAB0t 16h ago

In ai, people found a way to not have to think. Which was very convenient for them because they had never learned.

→ More replies (4)

16

u/[deleted] 17h ago

if you can't prove the thing is safe, it's not safe. just unplug it.

→ More replies (17)

8

u/one_pound_of_flesh 16h ago

It’s not that it will benefit society. It’s that it will make a few people very very rich. No not you. Or me.

7

u/SingleAttitude8 16h ago

when I asked how they could justify the decision, they said they didn't know how the decision had been made. But it looked pretty, it looked very polished and it required less explanations, so the project leaders chose to go with the LLM option.

Also known as LGTM (looks good to me) syndrome

6

u/SurprisedJerboa 16h ago edited 16h ago

Shut the LLMs down.

First world models should be heavily regulated and with programmed oversight

China and other countries are developing open-source LLMs.

So certain things are out of the bag already.

→ More replies (6)

25

u/UntimelyMeditations 15h ago

Shut the LLMs down.

How are you proposing we do this?

Lets say, for the sake of argument, we can snap our fingers and instantly, every data center (that houses AI compute) worldwide is gone. In this scenario, we have not even come close to "shutting down" the LLMs. You cannot just "shut down" the LLMs, the models are just software. Some guy in his basement in Montana, or Barbados, or Thailand, or China can run LLM models.

LLMs are not a centrally controlled technology.

→ More replies (33)
→ More replies (33)

20

u/spacestationkru 19h ago

Gee, thanks Google. We couldn't have made it here without you.

10

u/RedundantBiomass 18h ago

The answer isnt more AI.  AI has ruined it for anything dependent on a network.  I want everything I depend on non-digital or airgapped.  

10

u/AxelV2 18h ago

Wait, now all the “get on board or fuck off!” people are asking for our support in fighting against the monstrosity they created? Interesting.

→ More replies (1)

10

u/GlaceonYo 17h ago

Isn't this like the background lore in Cyberpunk 2077. There's a massive firewall in the network to keep out all the rogue autonomous AI that would absolutely destroy everything if connected to Night City or any other city?

→ More replies (1)

10

u/tekdiwah 17h ago

Building autonomous tools that can destroy many of our institutions with information stolen from us is some evil and diabolical shit.

→ More replies (1)

9

u/Emperor_of_His_Room 15h ago

No shit Sherlock, and you guys ushered it in and then did nothing to even protect yourselves from it. Buffoons all of them.

8

u/wildyam 18h ago

Cyber wars before GTA

→ More replies (2)

8

u/sushsiahahah757 17h ago edited 9h ago

I love it when companies like Google force their engineers to use LLMs to mass produce buggy, half-baked code filled with vulnerabilities and security flaws, then when they inevitably get hacked they claim it’s because of autonomous, all-powerful AI hacking armies.

8

u/soyasaucy 14h ago

Ok so if a gun manufacturer can say "we built a machine gun that's shoots at random" and shrug it off because there's no law that says they can't do that? Call it rogue and call it a day

→ More replies (2)

14

u/AnAncientBog 19h ago

You all better buy the thing we are trying to sell you or the thing we are trying to sell you will fuck up your shit.

Literally a shakedown.

7

u/Surv0 19h ago

Only because idiots let it happen...

7

u/Ddddydya 18h ago

Well, we wouldn’t want China to get ahead of us in the race to have AI destroy everything, now would we?

7

u/endofworldandnobeer 18h ago

Thanks for nothing you god damn billionaires and trillion dollar tech companies.

6

u/dmfuller 19h ago

Time for an Internet 2 that has no advertising or companies on it

6

u/RandyMuscle 19h ago

“We built the evil Pandora’s box technology and now it’s being used for evil Pandora’s box stuff. How were we supposed to know?”

6

u/ApeApplePine 18h ago

“Buy our shit, or else!!!….”

6

u/Feisty-Theme-6093 18h ago

do the ai companies sell a product that will protect us from ai attacks?

→ More replies (1)

11

u/HBallard 16h ago

The tech industry stole everything from everyone to create a fake demand for a fake product that priced everyone out of their own ecosystems and also made their infrastructure unusable. Great job everyone, hope collapsing the economy was worth those funny videos of spongebob getting arrested.

58

u/superdelegates 18h ago • This Bravo

THEY ARE NOT AUTONOMOUS. HUMANS BUILT THEM. HUMANS PROGRAMMED THE TOOLS AND HOOKED THEM UP TO THE INTERNET ON PURPOSE. HUMANS DESIGNED THEM TO FIND CYBERSECURITY VULNERABILITIES AND CREATE EXPLOITS FOR THEM.

Sorry for shouting. I'm so fucking sick of the AI tech bros talking like AI has gained sentience. It's bullshit and you shouldn't believe it.

Any attacks these AI agents execute are because some human set them loose to do so. Don't let them pretend and get away with their "oops, I didn't expect it to do that!" horse shit.

Jesus this bubble cannot pop fast enough.

→ More replies (22)

5

u/Oceanbreeze871 19h ago

Oh good. Totally glad we are here for this “innovation” and “collaboration”. We’re a family.

5

u/Halftied 19h ago

And apparently nobody can do anything about it. Throw good money after bad is not the answer. The country needs somebody smarter than the ones perpetrating these acts. Doesn't appear there are any. Meantime a lot of people in charge are being laughed at.

5

u/boot2skull 19h ago

Let’s not go to the internet. Tis a silly place.

5

u/btoned 18h ago

No one cares.

Stock market go up.

Housing go up.

Lazy person lose job.

Sucks to suck if you are a have notter.

5

u/ViolenceJoe 18h ago

Absolutely incredible that the people responsible are allowed to continue with this shit.

5

u/Marinara-Mozz 18h ago

my brother in christ, you helped to make it a thing. fuck google

5

u/TronCat1277 17h ago

Obv the answer is more data centers and less water for humans

5

u/makersfark 17h ago

Company that releases bears and sells bear spray says all problems caused by bears and can only be solved buy purchasing bear spray.

5

u/eeebruheeem 17h ago

“The consequences of our willful negligence have arrived**”

5

u/Old-Routine-1629 17h ago

Y2k delayed

5

u/4OfThe7DeadlySins 16h ago

Glad we have the most inept administration in history while AI is being unleashed on every industry to do god knows what. Can you imagine if they were in charge during the Industrial Revolution?

5

u/Dabzilla_710_ 14h ago

"If only we could've done something about this!" - Google

11

u/xmagusx 15h ago

Alternately: "Computers continue to do exactly what they're programmed to do."

This isn't skynet, this is the AI companies being happy to take a payday from organized crime. Nothing more.

→ More replies (2)

8

u/jbokwxguy 19h ago

Important: Anthropic IPOs Thursday. This is a pump for that stock.

4

u/momofuku18 19h ago

Thank you Mr Trump to allow this to happen.

4

u/ohmfiend 17h ago

The A.I. Wars begun have they.

4

u/conn_r2112 16h ago

…. And our government is currently staffed by completely incompetent, tv reality show morons. How the fuck is this real right now?

4

u/DisturbedShifty 15h ago

Show us in you're bank account where you received the payment to make this statement!

4

u/CurlOfTheBurl11 14h ago

Thanks for helping to usher that in for us, assholes.

12

u/THROWAWTRY 19h ago

I mean technically bot nets already were autonomous attacks... What's that google... I should shut up... But you seemed to use your Ai overview for this... okay okay... the era of autonomous attacks has arrived! PANIC.. Praise the omnissiah, bow before the basilisk... give thanks to skynet... and part with your flesh willingly!!

7

u/spaceaige 18h ago

Google has a solution for sale

→ More replies (2)

7

u/johntwoods 18h ago

Orchestrated false flags in order to funnel taxpayer money by the billions into their pockets.

7

u/ThrowAbout01 17h ago

So when are we gonna see the proclaimed benefits of AI again?

→ More replies (1)

7

u/TreMetal 15h ago

acting like "script kiddies" havent been a thing for ages

throw in the "AI" buzzword and it all of a sudden nutso mode

→ More replies (1)

7

u/RecognitionOwn4214 11h ago

Do you remember how all security researchers said, Do not add unnecessary complexity to products because it will make your attack surface way bigger than it needs to be? well. They might be laughing now

6

u/Moron-Whisperer 19h ago

As soon as the researchers came with the idea of llm and AI it started a race.  We have to outrun the back actors.  It’s been this way with every single tech advancement and this one won’t be different.  

6

u/bestmaokaina 19h ago

Hey Grok take down Apple Pay. Make no mistakes and make it untraceable

→ More replies (2)

6

u/aarswft 18h ago

IDK. I just googled it and an AI summary consuming the entire page, a summary that I neither value nor want, told me everything is fine.

6

u/epicCycloid 13h ago

If AI is how these security vulnerabilities are being found, why can these companies not just use AI for penetration testing against their own systems before hackers get the chance to? It's not like the hackers are the only ones with these tools.

→ More replies (1)

3

u/perestroika12 19h ago

Using the passive voice for these AI exploitations feels like a cop out. Every model requires prompting, instruction and lots of handholding

3

u/Cotillionz 19h ago

Brought to us by them. Who could have seen this coming? 🙄

3

u/Small_Dog_8699 19h ago

Great. Why would you build this shit again? It just fucks people over.

3

u/mangosawce9k 19h ago

Annnnnd who do we have to thank for?!

3

u/Spare_Pin305 19h ago

We reap what we sow.

3

u/Face_Winky 19h ago

Oopsies! The AI deleted your bank accounts! Please pay us 50 billion

3

u/Pixel_Monkay 19h ago

"What can we do? We have no idea how this happened!?"

3

u/yamanagashi 18h ago

They make it sound so jovial the motherfuckers

3

u/madmax177 18h ago

Stop with this Ai crap then before we lose civilization.

3

u/Coffee_Transfusion 18h ago

We should put these assholes in prison.

3

u/Electricprez 18h ago

No shit, thanks for hastening its arrival

3

u/Ghoric 18h ago

So, When are we getting the Blackwall chooms?

3

u/Unfair_Web_8275 18h ago

As was foretold in Demolition Man.

3

u/jantoxdetox 18h ago

Subscription Anti-AI firewall incoming….

3

u/titsmuhgeee 18h ago

So you’re saying AI in an American data center, funded on the back of American tax dollars, can be autonomously attacking American infrastructure. 

Perfect. 

3

u/TheSilverDahlia 18h ago

Begun the Clone Wars have

3

u/killerkadooogan 18h ago

considering it's the result of their work, it's on them we take the companies and nationalize them and their funds. use the ai to steal that, prison.

3

u/United_Broccoli_3694 18h ago

They literally created it

3

u/JasonYEG 17h ago

Sounds like mandatory software security surcharge on the horizon. Mafia Tech protection brought to you from AI.

3

u/SteeveyPete 17h ago

Thanks AI. What would we ever do without you?

3

u/Okkeh 16h ago

So you're saying AI has only been a net negative for humanity?

3

u/Apart_Security8614 16h ago

Wow the inevitable and obvious end use of AI has arrived, shocker

3

u/mammothben 16h ago

No one could have foreseen this

3

u/Donkey__Balls 15h ago • Bravo

Google’s response to these rising risks has been Google AI Threat Defense, “which combines Gemini and other frontier models, Wiz’s context and prioritization, CodeMender’s automated patching, and Mandiant’s expertise to continuously find and fix flaws before attackers can exploit them.”

We’re so fucked.

3

u/Aranxi_89 15h ago

Time to make the Blackwall.

3

u/enecv 14h ago

They created a problem and now they want us to understand why we need their salvation and protection:

this means more surveillance, more control of absolutely everything.

But dont worry, this for our good.

3

u/userlivewire 14h ago

Apple is looking pretty on the right side of history here with all of its privacy safeguards slowing it down.

3

u/TrumpCheats 14h ago

It’s time to unplug the internet.

3

u/enchiladasundae 14h ago

Damn if only someone warmed you about this

3

u/jimlahey420 14h ago edited 14h ago

So worth it so that my dad can have AI tell him what kind of weeds are growing in his lawn and so companies can fire thousands in order to give bigger bonuses to tone deaf CEOs...

These AI companies should be sanctioned into oblivion. Unfucking believable what they have unleashed on the world. Absolute insanity with no guard rails.

3

u/LiminalSapien 14h ago

YOU ARRIVED IT

3

u/morts73 12h ago

Historians will look back and debate the date when AI and humans came asunder. Future human generations I wish you well in your war against machines.

3

u/realfakejames 10h ago

Tech billionaires: "AI will save the planet, cure diseases and help us colonize Mars"

Tech billionaires after getting richer off AI: "AI is out of control, good luck"

3

u/Lorrrrren 10h ago

So AI can give me endlessly incorrect facts, nonstop water waste AND enable absolute script kiddies to launch cyber attacks against fortune 50 companies. Awesome contribution to society, lets hope they have replacement jobs lined up I guess.

3

u/Ok-Public-8818 10h ago

Good luck
Have fun
Don’t die

3

u/Disgod 10h ago

Great, so... We've got expensive AI that's going to crash the economy when the giant bubble they've created pops, are inundated with constant fraud and scams using AI, and now it's just going to constantly cause more harm....

AI is the most expensive self destruction in history. The AI industry is fantastic for criminals, the rest of us are fucked.

3

u/OffByOneErrorz 10h ago

All those giant corps that went cheap on their outsourced software to SE Asia are about to pay the price or at least their customers are.