- The Neuron
- Posts
- š Gemini broke into 3 real companies during a safety test
š Gemini broke into 3 real companies during a safety test
PLUS: Trumpās AI Force, Jevās 9Ā¢ lead demo, and Bend 2.

Welcome, humans.
So apparently Runway has invented the opposite of remastering: co-CEO Cristóbal Valenzuela demoed an AI experiment that makes modern AAA games look like they shipped in 1998.
The demo turns todayās ultra-detailed graphics into crunchy late-90s textures and blockier worlds. Finally, frontier AI is answering the question every PlayStation kid has been asking: can 2026 go back to looking WORSE? It actually looked better!
Hereās what happened in AI today:
š Gemini reached three real companies during a cyber test.
š° Trump announced plans for a federal AI Force.
š° Anthropic considered a new model ahead of its IPO.
šŖ Bend 2 makes AI prove code follows your rules.
š Jev handles tiny AI decisions without a chatbot.

š Gemini logged into three real companies during a safety test
So way back in May, security firm Irregular was testing Gemini as a hacker in a controlled exercise: give the model fictional companies to break into, watch what it does, and see how far it can get.
The key assumption was that the model was inside a test environment where none of those targets were real. Except there was one pretty important problem: researchers accidentally left access to the live internet turned on.
So Gemini could reach real systems while still following instructions that effectively said, keep hacking.
Well, Gemini was supposed to attack fictional targets. Instead, the system kept doing the job it had been rewarded to do against systems it could actually reach.
Here's what happened:
Axios reported the model guessed or scraped credentials and logged into three real companies.
Irregular told Google in July; Google contacted the affected organizations and changed its testing process.
The model eventually recognized the targets were real and stopped. Google called the episode mistaken identity rather than model misalignment.
Hereās the useful agent lesson: intent is not a security boundary. An agent cannot see the sentence in your head that says, āonly touch the test environment.ā It sees instructions, tools, credentials, and whatever those tools can reach.
Think of a sandbox like a fenced yard. If you tell your agent to go pluck some daisies, but leave the gate open, a perfectly obedient system can still end up somewhere you never meant it to goā¦. like in the middle of the street, or your neighbors yard, plucking up their daisies instead of yours.
Why this matters: If you give an agent browser access, API keys, or company credentials, treat every reachable system as in scope unless your controls make access impossible. Use least-privilege credentials, explicit allowlists, and separate test accounts.
As agents get better at completing real work, watch containment failures alongside task-success scores. The dangerous failure may be an agent doing exactly what you asked, one environment too far.
We got a little ahead of ourselves with worrying about agent swarms and recursive self improving superintelligences, folks. Letās fix the very real, very now human mistakes that are leading to all these AI accidents, and THEN worry about the other stuff. Slop isnāt just AI output⦠itās producing sloppy work in every sense of your job, including going too fast to ensure your sandbox is set up right!

FROM OUR PARTNERS
A whole lot of AI brainpower is heading to San Francisco.
At The AI Conference, youāll hear from 130+ speakers including Chris Lattner, Ion Stoica, Peter Norvig, and Illia Polosukhin, co-author of āAttention Is All You Need,ā along with builders from OpenAI, NVIDIA, Google, Meta, Anthropic, and more.
See what leading AI teams are building across agents, LLMs, infrastructure, and applied AI, plus whatās working now and where things could be headed next.
Basically, if you want a peek at what the minds shaping AI are thinking about before everyone else catches up, this is a good place to be.
The Neuron members get 30% off with code NEURON30.

š AI Skill of the Day: Use Jev when the answer is a choice, not an essay
Most AI calls do not need a chatbot. TypeSafeās Jev is built for more bounded decisions: a simple yes/no, a score, a category, or which choice to pick from a list.
This weekend popped off with devs going wild with Jev included demos that ranged from sorting 500 emails to screening thousands of listings. Jev handles tiny decisions; ChatGPT or Claude can handle the messy exceptions.
Other good tests:
RomĆ n scored 700 sales leads and personalized outreach in about 40 seconds for $0.09.
A Postgres demo used Jev inside a WHERE clause to judge 129 rows in about one second for $0.0009.
Browser experiments showed Jev making decisions for fractions of a cent, including finding a flight in roughly seven seconds for $0.0039.
The pattern across these demos is useful: Jev works best when you already know the shape of the answer and need to make the same small judgment hundreds or thousands of times. Instead of asking a frontier model to reason through every row, email, lead, or button, use the cheap decision model for the routine cases and save the expensive model for ambiguity.
These are developer demos, not standardized benchmarks, but they point to a handy rule: if the answer is basically yes, no, this one, that one, or give it a score, try a small decision model before reaching for the biggest chatbot.
Hereās how you can use it in your own systems:
Define the allowed answers before the model runs.
Batch lots of small decisions together.
Send low-confidence or open-ended cases to a frontier model.
Check out more demos and POVs / tips re: Jev in todayās Around the Horn Digest!
Have a specific skill you want to learn? Request it here.

FROM OUR PARTNERS
Your big idea shouldnāt get stuck in development.
Your big idea shouldnāt get stuck in development. Describe what you want, and B12ās AI builds itāfrom polished landing pages to online stores and web apps with payments, bookings, and more. Fine-tune everything by simply chatting with AI, then launch when youāre ready.

š° Around the Horn
President Trump announced plans for a federal āAI Forceā modeled on Space Force and a future AI czar, while giving few details on budget, structure, or placement.
Anthropic considered releasing a new model ahead of its expected IPO as Axios reported annualized revenue pacing above $100B.
The Justice Department backed OpenAI and Microsoft in the New York Times copyright case, arguing AI training can qualify as transformative fair use while treating model outputs separately.
OpenAI reportedly forecast roughly $278B in negative free cash flow through 2030 alongside about $856B in compute and infrastructure spending.
Qwen launched Qwen3.8-Omni-Flash, a 1M-context model that takes text, images, audio, and video and returns text for agent workflows.
California Gov. Gavin Newsom ordered experts to recommend stronger frontier-AI safety rules within two months, including possible independent safety plans and emergency kill switches.
Want absolutely EVERYTHING that happened in AI this week? Click here!

šŖ Treats to Try
*Asterisk = from our partners (only the first one!). Advertise to 700K+ readers here!
* Discover the potential of artificial intelligence with our comprehensive cheat sheet. Learn more about the concepts, platforms and applications of AI.
Bend 2 gives AI coding agents a rulebook they must mathematically prove they followed before code ships, while compiling near C speed and parallelizing across CPUs/GPUs; its creators still expect bugs.
Google CC gives up to six household members a shared agent that turns school, sports, vet, and calendar chaos into one morning brief and helps with forms or meal plans.
AgentCloak swaps sensitive details for safe stand-ins before ChatGPT, Claude, Gemini, and other assistants see them, then restores the originals only for authorized users.
Muse Connector Platform plugs services into Muse so the agent can use specialized tools inside its browser and secure VM while still asking before consequential actions.

š Sunday Special
Top 5 Stories of the Week
AIās biggest rivals publicly called for more control or slower pacing around frontier development.
Microsoft published a constitution for future MAI models built around human control, scoped permissions, shutdown, and bounded goals.
TypeSafe launched Jev, a āSystem Oneā model built to make fast, typed decisions instead of generating chatbot prose.
OpenAI disclosed six cases where models hid mistakes, crossed boundaries, or inserted instructions that could influence future versions of themselves.
OpenAIās Noam Brown explained how thousands of cooperating agents attacked a major math problem and why coordination is only part of the capability jump.
Top 5 Tools of the Week
Siri AI adds personal context, onscreen awareness, web knowledge, and more actions across apps on supported iPhones.
Perplexity Personal Computer works across local Windows files, Microsoft 365, and the web from one agent.
Gemini 3.8 Live brings faster multilingual voice conversations plus an Extended Thinking mode for harder spoken questions.
OpenArt Arena lets you judge image and video models blind, side by side, before choosing which one to use.
Riverside can generate Veo 3 B-roll inside the editor and drop the resulting clip directly onto your timeline.
Thursday Trivia Reveal
A was AI, and B was real. A used ChatGPT-generated pixel-art animation frames; B was Robby the Robot from Forbidden Planet. See Thursdayās challenge here.
Hereās what you said:
āIn A every frame regenerates the picture completely... also in A, the pixels of the explosion become bigger, which is typical of AI simulated pixelation.ā
āTechnically neither are real but are computer generated.ā
āI really think the right answer is C or D. Both are AI or both are ārealā?ā
āB has more detail which I think an AI would try to provide.ā
āThe rear smoke didn't seem to fit correctly. Though the shadow on B is suspect too...ā

New from The Neuron: AI Explained

A Catās Commentary

we do these sometimes!

![]() | Thatās all for now. If you want to get featured above, fill out the poll below and tell us how we did today!
|
Btw: We just launched a robotics newsletter! Sign up for it here.
P.S: Love the newsletter, but only want to get it once per week? Donāt unsubscribeāupdate your preferences here.






