- The Neuron
- Posts
- đș ChatGPT sees your screen
đș ChatGPT sees your screen
PLUS: There's a new AI Granny to scam the scammers...
Welcome, humans.
We're now accepting advertising partners for Q1 2024, and inventoryâs moving faster than the price of Bitcoin right now.
With 470,000+ readers, a 42% open rate, and a new standalone secondary placement to offer, there's never been a better time to get your product in front of our audience.
Want in? Fill out our 60-second partnership form and let's make some magic happen.
Hereâs what you need to know about AI today:
ChatGPTâs desktop apps can see your code on your screen.
Anthropic tests Claude with nuclear agency for security.
Pony AI plans a major U.S. IPO.
Virgin Media O2's AI bot wastes scammers' time.
ChatGPT's Mac update quietly sets the stage for January's big âOperatorâ release (and by Operator, we mean âagentâ).
If you missed yesterdayâs story (and even if you read it), you might have missed this:
While January is a long time from now (AGES, in AI years), OpenAI just released two big updates to its desktop app that set the stage for whatâs to come:
ChatGPT for Windows is now available to everyone, with features like Alt + Space for quick access + companion windows to pick up where you left off.
ChatGPT for MacOS can now âseeâ exactly what you see on your desktop, and help you do stuff within apps.
For the Mac update (which is the really interesting one), ChatGPT's desktop app can now directly interact with apps on your screen.
For developers, this means ChatGPT can now read directly from:
The best way to think of this update is as a test run for how ChatGPT will interact with your computer when it becomes a full-fledged agent in January. For now, it can only see these apps, but soon itâll be able to act on your behalf.
Hereâs how you can try it yourself:
Download the Mac Desktop app + VS Code if you donât have them already.
Install this extension (link starts a download fyi), open VS Code, hit CMD + Shift + P, and type âExtensions: Install from VSIXâ (official explainer here).
Select âWork with Appsâ in ChatGPT, and add the Option for VS Code and Terminal access with the â+â next to both.
Once this is set up, ChatGPT sees everything in your open editor panes + the last 200 lines of your terminal. You can even highlight specific sections to focus GPTâs attention, just like you would with a human programming partner.
From here, ask ChatGPT to guide you as you write the code for your app (or write the code for you), then troubleshoot things for you in real-time.
FROM OUR PARTNERS
Metaview: The Worldâs #1 AI scribe for recruiting
This is awesome: Metaviewâs AI automates the toil of note-taking during interviews so that you can be fully present and focused on the conversation. With Metaviewâs highly accurate AI notes, recruiters and hiring managers at companies like Deel, Deliveroo, Sony, and HelloFresh are saving 10 hours per week.
âIf youâre not using Metaview yet, youâre making a mistake.â Zack, Founder, Pac Heights Partners
You can get started with Metaview in minutes, and it works alongside all of your existing tools.
Oh, and speaking of awesome? As The Neuron reader, you're invited to an extended free trial. That's what we're talking about!
Treats To Try.
*If you want to learn how data scientists are solving real practical challenges with agentic workflows, you need to join Vellumâs GenAI webinar. Learn best practices on building agentic workflows that automate research tasksâfrom making restaurant calls with voice to scraping review sites for due diligence. Seats are limited - grab yours now.
Symphony Creative Studio from TikTok generates fresh TikTok videos from your basic product details, letting you add avatars, translations, and TikTok-style edits without filming anything yourself (more details here).
ElevenLabs Projects helps you turn books and scripts into polished audio content by letting you organize chapters, assign different AI voices to characters, and edit specific sections.
Gemini has an app now for talking via voice chat to get answers, summaries, and help with tasks.
CuriosityXR turns your Meta Quest into an interactive teacher that shows you 3D models of anything you ask about in real time.
Recall.ai streams your web apps directly into video calls, letting you add interactive tools like language translators and sales agents to your meetings.
Zepic automates your customer messaging across WhatsApp and email.
*This is sponsored content. Advertise in The Neuron here.
Around the Horn.
Anthropic partnered with the U.S. Department of Energy's National Nuclear Security Administration to test whether its Claude models could accidentally share sensitive nuclear information in classified settings.
Pony AI, a Chinese self-driving car company, announced plans to raise up to $195M in a U.S. IPO at a valuation of up to $4.48B.
Virgin Media O2 revealed Daisy, an AI who keeps phone scammers occupied by chatting endlessly about knitting and family stories in a convincing elderly voice, wasting up to 40 minutes of their time per call.
FROM OUR PARTNERS
You can now Transform Adobe Stock images with Firefly AI.
Check this out: New features in Adobe Stock enable creators like you to find more unique, relevant content you can customize to your needs. Swap backgrounds, remove elements, expand frames, match styles, and replicate compositionsâand preview all changes before purchasing. Learn more here.
Intelligent Insights
A robot who trained on hours of videos of skilled surgeons conducting surgeries performed the same surgery at the same skill level without human assistance.
Sam Altman apparently wants to do a $1T training run at some point, which he believes will help solve physics + nuclear fusion (full video)
Fraudsters are uploading AI music to Spotify under established artists' names to steal streaming revenue.
An ICU nurse says AI systems are being increasingly implemented in hospitals, from patient monitoring to documentationâand shares why thatâs âterrifying.â
Microsoft teamed up with The Vatican to create an AI 3D digital twin of St. Peterâs Basilica for online visitors to explore (hereâs a preview video) and teamed up with NASA to make an âEarth Copilotâ that uses geospatial data to answer questions about the world (video here).
Gartner predicted that 40% of AI data centers would face power shortages by 2027 due to rapid growth in energy consumption from generative AI systems.
A Cat's Commentary.
Thatâs all for today, for more AI treats, check out our website. The best way to support us is by checking out our sponsorsâtodayâs are Metaview, Vellum, and Adobe. See you cool cats on Twitter: @noahedelman02 |
|