- The Neuron
- Posts
- 😺 DIY AI special effects
😺 DIY AI special effects
PLUS: Did ChatGPT start messaging people first?!
Welcome, humans.
We’ve been seeing A LOT of AI music videos lately. Like check out this one that uses Flux Schnell images, to Runway Gen 3 videos, set to Udio music, with lyrics by o1:
Some other instant-hits:
The Nile Nexus club—dreamy, Egyptian-themed DJ house mix.
Tell Me Anything At All—fake 90s pop song for a fake 90s teen romcom.
Sad Superman—folksy country ballad, featuring George Clooney.
Hog on a log—a deep south hip hop banger, featuring, yup, a hog on a log.
Drinking gasoline—a synth-pop sleeper hit, with a huge “don’t repeat this at home” disclaimer.
Y’know what someone should do? Bring back MTV (“back when MTV used to play music videos”) as a Youtube live channel that streams AI music videos 24/7.
Here’s what you need to know about AI today:
Runway launched a new “video to video” feature.
Midjourney to add external photo editing and 3D features soon.
Tencent created AI open-world game generator.
ChatGPT allegedly messaged someone first.
Runway just released “Video to Video” capabilities—here’s what that means.
Last Friday, Runway released video-to-video for its Gen-3 model, which essentially lets you alter a video through simple text commands. For example, “change the background of me walking to be in NYC.”
What people are saying: Early users note inconsistent style across clips, with a “wide discrepancy” between high fidelity and “smudgy” images.
While the new video maintains the movements of the original, the new creations can still struggle to emulate physics accurately.
Sometimes you want a Phoenix flying through a jungle, and you get a Phoenix that IS a jungle.
That said, video to video is probably the closest you can get to “controlling” the output of a video generator, so it’s a must-have if you want to seriously create AI videos.
Creators have already demo’d over 35 impressive use-cases:
Add filters to various video types:
Dance videos, performance videos, youtube videos, music videos, video game streams, memes, anime fight scenes, and stock footage (1, 2, 3).
Generate a clip with Midjourney image-to-video, then change the style (1, 2, 3, 4).
Create homemade Hollywood effects—no green screen required (1, 2, 3).
Turn motion capture CGI into a “rendered” animation.
Create a visual effects mask on your footage (like the VFX pros do).
Create ad mockups for a potential product video (another example).
Make an animated movie out of your kids toys–or their crafts.
Create realistic lip syncs.
Create video game footage in real life.
Send a car into outer space.
Become anyone, anywhere.
Here’s Runway’s guide on how to use.
The TLDR: upload your reference vid, write your prompt, adjust the “structure transformation” score (0 for an exact match, 1 for very different), and generate. Max input is 64mb (1280x768p) with 720p output.
For best results, use 5-10 second clips, a “fixed seed” for consistent styles, and distort your vid if needed. Here’s a tutorial video, with more examples.
FROM OUR PARTNERS
Have an AI idea but don’t know how to build it?
If you know AI should be a part of your business but don’t know how to implement it, you need AE Studio.
Their team is stacked with elite software creators who can turn any AI concept into reality for your business—think automated reports, NLP, custom chatbots, and beyond.
The secret to their success is treating your project as if it were their own startup.
Tell AE Studio about your business challenge today. They’ll listen to you, take the time to “get” it, and do the work you need to get done.
Around the Horn.
Midjourney will launch the ability to edit external photos, new storytelling tools, and “Midjourney 3D”, plus a few other cool features before end of year.
Tencent created GameGen-O, an open-world video game generator that represents a “notable initial step” towards creating full video games with AI.
…Did OpenAI just update ChatGPT to message you first?! According to this conversation, it did (more discussion, and a potential debunk thread).
Treats To Try.
*In sales, timing is everything. But how can you stay on top of every lead when you're juggling dozens of calls a day? Easy. Let Attention automate email follow-ups so you can focus on closing more deals.
Selfplanr creates weekly plans for high school students to help them prepare for admission to elite colleges.
MindPal helps you turn your personal expertise into an agent workflow you can sell to others (without any coding).
DryMerge lets you connect your favorite apps and automate repetitive tasks, like an AI Zapier—this report says it's a bit buggy atm, but a cool product to try.
Respeecher allows you to clone and synthesize voices for applications like film, TV, music, and advertising.
Solvr answers your questions from screenshots, PDFs, or highlighted text on any webpage without needing to open new tabs or copy-paste content.
Kaiden AI creates voice simulations for personalized training (like practicing for IRL interviews).
Appy Pie lets you create apps, websites, chatbots, and designs with templates to quickly build and launch (and no code required).
*This is sponsored content. Advertise in The Neuron here.
What gives it away that this is AI?
Your job is to tell us what about the video below gives it away as being AI. Click the link, watch the vid, and then answer the poll with your best take!
What gives it away that this video is AI? |
Monday Meme.
A Cat's Commentary.
If you missed yesterday’s Sunday newsletter, check your inbox!
That’s all for today, for more AI treats, check out our website. See you cool cats on Twitter: @nonmayorpete & @noahedelman02 |
|