Evolving AI Art
ฝัง
- เผยแพร่เมื่อ 30 พ.ค. 2024
- In this video, I explain how #aiart generators like #midjourney and #stablediffusion can be used to simulate evolutionary processes, and explain why this is important and valuable as an exploration algorithm. I also show very good pictures of orangutans, which is perhaps the most important part of the video. Please comment "orangutan good" if you read this, it is a sign of unwavering loyalty.
Links to my stuff:
Patreon: / emergentgarden
Discord invite: / discord
Twitter: / max_romana
The Life Engine: thelifeengine.net/
Links to cool stuff from the video:
Midjourney: www.midjourney.com/
Stable Diffusion: huggingface.co/spaces/stabili...
Pic Breeder: nbenko1.github.io/#/explore
Pic Breeder Paper: eplex.cs.ucf.edu/papers/secret...
Image Library of Babel: babelia.libraryofbabel.info/
Richard Dawkin's Biomorphs: • Biomorphs - Richard Da...
Timestamps:
(0:00) Intro + Explanation
(1:56) Midjourney Evolution
(4:46) Stable Diffusion Evolution
(6:56) Pic Breeder
(7:49) Image Space
(10:00) Exploring Image Space
(11:57) Open Ended Exploration
Music:
• Mindful Horizons (Albu...
• Stepping into the Ether
• Closed Circuits
• Mindful Horizons (Albu... - วิทยาศาสตร์และเทคโนโลยี
Correction: There are 256 possible pixel values (0-255, zero included), so the image space calculation is wrong. It is actually LARGER than the number shown on screen 🤯
💕 this. IMAGINE.
A GOOD JAMES WEBBEYE 👁️ TO ADD TO IT.
AMAZING 🤩 THUMBS UP !!
This newfangled "ai art" stuff is depressing as hell. It will change what being an artist is, it will throw most artists in the dustbin of history.
Art is now obsolete, worthless, just something a machine can automatically spit out. Non artists will somehow think that are artists, and true artists will be forgotten.
I hate the 21st century. I hate world the new generations are creating.
This sucks, entirely.
fuck ai art!
you forgot the point that this AI work by taking "reference" of the millions of art posted in the internet. It does NOT create by themselves, but has billions of images made by others artist saved and use other art to recreate an image. Many of the picture you showed, I already saw, made by other Artist or even Pictures.
So if you never saw this kind of art, it is maybe, because you never search in the various art community this kind of art.
Sadly like in every business there is one kind of thing (in this case art-style) that is heavy sponsored like in Music. But if you search you find it.
In few words the AI helps you with research of pictures, because you are maybe too lazy to search or because you do not know where to start.
But this software NEVER create, it just replicate.
and it gives you the feeling that you are part of the process...but you are not.
@Red Tide Someone in NY won in court because they turned the images into a product they made, comic book of raw "AI splicing". This is a birth of a new way of creating that even a child could dream up and in the future there will probably be artists specifically creating for the database. Maybe all the money from the previous version can fund those peoples lives.
As an illustrator and graphic artist i'm concerned with the progress of A.I and what it'll inevitably do to my field and to the people working in it.. but you kinda open a door to something beautifull and poetic at the same time. Thank you.
see this is why instead of art, im studying compsci, gotta be on the side of robots once the revolution happens ;D
@@ejsafara456 I'm doing the same for the same reason but i find it an interesting paradox, because we're the ones creating these, surely we will be the last to lose our jobs but at the same time technally we are writing programs that write themselves. so maybe we will be gone faster than we think.
AI don't generate pic's with story/reason behind them, so artists still be welcomed in society.
@@user-ru3ll6fx9v idk man, just hook up the ai to random word generator :x and we already have ai writing articles and such :b
@@user-ru3ll6fx9v it can duh😑
Your videos are awesome, really enjoyed the explanation of search space and evolutionary search as a means to creativity. It turns a seemingly np-hard problem into something solvable via a gradient descent through interestingness. Learned a lot, thank you!
Dawkins 'Blind Watchmaker' and its biomorphs blew my mind in the 80s, thanks for crediting the link from todays tech back to that. The related term 'genetic algorithims' seems to have been overtaken, but I find it still a useful one.
it’s really nice having someone more knowledgeable on a subject like this give their 2 cents. i’ve been messing around with ai art for a while now ever since the back/frontdoor leak for novel ai happened and your video kind of Recontextualised all my thoughts/assumptions about this kind of technology.
I initially subbed to your channel because of your evolution simulation videos but it seems you’re really good at making videos on other topics as well. i wish you’d make more of them or they’d come in my feed more often.
What a cool video, I really liked the part about exploration, I've been thinking a lot about life as exploring one value of the "life space"
Wow, I am really impressed, well done! These creatures look so different, mysterious and yet real at the same time - and those colours!
Even better, Can't wait for AI to start mass producing and distributing worldwide!
Did not expect to be hit with the powerful philosophical analogies at the end. Bravo. Really provocative ideas, well delivered script as well!!
Bbbqvvvbbe av
V
C es. W n. No vj
One of the most inspiring videos I have seen. Thought provoking and enticing exploration. Thanks!!!!
This was hands down the most exciting video I have ever seen. I love how maths and art combine in this video to search for beauty
dude this is mindblowing content.. please keep going and never stop. it is always the art of technology. the art.
Oh man, this was so great. Reminds me of being a kid and watching all those epic space documentaries.
Beautiful video and very intriguing proposition. I’ll explore it further. Thank you
This is an excellent video making a complex situation understandable. Thank you for sharing this information. It was very informative.
Love this video, thank you for sharing your perspectives Emergent Garden! I have been exploring AI art lately and it's been a fascinating experience.
great explination of latent space and image space amazing stuff
you nailed it at "unlike any artwork I have previously seen" - this sums up MJ for me - constant pixel variation, the trip machine
This is a fantastic jumping off point to so many interesting ideas and insights.
"latent image space explorer" sounds like a job from a sci-fi world
Well, we now have latent 3D NeRF explorer. I think science fiction is not keeping up
@@escher4401 I think that "It's NeRF or nothing" is pretty NEAT 😂
We are living a sci-fi world.
And we realize that's also what artists have been doing.
Mathematics asks: What is the space of imaginable universes? (i.e. patterns made of rules)
Science asks: What are are the properties of this universe? (i.e. Which universe - pattern of rules - do we live in, of all imaginable ones)
Art asks: What changes to the rules can we imagine, and what can we bring back from these alternate universes?
In principle, one can imagine that a simulation of any hypothetical reality exists in the mathematical space of possibilities. I'm not saying all reality reduces to math or can be contained in it - that philosophy ain't so simple - but a simulation, sure. Whether our reality is large enough or has the right properties to even run certain simulations is a separate problem. The point is, the simulation exists in the pattern-space of mathematics. And maybe by accessing alternate realities similar to ours we can learn things about actual reality.
So artists can be said to be accessing alternate realities (at least virtual ones) via the simulation abilities of our mind. The current AI results are the outgrowth of creating and training AI models capable of simulating real images. The actual result is that they simulate non-(immediately)-real images too. Neat.
Evolution as commonly accepted is in principle much the same - it creates organisms hypothetically fit for alternate realities, but only some of them are compatible with our reality as well. So to some degree it reaches into alternate realities to extract information about its own.
These thoughts are a work in progress, but hopefully they might make someone's day more interesting.
@@cliftut but before, only artists could travel into that world but now everyone can.
THIS is exactly the kind of explanation I was looking for, and trust me I've seen some. Great job, thank you!
Great video. One sidenote though as it may not be clear. Generative models don't have the capacity to produce every possible image in the image space. They generate cohesive images rather than noise because their output space is heavily constrained when compared to the image space you mentioned earlier. Their output space is usually still enormously big but there are far fewer images in it than points in the image space.
well yeah id say thats because almost all of image space is just white noise. but theres defos a bigger amount of images that would mean something to us that these ais can generate. which is a god thing i think, dont want to build rome too fast.
Or you take a formate and play through all possible pixel constellations, there may be a lot of noise but also everything imaginable picture like Mona Lisa and Einstein riding on the Sphinx in the morninglight of Quebec with both having pink bananas in their, em, seven front limbs so far ...
You should be narrating documentaries. You have a profound and nice voice! I found your video's part (7:49) especially interesting and informative.
sick, your vids are always welcome in my notifications
you scared me with this tecnology. Avator movie must hire you for their new characters.
Love your work.
Love from Afghanistan.
Amazing video, this is one of the best videos I have seen talking about AI image generators and such, keep it up, really looking forward to the next video haha
Amazing! thanks for the upload. 2023 will be an amazing year
This was the best video I've watched on this subject
You could automate these evolutionary trees by evaluating the outputs on a caption or a classifier network, making *it* select the next branch(es)
Don’t text-to-image models already do that?
@@Infiny92 yes, this is how they are trained in the first place. They start off in the hypothetical library of babble, generating random noise. But are then trained against the subset of human imagery. So in essence, with respect to language used in this video, the space AI models are in is the subset of babble that which pertains to human experience. And when you are following these “evolutionary trees” you are exploring the already curated space.
with the 3d generators and video generators that now exist, I feel like we aren't too far away from a day when something like no mans sky could literally have infinately generated alien lifeforms that don't have to be human created ahead of time.
That's already possible. The bottleneck is gameplay. You can generate an infinite variety of visuals, but they don't DO anything. Compositing and mixing behaviors is yet unsolved, as our understanding of the consciousness that drives behavior is bound to physical bodies, which computer-simulated agents aren't.
Even if we could generate behaviors, there's no guarantee they make any sense, or be entertaining to interact with. Having said that, it's only a matter of time until we can generate entire video games by prompt. How long, is uncertain.
We are starting to see this in the blender community. I believe there are already prototype AI for procedural textures, UV textures, and I believe bump maps. There might be one for mesh, but while it's easy to make an AI create models, it's incredibly difficult to get it to do so properly, so you get a lot of weird mesh that doesn't make sense or artifacts from the noise. I think we'd find more potential in using AI as a controller rather than as an artist. For example, you (a human) can make a bunch of body parts with specific parameters for size, texturing, etc (imagine like Spore but more advanced), so you wouldn't have something with no mouth and radio static as skin. Have those models as a template, and then use something like geometry nodes to morph between them and arrange them in various orientations. Then have the AI on the game side control those nodes, so it chooses which of the already pre-modeled body parts to put, where, and with what texture. This would be more on the world generation side, turning the game into the dwarf fortress loading screen for a while but then you get a procedural experience when you load that save.
As an artist, this tech is very interesting and I look forward to what humans can do with it. But as I say to people who are concerned about AI, the human element is always going to have to be there because AI is too capable - it can create an infinite number of outputs, but like with the library of babel, without a human it's wasting resources on something totally useless.
@@benji45645You're right. It needs human interaction and guidance. The fact that we have the tools now to make it happen is really exciting.
Btw, If you know of a model that generates bump maps like you mentioned from photos i'd love to see it. The best program I've found is Materialize, and that's not AI. I feel like AI could do much better.
@@hyperteleXii don't see why you wouldn't make a database with behavior information on humans, animals and evolution. Use it to train AI and simulate-test it to produce viable behavior, like an evolution simulation. You could also do this for all the aliens on the planet, so they would have complicated relations, things like eusocialism, parenting, symbiosis.. etc and things that don't happen on earth but might be succesfull in the simulation test. But that's probably not gonna be practical to do for a game with infinitely generated map.
@@ustanik9921 It's difficult to encode behavior as information. Results can be measured, but *why* did the animal do that? AI generated behavior will thusly *resemble* animal behavior, but have no logic to it = Falls apart upon inspection.
The library of babel is one of my favorite places, and until now I didn't think of one for video. But you can have one for any form of art.
Can you post a link to your discord channel to participate in the evolution thing or to download some of the breaded creatures?
Probably one of the most fascinating and intelligent videos I have seen for a long time!
Fantastic videos as usual my friend!
Thank you for this beautiful video.
Now what would be really interesting is if instead of prompts and variations, you could draw or paint right along with it as it evolves.
Great video as always!
Glad to know I'm not the onlyone who thinks of V-Rolling as evolving an image. I've done some crazy things exploring different branches.
Thanks for the reminder to take pauses to be thankful for these new islands of creativity, and the maturing tools to seek them and foster them. Maybe I'll try to play with some good orangutans on the way.
This is such a cool experiment! You should do this again. Or more.
Thanks OP that was a great film!
dude this intro is really great for this topic im pretty sure its from the first alien movie where he turns on the computer to talk with mother
That explanation of image space at 9:00 really drive the point home. Well done.
I tried this. Amaaaaaaaazing!
really cool video ! (oragutan good btw)
On Stable Diffusion, what should I do with this: "RuntimeError: CUDA error: out of memory
CUDA kernel errors might be asynchronously reported at some other API call,so the stacktrace below might be incorrect.
For debugging consider passing CUDA_LAUNCH_BLOCKING=1"
It means you're out of gpu memory, which depends on your hardware. I'd just go to playgroundai.com to use SD for free.
im so addicted to MidJourney lol! V4 is amazing
4:21 realistic bug cat
Super interesting, but can we use for some generating text, or some story ?
There's already AI out there used to help writing scientific papers. So yeah!
I've loved your video, and I agree this idea of exploring evolving generations in the latent space, breeding, is not new but it's should be explored more.
In particular automatic breeding/evolution based on "fitness" by some aesthetics defined in adversarial network's like model would be cool to imagine!
since stable diffusion is open source, something A little like this has been made.
They call it textural inversion and it lets you take in A bunch of images that share something in common and assign A made up word/tag to describe that thing. Then you can include this new subject into any other prompt by adding this new tag to the prompt.
Most demos I see of it are people using pictures of themselves to allow adding them by name to any prompt.
I also saw one trained on pokemon that could make fictional pokemon with the features of various US presidents in the pokemon art style.
That was pretty cool.
beautiful video
Something important to note with models like midjourney is that they _have_ been trained on the creativity of others, and while you might not ever have seen some of the art that has guided the model, everything it generates is entirely derivative. These models have none of the attributes that could be classed as creative, even with a human ultimately guiding the process through prompts. It is more akin to taking existing paintings and smooshing them around, than anything resembling original work. Their styles, all of the artistry you might find while exploring their model, it is all explicitly plagiarized from existing work. Whether you care about the ethics or not, it is hardly novel. Picbreeder is the most novel thing in this video, because it is a model trained and guided entirely by collaborative creation, all that it generates is original and purely evolved within the collective mind. (I had not heard of Picbreeder before seeing this video, but it's certainly the most interesting to me)
All of those are good points.
Any idea who owns this computer what makes these pictures?
Nice images for new nightmares.
Thats incredibilly interesting
Excellent video, I like Stable Diffusion because you get results right away with the right promt, then you can generate endless variations of any of the first set of images you created.
Can you detail your settings in stable diffusion for this kind variations/evolutions ?
I was going to make some congratulatory comments about how well you have articulated some of the key intrinsic values of AI driven generative image creation but then at the end of the video I was left feeling inarticulate for a few minutes (obviously I got over that). I could feel my brain "chewing" on perception in a "new" way. It made me think that perhaps either passively experiencing image evolution (like in this video) or doing it actively yourself (like I did for a while on your discord) results in an altered mental state sort of like a meditation or "waking" lucid dreaming state. In addition to being a scientist myself (currently studying to be a data scientist and have experience coding neural network models) I am also an artist.. I find that your video has resulted in a "flow state" that I often feel when inspired during art-making. This is a good thing.
Wow...this is a....nightmarish monster breeder...cool
What a great video! WOW! After painting for 40 years with a brush, I am now diving in that Image Space.... and it is a mindblowing trip
Fascinating video and so very well made! Thought-provoking, eerie, beautifully scripted and a joy to look at ❤
When I was in primary school, I wrote a program in qbasic to try and make every possible icon for windows (32x32). I can't remember if I used 256 colour VGA (screen 13) or 16 colors.
Needless to say, after leaving the 386 running all day, seeing that only maybe four of the pixels had changed was what made me realise this was impossible.
Brilliant!
this is the most insane shit ive ever seen.... what an absolutely astounding explanation of image space and the possibilities we have...
What if you use the images from the image library of babel to be used in the stabled iffusion or midjourney?
Great video!
Thank you for eloquently putting into words the comparison with an gallery of babel that I felt was a good way to think about AI art, but didn't have the words to explain.
Some of these images as the Algorithm evolved- are very accurate even if we have never seen certain species,tribes or genes.
If AI in general is a real thing that is accurately becoming....i suggest that we use this technology in it's most organic state of mind.
If used well,i can see us really using Al technology with human DNA and even foreign gene building splicing...etc.
I use it before even having access to these programs so now that i had been on a waiting list for a new Art AI program,
I know it works.
I'll build as our realm becomes integrated.
That's all we are in at this time.
Deep mental monopolizing reorgan- izing....integration.
Reintegrating is not AI.
We just will build technology at this time in life.
I believe that software engineering is actually collective software breeding with trying to apply best practices to solve common problems in the most optimal way based on the context.
And one of the my "field of interest" is evolving of software systems themselves. Where can I speak with someone about this? :D
By the way, your video is very exciting, thank you!
UPD: also, it is important to mention, that neural network implicitly adapts to suit your visual tastes, if you have control in breeding process.
mesmerizing
Amazing
amazing video though, I'm going to play with stable diffusion right now
Gracias!!
Beautiful :)
This technology is getting good fast
Exploration sped up to instant gratification is a destructive force; it will degrade, not uplift, the human spirit.
We all instinctively know this, but temptation all too often outweighs instinct.
The aesthetic appeal of a piece of art is important, but only a small part of the total equation of human appreciation. The investment of time is actually weighted more, the time taken to produce any given piece of art, but also the time it takes to master a given medium. Once the component of time invested is removed from the equation, the appreciation of art will continuously degrade until it is meaningless.
Yea.
To put it another way, once these AI have been evolved into completely autonomous content farms. We're going to be inundated with so much high quality media that we simply could not have the time to appreciate all of it even if we had the motivation to do so.
And anything humans could possibly turn out is going to be completely swallowed by that sea of content.
We're paving the way for the complete saturation of aesthetic media, to the point that it will be totally valueless.
It's genuinely irksome that so many people don't see this coming and are happy to keep training these content farms. Distracted by the new shiny toy that they're inevitably going to stop caring about way before it's done completely ruining the lives and motivations of the people currently devoting their lives to the pursuit of art.
Future looks bleak for artists of any kind.
@@Cernunnnos I actually agree with you. The shift toward the instant gratification of art production will destroy all appreciation and meaning. When you have access to everything, nothing matters... it will be a digital hell. Pure boredom in the end.
And nothing can stop it from happening.
But there will be a % of humanity who reject the whole digital thing, and for those pockets of the world, there will actually be a renaissance of traditional art across all mediums. That's my prediction, we'll see.
@@tygorton I like the idea, and I hope it's true. But it seems like it'll be such a small group of people who do this.
But maybe this can of worms is what teaches us, as a species, that scarcity is a commodity in of itself.
That a thing being finite is good for our mental health and that we should stop engaging with ourselves and our environment like everything we consume or desire is limitless.
If we're being hope pilled, I kind of like the idea that this could be a small facet of our greater cultural individuation.
@@Cernunnnos anyone else starting to think more about Dune and one of it's most radical ideas?
@@jichaelmorgan3796 You mean the Mentats?
I'd say the idea has legs, but it's more that we're going to have to integrate with machines and AI. Rather than try and make us good at the same things it's good at.
If AI stays as these hyper efficient but one dimensional logic crunching programs, and we seriously worked on how we integrate with technology. Then we could function as the central will to these singularly exceptional arms of various disciplines.
If these individual programs are just bolted together though, they have the potential to be what leads to genuine AGI. Which isn't even worth theorising about. It could either be benevolent man made god that makes everyones lives better, or it could just fuck off into space to escape the planet of the crazy apes. Or anything inbetween.
Какой шикарный способ создавать концепты новых существ.. причём сразу с эволюцией от эмбриона
It's truly a strange time to exist. I only hope artists do not become obsolete but perhaps masterpieces can be created by meshing AI generated art with human instincts.
no artist can encapsulate so much knowledge and creativity
Perhaps an artist is really less creating something new and more exploring image space with the strokes they make on the canvas. the strokes they chose to make come from their gained understanding of the objects their brain was trained to understand, and they are combining those mental understandings of form and shape to create newly discovered images on the canvas. The images already exist in babble, they just haven't been discovered. Now the artist can use tools of language to pull out images from the image space. Perhaps less precise than the brush stroke, but faster and more of an iterative process. in this way the artist is not replaced (at least not directly though the barrier for entry may be lowered and the old ways of artistic profit threatened) but granted new tools in the exploratory process.
Wow, just blown away!
being a graphic designer this is something so amazing and great! Creating abstract image in matter of mins which didn't ever exist in reality is just mind blowing!
Literally!
I was so eager to explore that I used up my trial verson before I could realise it. Thank you so much for this.
And, I can't afford pay so much for a subscription. I wish there will be more such AIs in future which will make a transformation in our perception
im blown away.
@EmergentGarden
Have you read "Darwin's Dangerous Idea" by Daniel Dennett. Some of the phrasing for ideas that you explore are very similar to how he put it in the book.
I have been playing with stable diffusion for the past couple months. And it keeps on amazing me. Still feel like i need to learn what prompts i should give and what pictures to select for seeding the next ones. It's a whole new world.
Wait, why does moving around the latent space produce mutations that are interesting to us instead of just random noise appearing all around? The movement is not random then, is it? It knows where to "randomly" move, right?
In the latent space things that look alike are near each other, like a gradient
@@JorgetePanete but the same image with random pixels smeared all over also looks alike the original image, doesn't it?
When he was illustrating moving around latent space we saw the hands move around a body. Why does that happen?
Isn't this space just a multidimensional array representing every possible combination of pixels of a particular resolution?
How could then the arms moving around be in proximity of the original image? This set would have to have the concept of hands being positioned in different parts on the body imbedded in it such that such images are in closer proximity than the same image with some random pixels all around.
Random pixels appearing where his hand was is also "slightly different", but almost the same" isn't it?
Seems like he skipped over something important here, because its not adding up for me.
@@asyncasync It isn't all the posibilities, it's what the network can offer and depends on its training and structure
underated vid!
incredible
Looks like we're one step closer to creating a Skynet situation. Better start stockpiling those Terminators now!😂
Thank you for this.
what is the pupose of artists now?
Bro our mind is evolving simultaneously as we dig deeper and deeper into what AI can help our minds generate. I’m no-longer the same exact being as I once was before AI 😏 great vid by the way. I use only free AI Art generators.
if a ai can take a prompt and turn into a image, could they take one of these library of babel images and give it a description
could they organize the mess of library of babel
could they?
Hits so hard
orangutan good! I just found your page. I am in this all the way friend.
I watched the whole thing and thought it had like 500k views but it only has 6.7k TH-cam needs to do something about this
pretty good
This is the sales pitch of the next generation, demo of 13 mins
This was amazing.
thanks alot
This was fascinating to watch. Props to you and your mods for putting together those trees!
This is awesome 😍
Interesting, but I like what my mind can create any day! As I’ve seen, and will see things that no one has ever seen and will ever see or know of!