AI in Blender is here | BlendAI
ฝัง
- เผยแพร่เมื่อ 20 ต.ค. 2024
- 📌 Get now: go.rubenmesser...
BlendAI is the most complete AI integration into Blender. It comes with a personal assistant and many time saving tools like texture generation, upscaling, and so much more!
✨ Beginner Tutorial: go.rubenmesser...
💎 My Addons: go.rubenmesser...
🔮 Discord: go.rubenmesser...
🔥 Socials: go.rubenmesser...
Credits
The Next Leap: How A.I. will change the 3D industry - Andrew Price: • The Next Leap: How A.I...
Music made with Suno
Sound Effects made with ElevenLabs - วิทยาศาสตร์และเทคโนโลยี
If every 3D app had an integrated AI tutor, it would be a huge help in learning the software. The app itself would teach you how to use it.
Totally agree!
Microsoft copilot is supposed to work like that when it can see your screen. Should be able to help with any program tbh
@@christianr.5868 how do you let it see your screen. it would actually be helpful if that was the case
Every app tbh
@@ns33333 it was hasn’t been updated for that yet. But it was in the surface pro 11 and surface laptop 7 reveal
As a bpy addon dev myself, THIS is how addons should be built. Seamlessly integrated into UI in intuitive places. Not just another one-stop shop clogging up the NPanel or hidden in the object data properties panel. Well done.
I see your blender market listing has credit purchase option. Do you allow devs to use their own API key for whatever LLM service you are calling? Edit: I see you're using open AI, nice. Would be awesome if you could also call Anthropic's API as an option, because it has a much larger context window and is better at needle in the haystack tasks.
First off, thanks for the great feedback. Really appreciate it to hear this from a fellow bpy dev, means a lot to me! User experience is always my top priority, so spent much time on the UI design. Yes, you pay a small amount of credits for using a feature. This is because I have to pay the AI services and these costs need to get covered. Actually I built the addon based on API keys initially, but the user experience of this is in my opinion not good. But I could bring it back for 'advanced' users that want to use their own keys and not rely on the credit system. And with it also more AI model options. This will all land on my notes for future updates. And I already have a lot more feature ideas, this is only the beginning of BlendAI! Thanks for your great suggestions :)
I thought this was another lazy 3d model making AI but it turns out its not, it helps you to create 3d and thats awsome!
That's right, thank you! Hope you enjoy it :)
Finally A.I coming to good Use and not replacing jobs
@@Daanimationovenit’s still going to replace jobs
How so if this A.I. tool isn't generating models? @Omaga_Akor
@@Daanimationoven hes just yapping
it's just a yet another chatGPT and midjourney wrapper plugin in blender, doesn't really do something real, just does shit faster than what we currently do now (by just connecting different sites), i hope it's free
Wtf do you mean by real?????? Using that term makes 0 sense
Is it a wrapper? I’m curious, is there a GitHub repo?
Would be very dumb if it wasn't ngl
You really dont see the potential 🤦♂️
@@RoddVeiler potential is insane, but stating it as the blenderAI is too much , marketing gimmik, as the term blender ai signifies an AI that will help you to do actual 3d stuff instead of a chatgpt guide and image generator for inspiration
It's a great project and definitely makes workflow faster , I just had concerns with marketing
the only unrealistic part of this trailer, is a blender user thanking chatGPT.
and paying like 10 credits to do so
Didn’t expect you to be here
It's important to thank AI. Our future overlords will appreciate us polite meat puppets of the early days. We may even get preferential seating in the human battery vats of goo.
I only use AI to help myself improve on certain aspects such as programming and a variety of other digital skills, however, seeing BlendAI, it gives opportunities for low-end intermediates like me to incorporate self-learning with AI alongside youtube courses and paid external ones. I see this is a good stepping stone for Blender to some extent.
Edit: And this is a great tool as well since its not like those other useless AIs. Would love to use it.
I'm happy to hear that you like it, thank you! You can try it for free to see how it works for you before paying anything: blendermarket.com/products/blendai/?ref=915
And don't hesitate to ask if you should have any questions. Have a great day!
Now this is really cool, you're literally taking something good and turning it into a useful tool that is actually helpful. While I can't say I am fond of having to buy credits I can understand why though and Ai is only going to become better and better and more useful over time.
Glad that you like it, thank you! For sure, I'll always keep BlendAI up to date with the latest technology. Also have many more feature ideas already, so stay tuned :)
The Blender Foundation needs to make it's own ai gpt built into the software.
They need to throw out Cycles and add ai now
"making the decision whether this is good or not" is an art director's job and they have learnt these skills over years of experience. or i guess we let the AI do it and never learn why it's good
BlendAI is no replacement for professionals, it's just a tool to learn new, find inspiration, and save time. All without leaving Blender. So the goal is to make AI more a tool for Blender users, instead of a threat.
@@rubenmesserschmidtprompting functions and workflows for a faster and easier result with same quality is all I'm about. But we all know this is not how these things are and will be used.
Wow this accually looks great! First i thought it will just generate shitty ai models or something but it looks like it litteraly is what ai should be! Helping artis not replacing them
@@annoyingwitch6769 Thank you!
Yes, that's the goal of BlendAI. Hope you'll like it :)
This is cool. I like that you have a free tier for people who just want to try it out. I can't wait for something similar for Unreal Engine
Thank you, really appreciate it! Yes it is important for me to give users the chance to try it out before paying for it. Can't imagine UE themselves aren't working on something similar, we'll see. Anyway, feel free to let me know how its working for you in Blender :)
something like this for UE would be insane lol
Finally AI is being used for something its supposed to. Assist and advisory
Correct! This is the purpose of BlendAI. Thank you :)
Can this AI also track a video and create same animation on your 3D model. I have seen video of trying to improve animation shots and I am wondering if there is a quicker way to improve animation shots. Espesically ones that can be super complex?
This one is pretty good
Thank you so much, really appreciate it!
Let’s see where this one goes :)
Finally something useful to help users.
Glad you find it useful, thank you!
Omaygod their coming run😮
What do you mean?
@@rubenmesserschmidt runnnnni run💀
What a amazing ad!
Love to hear that. Thank you very much!
This is Everything I wanted 🧡👌
Great to hear, thank you!
ooooo crazy stuff right here
@@ocopytdah Thank you :)
Is the data set, for the ChatAI, from the official blender manual?
Can it assist in rigging?
@@-z-9989 Yes, you can ask any questions about rigging.
Great work! in the future, Could we expect image generation using datas of viewport(depth, pose..), like Tydiffusion on 3DMax?
Glad you like it, thanks! It's not planned for the near future but will definitely put it on my to-do list.
I also have many more feature ideas already and can't wait to develop them. Feel free to join my discord server, there I plan to do kind of development logs soon. Would look forward to hearing your thoughts there. Thanks for the great proposal!
the fact that it doesn"t make a 3D model for you or a shader for you and actually tell you how is great for beginners! but that tho..: 1:32
Right, thank you! Yeah the inpaint feature, but if you look closer you'll see many artifacts. And you can't animate it and so on. It's purpose is just to preview your idea before actually spending much time on it. Hope you'll find it useful!
@@rubenmesserschmidt oh, very nice!
I really like this a lot but the whole credit is what really kills it for. Is there a way I can run local with my own gpu?
I can understand that you don't like a credit system, but I have to do this to cover my costs for running the AI models. You're not the first requesting this so I've already added this to my list. What will come for sure soon is API Key support, then you can use them instead of the credit system. Let me know if you have any more questions or suggestions!
@@rubenmesserschmidt when will you update to that? The own API system
@@shadows1235 in the coming weeks. It will be included in the very next content update. So stay tuned!
very creative & amazing new plug in idea
Thank you so much, I really do appreciate it!
if it really works. it's like a dream
It does!
well done
Thanks :)
what ai model does the language model and image generation use?
The text based features use OpenAI's most advanced model GPT4o if using the high quality setting, otherwise GPT4o mini. The image based features use different open source models that works best for each task. You can find all info about the models used in the documentation in the bottom of the feature pages:
blendai.readthedocs.io/en/latest/
Feel free to let me know if you have any more questions!
Wait is it out now?
@@oriki3100 Yup, it is! You can get it on Blender Market: blendermarket.com/products/blendai
Hope you like it :)
Is it free?
@@oriki3100 Yes there is a free version available. If you should find it useful, you can upgrade to Pro anytime. Feel free to ask if you have any more questions!
Thank you so much for the info people like you make the economy better ❤️❤️❤️
Does credit need to be recharged every month, or is it a one-time purchase where the account gets free updates every month?
BlendAI is a one time purchase, this means you don't get new credits every month. Instead you can recharge credits anytime and only pay for when and what you're using. And yes, updates are free. Though there could be an exception for a huge new version someday, but then I would ask all users about how they find that. Hope this helps! Feel free to ask if you have any more questions :)
@@rubenmesserschmidt Sooo... Credits and subscriptions inside open source software... terrific... where do I NOT sign in? Just sell the damn thing with a limited update time window. after that the user can stick to his old version or buy the new one. Paying everytime you need to use your software is abusive
Can It UV my Models? Can it do a decent context based retopo? Can it create a node tree example based on requests? How do it know what my scene contains? I have questions.
Actually nothing of these yet. For now it knows where you're currently working in Blender and which version and so on, which makes it easier to get the info you need. Though thanks for the ideas, even if they are quite complex but maybe that's possible someday. This is just the beginning of BlendAI, and I have many more feature ideas already as well. If you're interested in giving input during development, feel free to join my discord server (link in video description). And if you have any more questions, don't hesitate to reach out!
Petah, the AI is here.
Can you list this in blender market also?
Its already available on Blender Market: blendermarket.com/products/blendai
Hope you like it :)
Can you ask it rigging questions? Like when you get an error in one of your bones? Can it tell you how to fix it?
Yes of course, the more info you'll give about the bone the higher the chances of a solution. Feel free to try it in the free version: blendermarket.com/products/blendai
@@rubenmesserschmidt awesome 👌 This is definitely something that could be very useful as we are just learning rigging, and we keep getting bone errors, and we don't know how to fix them properly.
@@GORILLAmation Great, sounds like BlendAI could be really useful for you! Feel free to let me know how you like it :)
Any tutorial about it?
Unfortunately not yet, but I'm working on it. I plan to do a tutorial about each feature in detail soon, so stay tuned. For now you can find all info in the docs: blendai.readthedocs.io/en/latest/
Exciting Stuff
Happy to hear that, thank you!
seems good, but does the free version create instances of only being able to use it a few times?
You can try BlendAI completely for free. Everyone gets 200 free starter credits to play with. This equals about 100 questions answered using the balanced quality setting. If you find BlendAI useful, you can upgrade to Pro or recharge credits anytime. You can learn more about credits and why there are actually required here: blendai.readthedocs.io/en/latest/credits.html
Hope this helps!
when the addon developers are faster than the app developers: 🗿
As far as I know, Blender themselves don't want to implement AI powered features. But all other 3D apps will do. So seems like this is solely on the addon devs. Thank you :)
@@rubenmesserschmidt ...and the addon devs did indeed come to our rescue! thanks for making such a useful addon :)
@@rubenmesserschmidt Neden blender yapay zeka destekli içerikleri istemiyor ki Bu şirket ile ilgili ilemi yoksa program ilemi ile ilgili.
Can't it automatically create the shader?
No it can't. It will only help you to create and understand them. However, this could be possible in the future but I don't know if the community would like that :) Let me know what you think!
There’s another plugin for that
I thought it was going to be an AI that makes models for you. I panicked a little.
i have bad news. that is already here.
@@neagrebe its been here for months and still garbage with no sign of improvement
@@higorss In my opinion, it would be better for GBT to handle this issue rather than dealing with unnecessary details.
I still didn't understand is that an addon or what ?
Yes it's an addon. You can get it on Blender Market: blendermarket.com/products/blendai
I would pay for a UE5 version of this ASAP
@@Xzipiit You can feed it only Unreal Engine data (or w/e you're making it for) as opposed to LLMs that have the entire internet. So it will be more up to date and give you better information with less hallucinations about that area of interest in particular. This is why there's specialized areas for certain bots as opposed to just feeding everything into Opus or GPT.
I just can't be bothered to make my own right now.
@@ProfShibeThé only thing I wish for UE is an ai that can reduce the game file size and reduce the error when exporting
Lots of ue developer expérience export error more than unity
This is literally a chat gpt or anthropic bot just in the client is not any better and will stay have the same mistakes, as someone who uses claude and gpt4 every day for programming and animating this is no where near as good as it sounds and often if you don't know what you're doing you'd be faster without it as it gives you incorrect but convincing information constantly.
Notice they did not show the character 3d model
This is cool and all, but all I want in blender is built in keyframe fills with good physics like Cascaduer.
Thank you! Maybe in the future, but this would be very very complex. I'll keep your interest in mind. Hope you find it useful anyway :)
As long as this thing doesn't straight up just be like:
Hey make me a water shader and it actually makes a full water shader
then I'm good. If people are going to make 3d characters by asking ai to do it for them, then f this
It does not. You only get instructions and tips on how to make it yourself. The goal is to improve your capabilities and not do everything for you and that's it. Thats why there is also an explain feature. Hope you like it!
@@rubenmesserschmidtFinally, someone who knows how to use AI properly 🙌🙌🙌
the plans are ridiculous. They don't give almost nothing useful in the free version. I cant even try the ai before I buy it.
You're right, it would be better if you could try every feature a couple of times in the free version, so that you can better decide if upgrading to Pro is worth it for you. I'll try my best to add this soon. Thanks for the feedback and stay tuned!
Hey! Just want to let you know that you can now try every pro feature a couple of times for free (also credit costs went way down!). Hope you like it :)
Hey can someone help me out, It does not work with my blender 3.6, It says in the addon settings no account found, please reinstall the addon, I tried a couple of times but doesn't work. Anybody help me out a little bit here, Thanks
Hello! I'm sorry to hear that. Can you please message me on Blender Market or Discord. There I can better help you fix the issue. Hope to hear from you there!
I wish you would have explained what AI models it uses and how much it is
I actually do in the documentation: blendai.readthedocs.io/en/latest/
There you find the AI model used in the bottom of each feature page. Hope this helps!
does the pro version use credits?
Yes, but you'll get extra 1000 free credits on top. And currently another 1000 for the first 100 pro users. You always pay a very small amount for each feature, so that the operating costs get covered. And it will only get better/cheaper from now!
Can the tool generate images?
Yes, BlendAI has currently two features that can generate images. First one is to create reference images to find more inspiration for your projects. The other can create image textures, which are best used for prototypes or background elements, as they are no substitute for high-quality textures. Feel free to let me know if you have any other questions!
@@rubenmesserschmidt Wow, bro, you're a game changer!
Nah, I have an idea, but I'm not sure if it's feasible or achievable. If I have a locally running SD WebUI or ComfyUI, could I use Blender AI to connect to it and generate images? The goal is to create more precise and high-quality images or textures. I know this might be a bit challenging to set up, but I'm excited about the potential. The power of Blender + AI!🎉@@rubenmesserschmidt
Is this official and is it out?
Yes BlendAI is out now! You can get it on Blender Market: blendermarket.com/products/blendai
Hope you find it useful!
Do you have to have an API key?
No, nothing required! After installation you can use BlendAI immediately. If you have any more questions, I'm happy to help!
is this server based programmed ai like chatgpt or something?
BlendAI is powered by server based AI models from OpenAI and more. That's why there is also a credit system. You can find all models used in the docs under each feature: blendai.readthedocs.io/en/latest/#
Don't hesitate to ask if you have any more questions!
Does it has a mandarin version 😢
Виглядає цікаво
Feel free to try it. Thanks for your support!
@@rubenmesserschmidt у мене виникло запитання. Я спробувала 0$ версію, а пише, що у мене всього 200 кредитів. Кредити потрібно купувати кожен раз окремо, чи pro версія не має обмежень?
praize the open source !
Thank God he don't actually do it for you
Now to make one for unreal lol
This is interesting is it open source?
Yes, the addon is fully open source. And all image based features use open source AI models only.
@@rubenmesserschmidt wow this so good.. i had a similar idea.. its good to see someone who went further and implemented it
@@wandenreich770 Glad to hear that! Yes it was actually a lot of work, happy that there are already many users who like the addon.
Very nice! Can I just use my API key if I have a ChatGPT subscription already instead of purchasing credits?
Thank you! Not yet, but thats already on my todo list. So stay tuned :)
This would be nice
@@Blendercage Coming soon!
Now make an AI that can use Blender instead of just speaking.
Bro might be just Cooked the most Fire addon in the blender market right now
Thank you, we'll see🔥
No AI Retopo?
So it wont do it for us but we still have to do it ourselve? 😂
yes, exactly. thats its whole purpose!
you could use its scripting functionality to have the AI make a script that does the stuff for you, but in the chat stuff, it cant do that stuff.
Hiw long until we stop automating tasks we dont want to automate
20$ for the pro version and 10$ for 10000 credits, if this does everything that is showed actually well this is really reasonable.
The only thing i would like would be the ability to use a custom LLM and pipeline for the ai as i assume you're using an api for openai or something similar.
I'm a big advocate for the option of running thing locally.
I'm still discovering blender and just got into shader, i'll definitely give this addon a try.
Thank you for understanding the pricing. And 10,000 credits are actually a lot in BlendAI which should hold up for months. And things get only cheaper/better from now, so you'll be able to do even more with it soon! And yes, running it with your own AI locally is already on my notes, will figure out if that's possible. Anyway, thank you for your support and I hope you like it!
The credit system... mmm..., good thing for rich dumbasses who are willing to pay instead of learning, getting ready for a new generation of 3D specialists
True, makes me feel dumb for spending all these years learning blender xd, anyway i don't have money to spare so i guess it wouldn't make a difference.
@@JorakinHost The world already belong to the rich. And one day when even art has become automation by money for money, we'll all already be dead and AI will most likely rule the world.
Or we'll realize how much we fucked up and actually support real artists again down the line?
@@JorakinHost nah AI will generate typical C4D shit which don’t interest me at all, complex rigging, purpose topology modelling, optimising for performance this stuff AI doesn’t try to do and people who will be using without any skills will do mediocre jobs and true skilled artist will always be worthy I guarantee you that, do you think such companies like ILM someday will disappear no way, not gonna happen
@@SUVO_RAW Yeah i know, and at the end of the day the best use for AI will be to make the workflow a litte more faster. The second best use case is for shitpost.
people out here looking for the 'make me gud' button
bruh shut up. maybe people just need access to solid information without having to leave their work session.
@@siloporcen sure thing buddy. That's why this so called 'addon' costs 20$ and is based on a credit system like every other half arsed AI company, giving you scrambled answers that are based on other peoples google searches, that you could look up yourself for free. Stop kidding yourself.
200 credits for every month ?
You get 200 free credits to play around and see if BlendAI is useful for you. Cause BlendAI is a one time purchase and not subscription based, you don't get new credits every month. Instead you can recharge anytime and only pay when and what you're using. Hope this helps!
that's cool i guess, until i saw options to buy credits
I fully understand that you don't like credits, but they are simply necessary to cover the costs for the AI services. Learn more about them here: blendai.readthedocs.io/en/latest/credits.html
Also most features only cost a very small amount of credits, which equals fractions of a cent. And it will get only cheaper/better from now, as the AI services improve.
I hope for your understanding!
Is this legal?
@@Xzipiit i thought so.
Of course!
What would make it illegal?
Needs internet to work?
Yes, working internet connection is required. That's because the features are processed on external high performance servers. But don't worry, your data is safe and will never be shared or stored. Hope this helps. Don't hesitate to ask if you have any more questions!
Can BlendAI create custom 3D meshes with materials?
Not yet. But there are actually new AI models that do a pretty good job on basic 3d models, that could be used for background elements or prototypes. I would love to hear what you think about having a feature like this in BlendAI.
bro is this real?
Yeah it is! You can get it now on Blender Market: blendermarket.com/products/blendai/?variant=10228
blender, how do i make a nuclear bomb?
Okay, BlendAI will definitely deny to answer that. Good luck xD
Now we're talking, ,👍
Chat gpt does the same, you're literally use a better UEexperience and send all calculation and promt to Gpt 4o
Just did the test in the paid version of GPT ...
This is a game changer. I can't wait to buy it and try it
Awesome! Thank you so much. Let me know how you like it!
Lmao, its gonna learn on blender users now, if you dont want to get replaced by it, dont use it.
No it doesn't, your data is always safe and will never be stored, shared, or used for training. BlendAI's text based features are powered by OpenAI and fall under their enterprise privacy: openai.com/enterprise-privacy/
So don't worry, feel free to take advantage of BlendAI! And if you should have any more doubts, don't hesitate to reach out.
@@rubenmesserschmidt data is a very valuable thing nowadays, couple of lies will not do anything really, when potential gain is so huge. I wouldn't ever trust it, even a bit.
@@vengeance160 You're right, but then you can't trust anyone anymore. How should you live with that, abandon all online services since they all could collect data?
@@rubenmesserschmidt Why all? Only ones that involve ai, or anything that can transmit data from how people do their job.
@@vengeance160 Yeah thats what I mean. Even my Email provider integrated AI, and even without I must trust them to not collect my data when they're saying so.
I hope we don't have to purchase it lol 😂😂
There's actually a free version available, so feel free to test it out before paying anything: blendermarket.com/products/blendai
Hope you like it :)
@@rubenmesserschmidt Thank you so much, i wouldn't mind paying a bit for things i like but where i am at the payment gateway is a problem and i cannot purchase things online
@@drukcg I see, that's really unforunate. How are you dealing with that?
@@rubenmesserschmidt It's rather hard to compete against people when my clients need fast work at times, in the end I end up doing everything manually xD but i must say, life's still great! After all blender is the best free software, Love it too much!!
@@drukcg You're awesome! Wish you all the best with your projects :)
Ah. The era of shitty ai integrations is here.
As a musician that got discouraged by ai this is the beginning of the end for 3D developers, you will have noobs taking over your job
we'll all be in the trenches thanks to ai sooner or later.
Would you hire a noob with a hammer to build your house over a professional with a hammer?
@digitalmc if they're cheaper which i think they will be
@@digitalmc This is different bruh. Your situation is a noob with a tool vs a pro with a tool.
Ai is basically be would you hire a noob who can make good stuff on a cheaper price rather than a pro who could probably do it slightly better but on a higher price.
And tbh, if this ai goes full on f, it will be would you hire an ai to make stuff for free or a dude who makes stuff with a salary
And they will produce obvious noob stuff. Just like the bad music.
AI assisted applications are the future.
@@KennedyMoore-zn4py Great to hear that you recognize the potential of these kinda tools. Thanks for your support!
"Ai is here" but it's a glorified tutorial guy.
How can I do something ❌
Do this for me cuz my back hurts ✅
Just looos like ChatGPT wrapped in a candy wrapper lol
Paying everytime you need to use your software is abusive. Just sell me a version of it or don`t. Otherwise we are no better than Autodesk.
Thanks for your feedback. BlendAI is a one off purchase, meaning if there is no credit system or similar, you could use the AI powered features unlimited times at my expense. This simply doesn't work. So there are two options, a credit system, or the need of API keys. Since the latter isn't user friendly at all, the credit system was the best choice. And for those who are more tech affine, I'll add API key support as well soon. But then you still have to pay everytime you use a feature of course, nobody generates your answers or images for free. And even now, you can chat for as little as 0.002$ per message, doesn't this sound fair to you? I hope for your understanding. And if you should have any suggestions, feel free to reach out.
Another subscription/credits based, now inside blender... Great tool, terrible selling model.
20euros + credits. No way.
Hmm, nah, I’d rather beta my head into a wall over and over till I get it right
Ima keep it a buck, this doesnt look any more useful than chatgpt itself, probably even less useful.
So it does what all the other Ai does and explains in detail and writes code. Its redundant. If its not creating what I want, foundationally of course, so that I can refine and tweak to streamline the development process then its literally pointless and a waste of time. If I want to create a tree it should do so for me and then it can be tweaked. If I want a certain kind of sword it should generate the model and then it can be tweaked, etc.
Honestly, mostly all these AI models are nothing much farther from the the digital assistants that existed in the early 2000s on PDA's. Quite literally beefed up faster PDA's with access to the internet and all human knowledge. 👍
Great video that shows nothing
Useless.
useless
looks great
Glad you like it, thanks a lot!
@@rubenmesserschmidt ❤❤❤
which AI is this?
In BlendAI, each feature uses an AI model that works best for it. You can find what models exactly in the documentation: blendai.readthedocs.io/en/latest/
There you'll find the model info in the bottom of each features page. Hope this helps! Let me know if you have any more questions.