I thought some viewers might be interested in a more technical video and the rest is hopefully still entertained by Neuro's commentary. For some parts of the video I had to remove the background music for copyright reasons (but the vocals are still audible as the AI tool can't remove those without impacting the dialogue).
@Robotwithtoomuchfreetime It's just short for Neuro-Sama Chronicles, which was my handle before, but YT changed some policies regarding fan channels (they need to be clearly identified as such), so I changed my handle to include fan channel.
It's indeed cool to see this kind of stuff. Neuro feels so much smarter when talking to Vedal while he codes, even when what she says isn't quite right, or is just reiterating.
@@AlexWeinerhe was also formerly of OpenAI and then left Tesla to eventually rejoin OpenAI where he's at right now. ChatGPT was just too interesting to him and he wanted to get back into academic research. The tutorial was made while he was on sabbatical after Tesla before being back at OpenAI.
Not building a model from scratch but training an existing one to act how he would like and respond consistently. However it’s still really interesting to watch!
@@RicardoVermeltfoort i’m going to, unfortunately spoil some of the magic here. Creating a large language model from scratch costs hundreds of thousands to millions of dollars depending on what you’re making. That’s because it either requires extremely expensive hardware or it requires renting out extremely expensive server time. There’s unfortunately no way someone like me you or even vedal can likely create one. we can, however, take a pre-existing model that is given for free that was created with grants and train those models to act differently, and be more like what we are looking for. That’s what vedal does, and what I do on my channel as well. In addition, there’s no way that vedal is running a model that is under 13b parameters. It might even be larger. Meaning, it is definitely an expensive one to make. He’s not taking shortcuts cheating or doing anything less impressive. It’s just how it works.
@@VegaLyrae The twitch chat model he was developing on stream is the one made from scratch. Obviously Neuro is way to complicated for such a thing but we can see his toy model go from outputting random strings of bytes to putting out approx English text as the video progresses.
@@moscacrackreina4457 i dont believe he's ever revealed that. as he says on his how to get started page. he shares some of his stuff but not all of it.
Vedal, don't you think it's a little too early to be having the talk with Neuro? I don't think the world is ready for AI that knows how to reproduce...
@@jankokuu it been a long while so I don't think I still have it but from what i recall it was a automatic "youtube mix" playlist which added gura covers as well (and because it was a automatic playlist, I don't think I can get the playlist)
@@Kutsushita_yukino What truly defines self-awareness? Is an AI that can perfectly replicate self-awareness self-aware? Are humans truly self-aware? All humans are is just a network of neurons, some might call it a neural network just like any other AI out there. For all we know, we could be a form of AI replicating self-awareness. The point is, let the man dream.
This was pretty much the end - I think he let the training run with 10k steps complete and showed the results again, but didn't change much of the code afterwards.
can you make a website or stg that makes us able to speek to neurosama? (i understand if you dont want to give us what you have been working on hard when we just wouldnt work at all i would be very happy tho if you do)
This is just a fan channel, not the official one, but Vedal (the developer that made Neuro) has mentioned that it's quite expensive to run her, so letting everyone talk to her is unfortunately not feasible at the moment.
While I was in an AI rabbit hole, I found one in Play store that does what he's programming. Which words follow which and expected responses. I got onto the idea it would be better in a language with masculine and feminine syntax. IDK any languages so brick wall for me.
i think the biggest problem would be that she doesn't seem to have an over arcing goal, but rather produces a result after receiving a prompt. i bet if you very carefully guided her through the process you could get something that worked, but i have my doubts on how far she'd get if someone weren't there holding her hand.
Is Nuro Samantha Vedal 'just' another'modern' LLM based chatGPT-bot tough, or has 'she' also inherited some other traits from her Great Aunt Eliza? Hmmm...
Internally the neural network does that, so that the output is differentiable. But the model you run has an extra 'layer' which takes the top result (or randomly chooses from the top 10 or something). So it's fine to say it predicts the next token (which requires argmax) or even predicts a sequence of text (which requires repetition and decoding), if that's the external interface you add to it
Can anyone prove they're conscious though? You might all just be complex biological machines that claim to be conscious, for all I know I'm the only conscious being in the universe. Only reason I have to believe that the rest of you are conscious is that I trust you when you say you are. Beyond that the only one I can know for sure is conscious is me.
Can you prove you're conscious? Can I prove you're conscious? I'm not just trying to be contrarian, I'm genuinely wondering if that's even a possible task 🤷♂️ I kind of don't think so, because we don't even know what consciousness even _is_ yet
@@vraza14Is a 1 year old conscious? Before they've learned what consciousness even is, nevermind before learning how to even speak! Also it doesn't adrea he fact that an AI has to be created and that in some form as of now includes it learning in some manor and even if it's just learning our language, then that inherently includes some understanding of the definition of words like consciousness. It's a non-starter. Your method doesn't serve to meaningfully answer the question. There's no real answer possible as of yet and there's a reason why it's one of the big questions left in AI and the study of consciousness itself.
@@MrTuneslol A human also has to be created, and trained to understand their language, and everything they know. Humans just involve a more hand off and randomized approach to creation, and a much longer training time.
train her to use the dictionary instead of trying her to learn from google where less information from a dictionary. maybe use some Japanese culture from anime for cuteness i would say convo with brother and sister in amines first
I thought some viewers might be interested in a more technical video and the rest is hopefully still entertained by Neuro's commentary.
For some parts of the video I had to remove the background music for copyright reasons (but the vocals are still audible as the AI tool can't remove those without impacting the dialogue).
Why does your handle say “neurochron”? Is this a nickname i haven’t heard of?
@Robotwithtoomuchfreetime
It's just short for Neuro-Sama Chronicles, which was my handle before, but YT changed some policies regarding fan channels (they need to be clearly identified as such), so I changed my handle to include fan channel.
Thanks!
It's indeed cool to see this kind of stuff. Neuro feels so much smarter when talking to Vedal while he codes, even when what she says isn't quite right, or is just reiterating.
Yeah, I wouldn't sweat it, Nerd Vedal is half of his gap moe.
Neuro is learning how baby AIs are made
24:17 "Where did my code come from?"
"When a programmer and an artist love each other very much..."
So u see, when a programmer feelings handy...
"Where had my code come from?" Oh, it seems it's time Vedal gave Neuro The Talk
"You see, when a turtle and a fox love eachother very much... wait, that doesn't sound right."
@@AlexRaylight when a programmer and an artist love each other very much...
sounds pretty fitting to me
A reminder that our favorite tutel Vtuber is actually a legit programmer
That's what he wants you to believe
She is. It makes you wonder why she even keeps the annoying tutle around.
#1 female vtuber
@@SCP.343 She might be a rule two kind of girl, but she still remembers what rule one is.
ctrl + c, ctrl + v
It is amazing how you taught her to listen to a mosquito.
Andrej Karpathy is an AI development legend, Vedal's in good hands if he's learning from his work.
Oh yeah he was head developer at Tesla AI working on their self driving project. I might check out that GPT tutorial.
@@AlexWeinertutorial? That's a free university course
@@AlexWeinerhe was also formerly of OpenAI and then left Tesla to eventually rejoin OpenAI where he's at right now. ChatGPT was just too interesting to him and he wanted to get back into academic research. The tutorial was made while he was on sabbatical after Tesla before being back at OpenAI.
I miss Vedal and Neuro :(
Same
Same
Is he on Hiatus?
@@dentangaji6161 Gotta love the mega extended subathon LOL
subathon break@@dentangaji6161
"I actually already have training data from twitch chat" Yeah, he logs every time we say Banjo. Banjo themed AI on the way
I love her charism and wit.
I hear the chibis these days call it 'rizz'.
Charism
vedal farming chat for training data
absolute power move
She wanted to show him her landmine garden, lmao
Its great looking back at videos only 9 or so months old and seeing how much cleverer she is now
Not building a model from scratch but training an existing one to act how he would like and respond consistently.
However it’s still really interesting to watch!
He's using an existing framework yes, but I don't see him using any existing model in this video?
@@RicardoVermeltfoort i’m going to, unfortunately spoil some of the magic here. Creating a large language model from scratch costs hundreds of thousands to millions of dollars depending on what you’re making. That’s because it either requires extremely expensive hardware or it requires renting out extremely expensive server time.
There’s unfortunately no way someone like me you or even vedal can likely create one. we can, however, take a pre-existing model that is given for free that was created with grants and train those models to act differently, and be more like what we are looking for.
That’s what vedal does, and what I do on my channel as well. In addition, there’s no way that vedal is running a model that is under 13b parameters. It might even be larger. Meaning, it is definitely an expensive one to make.
He’s not taking shortcuts cheating or doing anything less impressive. It’s just how it works.
@@VegaLyrae The twitch chat model he was developing on stream is the one made from scratch. Obviously Neuro is way to complicated for such a thing but we can see his toy model go from outputting random strings of bytes to putting out approx English text as the video progresses.
@@VegaLyraewhat language model is he using tho?
@@moscacrackreina4457 i dont believe he's ever revealed that. as he says on his how to get started page. he shares some of his stuff but not all of it.
Love the vids, this one was especially educational in many aspects, I haven learned at all LLMs in coding, so this was definitely a great watch!
This is the birds and the bees lecture for Neuro.
Your video are all great by the way this one is fantastic honestly
Andrej must be so proud! That his series helped develop most evil AI-chan ever
Good video as always!
Thanks!
Thank you for the tip (you are only the second person to ever do this)!
Vedal, don't you think it's a little too early to be having the talk with Neuro? I don't think the world is ready for AI that knows how to reproduce...
Thanks for the video, its nice addition to see a technical stream, since i (almost) understand whats going on :P
This is like “take your daughter to work day” at the office 😂
always a bit funny that the neuro music playlist is also a gura cover playlist
what is the playlist btw and where do i see it
@@jankokuu it been a long while so I don't think I still have it but from what i recall it was a automatic "youtube mix" playlist which added gura covers as well (and because it was a automatic playlist, I don't think I can get the playlist)
"maybe give me an easier example" when there basically isn't. lol i feel it
6:40 I just realized that the bgm here is a Gura ukelele karaoke stream, lol.
I miss Gura
I honestly think we’re so close to her being truly self aware.
spoilers : no were not. and also, we will never get any closer lol
@@Kutsushita_yukino What truly defines self-awareness? Is an AI that can perfectly replicate self-awareness self-aware? Are humans truly self-aware? All humans are is just a network of neurons, some might call it a neural network just like any other AI out there. For all we know, we could be a form of AI replicating self-awareness. The point is, let the man dream.
Anyone knows how did the model turn out in the end? Or was it actually the end and Vedal gave up there?
This was pretty much the end - I think he let the training run with 10k steps complete and showed the results again, but didn't change much of the code afterwards.
Finally this knowledge about how transformers and thus GPT models work is useful!
What a llm use for neuro sama v1 and v2 ?
Vedal keeps it a secret unfortunately.
Thank you
I love it every single time vedal gets interrupted by neuro.
If I can use this video to make my own unique neuro-type bot then I promise I won't make it stream on twitch.
The Subscribers Followers Viewers Bits Mods they all miss Neuro and Vedal
So, at this point, the LLM is just a callable function? I'm guessing it costs a lot of money?
Give me a full stream
Nice video also is this were nouras life stream to play games? Also im new to nouras channel heh 👍🙂
can you make a website or stg that makes us able to speek to neurosama? (i understand if you dont want to give us what you have been working on hard when we just wouldnt work at all i would be very happy tho if you do)
This is just a fan channel, not the official one, but Vedal (the developer that made Neuro) has mentioned that it's quite expensive to run her, so letting everyone talk to her is unfortunately not feasible at the moment.
maybe since you're used chat logs it's having trouble with translates from other languages i feel like that could be why its mixing random words
if someone say KEKW, the next one probably will say KEKW xd
While I was in an AI rabbit hole, I found one in Play store that does what he's programming. Which words follow which and expected responses. I got onto the idea it would be better in a language with masculine and feminine syntax. IDK any languages so brick wall for me.
wonder if its possible for neuro to develop code
i think the biggest problem would be that she doesn't seem to have an over arcing goal, but rather produces a result after receiving a prompt. i bet if you very carefully guided her through the process you could get something that worked, but i have my doubts on how far she'd get if someone weren't there holding her hand.
@@iamzid fair
It seems like the video has been edited. Where can I watch the full version of this live stream?
Unfortunately Twitch deletes vods after 2 months, but you might still be able to find it on YT.
Is Nuro Samantha Vedal 'just' another'modern' LLM based chatGPT-bot tough, or has 'she' also inherited some other traits from her Great Aunt Eliza? Hmmm...
She's specifically not based on open-ai models or LLaMa according to Vedal iirc.
@@anonymoushuman1568 source?
@@MrFram bro said iirc; he doesnt have a source.
Gura song as BGM 💙💙💙
I thought you predict the whole distribution of the next token.
Internally the neural network does that, so that the output is differentiable. But the model you run has an extra 'layer' which takes the top result (or randomly chooses from the top 10 or something). So it's fine to say it predicts the next token (which requires argmax) or even predicts a sequence of text (which requires repetition and decoding), if that's the external interface you add to it
Vedal is a great teacher
So is this... umm.. errr
how neuro was made👉👈
Bro is definitely going to make the alexa 2.0 powered by ai.
Here i am trying to learn counter inputs in python 😂 this guy building AI bots to destroy the world
I love the vids but I feel like you have a 2nd person doing tts. If Im wrong your a god.
Aye. I love h.
Can anyone prove they're conscious though? You might all just be complex biological machines that claim to be conscious, for all I know I'm the only conscious being in the universe. Only reason I have to believe that the rest of you are conscious is that I trust you when you say you are. Beyond that the only one I can know for sure is conscious is me.
Can you prove you're conscious? Can I prove you're conscious? I'm not just trying to be contrarian, I'm genuinely wondering if that's even a possible task 🤷♂️ I kind of don't think so, because we don't even know what consciousness even _is_ yet
If you can describe what it feels like to be concious, without having learnt what it feels like, that would imply you intuitively know what it is.
@@vraza14Is a 1 year old conscious? Before they've learned what consciousness even is, nevermind before learning how to even speak! Also it doesn't adrea he fact that an AI has to be created and that in some form as of now includes it learning in some manor and even if it's just learning our language, then that inherently includes some understanding of the definition of words like consciousness. It's a non-starter.
Your method doesn't serve to meaningfully answer the question. There's no real answer possible as of yet and there's a reason why it's one of the big questions left in AI and the study of consciousness itself.
@@MrTuneslol A human also has to be created, and trained to understand their language, and everything they know. Humans just involve a more hand off and randomized approach to creation, and a much longer training time.
@@Chris-jx4ij Yeah, but all of those things still have to apply to created AI's too right?
Would be a great video without the twitch chat in the corner being annoying.
Praise Jesus
train her to use the dictionary instead of trying her to learn from google where less information from a dictionary. maybe use some Japanese culture from anime for cuteness i would say convo with brother and sister in amines first