This is so helpful! I always wondered how lexers were implemented and even if this isn't something very advanced, it makes understanding so much easier! Thank you!
Legendary work! I'm currently going through the same process of making a compiler, so I guess TH-cam sent me here to be amongst comrades. Best of luck on the rest of this language! Have you read any books like "Crafting Interpreters", by the way? That one is an absolute treasure for learning to make a language, plus it's graciously hosted for free online. It was a colossal help in my own studies at the very least, so who knows-it might be of use to you as well :)
I have created my own programming language too using python as a backend but in my way, i mean that using my own set of logics to create an environment out from it and I haven't red any compiler design books. And it's working quite well then i had expected:').
i think there is an issue with " ' " crearing an invalid token, is it not better to compare symbol and begin of last token if last_token[0] != last_token[-1] for " and ' also me nitpicking here but: == False... really?
I completely agree! This was a while ago and I was no expert at python 😂😂Looking back recently it does seem that this code is incredibly messy and inefficient. I'm thinking of starting the series again.
@@theivorycoder that's an option, also, for the parser, is it not better to build an AST (en.m.wikipedia.org/wiki/Abstract_syntax_tree python also uses this internally)? it would make for a more generalized approach (as not every language had exec/eval functionality)
Alright, a few seconds in. Haven't watched more. But since this is written in Pythin, I am really hoping the custom language is not interpreted! Please be compiled!
@@warmBy The way a compiler and an interpreter differ is that an interpreter processes the AST, and a compiler translates the AST to binary or ASM or C or something else.
I understand that, this is merely a simplified version to introduce people to the fundamental concepts. I am fully aware no real interpreter would be coded like this
This is actually an amazing tutorial! You explain things really well too, unlike almost every other tutorial on the same subject
This is so helpful! I always wondered how lexers were implemented and even if this isn't something very advanced, it makes understanding so much easier! Thank you!
damnnn underrated my guy, you literally took making an ENTIRELY NEW CODING LANGUAGE, and made it EASY
thank you! that’s the goal 😄
How are you so underrated? This video is amazing!
aww thank you so much!
I watched the first five minutes, understood the concept, and made my own. Thank you for the great explanation!
Glad it helped!
Legendary work! I'm currently going through the same process of making a compiler, so I guess TH-cam sent me here to be amongst comrades. Best of luck on the rest of this language! Have you read any books like "Crafting Interpreters", by the way? That one is an absolute treasure for learning to make a language, plus it's graciously hosted for free online. It was a colossal help in my own studies at the very least, so who knows-it might be of use to you as well :)
I haven't! But not for long ;D
I really appreciate how you explained that. It helped me understand the concept much better.🤝
That’s great to hear!
I have created my own programming language too using python as a backend but in my way, i mean that using my own set of logics to create an environment out from it and I haven't red any compiler design books. And it's working quite well then i had expected:').
Make a video
Great! I'd love to see it
@@theivorycoder It was meant to be an imperative grammar tense, not infinitive. I’m asking him to show what he did
@@lsfornells I'm sorry, I don't really understand what you mean. I was telling Prakamya Khare that I would like to see their language
@@theivorycoder Yes, sorry, I replied to you on mistake. I love compilers too
I am a python programmer, and this is very good!
i know this might sound stupid, but what theme do you use, its easier for me to match colors than match words/symbols. thanks!
I think there might be a slight problem with quotes. If you try to parse "Hh'd'Gg", it will break it into three tokens, not 1, won't it?
cant wait for part 2
I love it!!! Please make more videos like this!
Nice tutorial, but how could you take print("Hi")? If I append "(" and ")", it shows me ['(', ')', 'print"Hello, world!"']
good question! this will be covered in a later episode where I go through how to add custom syntax
i think there is an issue with " ' " crearing an invalid token, is it not better to compare symbol and begin of last token if last_token[0] != last_token[-1] for " and '
also me nitpicking here but: == False... really?
I completely agree! This was a while ago and I was no expert at python 😂😂Looking back recently it does seem that this code is incredibly messy and inefficient. I'm thinking of starting the series again.
@@theivorycoder that's an option, also, for the parser, is it not better to build an AST (en.m.wikipedia.org/wiki/Abstract_syntax_tree python also uses this internally)? it would make for a more generalized approach (as not every language had exec/eval functionality)
Good tutorial, but I would recommend actually making your lexer a class and parsing by line for scalibility and adaptability
I would recommend using a state machine.
excellent video
looking forward for part 2 :)
thanks! you won't have to wait too long hopefully :)
Alright, a few seconds in. Haven't watched more. But since this is written in Pythin, I am really hoping the custom language is not interpreted! Please be compiled!
How do you imagine a compiler written in Python?
@@warmBy You can absolutely write a compiler in Python!
@@warmBy The way a compiler and an interpreter differ is that an interpreter processes the AST, and a compiler translates the AST to binary or ASM or C or something else.
Amazing! Are you planning to do more?
Don't worry I'm going to get round to it soon! 👍
Very good tutorial !
Thank you!
but like how do you obtain this knowledge. I have tried but with no avail. good job
It can seem like a bit of a mystery. But if you dig around enough you will find it. I'm just trying to make it more accessible :)
@@theivorycoder And I thank you so much for that.
I LOVEEEE THIS VCIDEOOOOO
I’m glad you’ve decided to get into coding alex 👍
What if i want to use "
if you mean declaring it like “” Then I’d recommend applying the same principle we used for recognising strings. If you mean “
Make an appointment with a psychotherapist
Every time you mention Lexer it sets off my Alexa :)
😂😂
@@theivorycoderYou need to Ko-fi or Buy me a Coffee!
Thanks, that's awesome!
kid this is not how it works
I understand that, this is merely a simplified version to introduce people to the fundamental concepts. I am fully aware no real interpreter would be coded like this
Look, it's a simple project, go make one yourself.