3.4 Huffman Coding - Greedy Method
ฝัง
- เผยแพร่เมื่อ 20 มิ.ย. 2024
- How to Compress a Message using
Fixed sized codes
Variable sized codes (Huffman Coding)
how to decode
PATREON : www.patreon.com/bePatron?u=20...
Courses on Udemy
================
Java Programming
www.udemy.com/course/java-se-...
Data Structures using C and C++
www.udemy.com/course/datastru...
C++ Programming
www.udemy.com/course/cpp-deep...
![CAMPปลิ้น | EP.76[2/2] เดินมาสิบกว่าป่า วันนี้รู้แล้วว่าโจโฉกลัวอะไร!](http://i.ytimg.com/vi/R7Yor-t2Au0/mqdefault.jpg)
My professor spent 1 1/2 hr to explain this. This man did it in 17 minutes. Thanks Professor Bari!
Mine spent 2 hr ....
Same
time compression technique
...and I learnt it in 12, thanks to TH-cam 1.5X :D
did your professor prove why this is better? if yes, then spending 1.5 hours is worthful,
Singh's Law: whatever you are trying to learn, a South Asian man somewhere on the internet explains it perfectly.
Indian the term you are looking for is Indian
@@snehashishsrivastava9018 sometimes they're Bangladeshi or Pakistani or otherwise
*curry Singh’s law
we indians always good with explaining
@@snehashishsrivastava9018 I am Pakistani and agree with this statement
I'm proud to say that i'm his regular student not only on TH-cam, on Udemy as well.
data structure also available there?
@@rahularya7891 g bhai
@@aliz5972 teek
@@aliz5972 How's the data structure course?
@@anujakulkarni8988I can't ask for anything more than that. Content is Complete and precise and the teacher got some skills man. He is genius.
If teaching is a work of art, then you are a master piece sir. Huge respect!!
Sir, please teach my professors how to teach.
🤣🤣🤣
Lol
exactly bro
Very true
🤣🤣😂
I passed my DAA thanks to you Sir! Allaah azza wa jal aapko khoob kamyabi ata farmaye! Ameen!
He is the best person who explain each nd evry doubt without asking. Thank u sir 😊
yes, relatable!!
That's true
100th like💥
After I watched this, I did my discussion on my class related to this topic, many classmates thanked me for a clear explanation. Thank you sir. You helped me and classmates too.
Teaching is an art and you are the master of it🙏 thankyou sir you made my DAA concepts clear.
Never thought learning algorithms would be fun .Thanks ,sir for demystifying algorithms
I am glad to see a video actually dwelling into the concepts used behind any algorithm implementation. It's hard to find such videos on TH-cam. Great work Sir :)
Huffman Coding starts @ 8:46 .
Bless you
thx!!
Thanks
Tq
My plans for studying for my Algorithm Analysis class from now on...
Step 1 - Read the syllabus to find the topics my professor will talk about in the upcoming lecture.
Step 2 - Watch Mr. Bari's videos on topics from step 1.
Step 3 - Read book for some more info on topics from step 1.
Step 4 - Attend my lecture, and desperately try to stay conscious.
Thanks for another great video. +1 cookie for you!
I am following your videos since months, they're really classic.
Thanks a lot for making such classic videos.
I'm a Brazilian student of computing systems and I learn a lot more with you than with any other teatcher in here
I've been binge watching his videos, it's so addictive 😂
I keep on reminding myself about the stature he carries, the command he brings, that professor element is something special which will keep you attentive..!! 🙌
dude! same. It's like watching a movie.
I can’t believe you are such a good teacher, Sir. You remind me of my digital electronics teacher in my undergrad school
i took multimedia class and learned this from your video 1 day before exam got 85 then i didnt study for final and didnt do project and got D, then i took the course again and relearned this from your video got B from course. now i am preparing for master degree interview and reviewing again from same video of yours :D thanks for helping me out all these years :)
Best Lecture On TH-cam For Huffman Coding.
I love you man, i come from my lecture confused and in 1 video I completely understand everything. You have a gift, thank you for sharing it with the world!
After watching few videos on Huffman Coding, I can definitely say that this is the BEST video for the topic.... GREAT DEMONSTRATION...!!!!! (y)
I never fast forward your videos,everything you say Sir,is valuable.
Your explanation of Huffman coding really helps me understand the topic better. I really like your approach to explaining the topic, where you used a simple example for the coding and decoding steps. Your explanation makes this complicated topic look so simple, thank you for the clear explanation!
Thank you for the explanation about Huffman coding! The pace and the way you explain it are so clear and help me to understand the topic better. I've been watching your youtube videos to understand Computer Science better and it's never failed to amaze me how you explain difficult concepts in simple examples!
I'm a self-taught programmer , your videos help me alot . Thank you Sir 😊😊😊
Mind blowing style and teaching. So soothing and calming
The way you explain huffman coding makes it very easy to learn and understand. With the help of the simple examples and exercise it also helps me understand the concept better. After watching this video, I instantly understand about huffman coding and how to decode and compress a message.
I really Like how you explain Huffman coding very simply and make it for me really easy to understand in one go without having to repeat the video to understand. my favorite part is when you explain how to determine the bit using a tree, and with that, I immediately understand how to compress a message using Huffman coding and also how to decode the message
Thank you Sir, the way you explain is marvelous, i saw so many video's but still my concept was not clear but after watching your video i know better.. thanks a lot.. 🙏🏼
Wow I have no idea that Huffman coding is actually quite easy. You explained it so well that I've never seen such a great lecture. Now I'm interested to decode a message as well as making a decoder tree/table just for fun and play with. What a lecture and keep up the good work!
Best explanation I've found thus far. Thorough, concise and well articulated. Thank you, Abdul Bari! I got a midterm soon!
Now I understand how Huffman Coding works. Your explanation was very clear and simple, with great examples. Thanks
Amazing sir! You've done a spectacular job explaining Huffman to me, I appreciate it!
Hello Aseem and Azam!
Sir me college me ek lecture nhi attend karta hun....teachers ko kudh nhi pata hota....unlog kya pada rahe han.....aap jaise logo ka video dekh dekh ke hi sikh raha hun....sir aap aise hi video banate rahiye
Wonderful Explanation !!! Keep it up, Sir !! This Planet needs You.
This is the best video on Huffman coding. I've been watching all your lectures. You are brilliant and your lectures are just beautiful to watch. Even though, I don't think we can thank you enough, thanks a lot for dedicating your time to help us.
who has disliked this video? Please dont give dislikes to the videos of Abdul Sir.
some assholes bro!
Some people (mostly western folk) don't like heavy accents and differences in grammar when trying to learn complex topics. I've come across a lot of nearly unwatchable videos on TH-cam before but it's never (well it can be) the accent that makes it bad, it's the horrible, inaudible or distorted audio. This video is recorded well and the audio, although clipping a bit, is still intelligible.
No dislike from me.
Free and good content should not be given dislikes,
Many assholes will not understand one line and rage dislike the video,
really selfish according to me
these are the fastest brain alive.
Really stupid people that found these lectures difficult to follow.
What?
It was that easy 😶
Our teacher explained it in 2 lectures and I slept through both of them as I was finding it difficult as heck!
I know right!!
😂🎉
While teaching in class u will sleep due to lazy but if we want to clear in exam or forjob u will learn.
17 minutes worth one full set of question. Thanks a bunch, Sir!!! Really appreciate your effort for making the world a better place for learners like us
I'm so thankful for your simple and clear explanation to Huffman Coding with great examples that helps me to further understand. Thank you!
Thank you very much sir, ths was the best huffman coding explanation i've ever seen.
YOU are really a great teacher! Honestly i miss great Indian teachers like you up here in Canada!
Unbelievable explanation! Sr. deserves to be called a greater Teacher!
I always feel like seeing you Sir, that he saved me. LOTS OF *RESPECT*
ye to abdul bari hai ye to acha bacha hai .... thanks sir
ye school b jata h ye quran b pdhta h
Ye bat bhi manta hai...
Lol 😂
Best explanation on TH-cam. Thx.
Absolutely teaching power ! So simple, so understandible... so clear, so perfect! Congrats and thanks professor!
I couldn't understand this concept that my professor had been teaching for over a week. I understood it thoroughly in 17 minutes. Thank You
Hello Sir, I'm Maniraj. Your Teaching was Excellent.
sir you are making me lazy by covering whole syllabus in a single day GREAT TEACHING
I really like the way you explain Huffman coding in the video, the explanation is very simple and easy to understand and the examples you use in the video are really helpful, it helps me understand the topic better. Thank You!
The way in which you explain everything is very simple to understand.
Thank you Sir.
Awesome explaination SIR. Really smooth and well explained.
Fantastic explanation! Thank you for sharing sir.
fullest explanation ive seen so far, very helpful! thanks
Sir, you are one of the best teachers i have ever seen in my life, thank you very much sir for your video tutorial
beautiful! Just beautiful! Thank you soooooooooooooooooooooooooo much!
Best teacher ever, god bless you sir ❤
Thank you so much, sir. I have a test on data compression tomorrow and I had no idea about Huffman coding. I don't who else would have given a more succinct explanation and I understand this concept more clearly now. You are literally every computer science student's saviour. Thank you so much. Keep up the amazing work!! 🙏👏
Thank you sir Abdul, I've read lots of documents about this algorithm but thanks to what you taught, I made sense all of it.
Such a good teacher... this guy needs to be hire at a college
00:00 Huffman coding is a compression technique
02:25 Message size can be reduced by using custom codes with fewer bits.
04:34 Encoding messages using 3-bit codes
06:44 Table and chart decoding reduces message size by 35-40%
08:58 Huffman code generates variable size codes for characters based on their frequency.
10:54 Variable size codes can be used for message encoding
13:22 Huffman coding reduces message size
15:33 Huffman coding can be decoded to get the original message in ASCII code.
Your way of explanation is amazing...You tells everything about the topic which associate with other topics.Your starting is very effective of any topic that makes me your fan..You are an Effective Teacher.I am sharing your video with my friends.
This guy a legend seriously. Thanks for your helpful courses! Keep up the good work Mister!
Thanks a lot. You're really good teacher. I followed your channel.
Thanks for your help
Thanks for your help
Thanks for your help
Thank you very much you are a very good teacher
Thank you sir. You have helped me a lot. The way you explain all this is just amazing and easy to understand. Thanks again for helping out.
Superb video sir! Thank you so much, your short video is not only concise but incredibly clear and explained everything I need to know for my midterm in 2 hours!
Hi Sir,
It was very difficult for me to get to know the difference between the algorithms and it's implementation..
But after listening to your videos, I m master in solving those problems. Really I am grateful to you sir..
Thank you so much for your wonderful teaching.. you teach us the very difficult concepts in a simple way..
Really I am very thankful to you sir..
I am struck up in heaps and heapsort concept.
Please make a video on it sir..
I didn't find that part. So asking sir..
If it's already been done, please share the link sir..
Thank you so much sir....
Thank you sir..
@@abdul_bari have you done the heap video sir?
@@abdul_bari ok :(
@@abdul_bari Beautiful video, sir. Are you familiar with Sloot encoding? He was able to compress a whole HD movie down to 4 kilobytes losslessly.
He had a library of 370Mb, about 70Mb for each kind of data, movies, sound... He was obviously comparing data to data in his library, generating keys of minimal size which could regenerate the original on the remote computer from the same library.
Only way this can be done even in theory is if he reduced big chunks of numbers to small mathematical expressions.
For example number 302875106592253 can be shortened as 13^13. If numbers related to this one appear often, we can define it as letter a and then just express those other numbers as 2a, 3a etc.
Multistage compression would allow for such extreme compression ratio. Exactly how he did it is not clear.
@@abdul_bari video on amortized analysis plz
The above example can be further reduced into 8.625 bytes(69 bits) from 20 bytes(160 bits)
Input: BCCABBDDAECCBBAEDDCC
[1.] Total number of ASCII characters = 20
[2.] Each ASCII character take minimum of 8 bits( 8 bits = 1 byte)
[3.] Required size = 20 * 8 = 160 bits ~ 20 bytes
The compression algorithm,
[Step 0] : Use a TreeSet
[Step 1] : Create a bit_level, and all possible pattern (assume the level start by 1)
when bit_level = 1
It means, the bit can only take two forms( either [1 or 0]) (i.e 2^1)
[Step 2] : Check character existence in Step [0], doesn't exist goto Step[3], else goto step[4]
[Step 3] : Character doesn't exist, and bit_pattern hasn't been exhausted
Key that character( perhaps using a DLL--> DoublyLinkedList) with the unused bit pattern
B
The codes you propose lack a prefix property because BC will not be distinguishable from A.
Please recheck properly.
@@amudaadeolubadmus6282 Please have a look at what the prefix property actually is. And maybe even thank me.
@@ujin981
Can I assume this is what you're referring to by Prefix Property?
"(computing theory) A coding system that uses (typically variable-length) codes that are distinguished by their "prefix property", which requires that there is no code word in the system that is a prefix (initial segment) of any other code word in the system."
@@amudaadeolubadmus6282 Yes. Correct. Now you can comprehend that in your example BC is the prefix of A and therefore the proposed codes are not prefix-free.
Each time I repeat this video, I remember how amazing is your explanation! thank you Sir
Your videos have helped me a lot in my algorithm courses. Thanks!
If anyone is practicing along, the position of B and A in the optimal merge tree got swapped at 16:10.
Yeah but still it is correct
@@vivek8438 No. It is wrong.
friend :- there is a movie name kgf, hero occupied the gold mine,by killing garuda and won lots of hearts.
mee :- there is a youtube channel name Abdul bari, Narasimha(mee) covered all videos in his channel, And solved all problems and placed in google.
friend :- you won my heart tooo and yaa that's a greedy method...
meee :- KGF bgm Starts...................................................................................................
Wowwwww
The best set of lectures ever made. Sir, kindly make videos on Java as well.
This video about Huffman Coding is very easy to understand! I really like the part when you show that we can also use tree other than table since it's simpler and yet very interesting. Thank you for making this video sir!
Hi, isn't (5) and 4(D) supposed to be inverted under 9?
5 is bigger than 4(D) but stays on the left.
Shouldn't it be 4(D) to the left and 5 to the right of 9 ?
9
/ \
D(4) 5
By doing those changes, and after calculating the values using software, i get the following codes
d:00
e:010
a:011
b:10
c:11
Thank you
Is the same problem I got
in 4 anni e l'avrai risorto
sir the technique you showed is wrong as in huffman tree the smaller node should be on the left side , here you placed 4 to the right of 5 which changed the code of the element d which is wrong
Your explanation really made me understand Huffman Code. Thanks for helping me learn this.
You explained this so quickly yet I understood better than in my teacher's 2 hour class
sir if in the message like
"Huffman coding is cool" this has spaces in it. Will the spaces is counted? pls reply sir
@@abdul_bari thanks sir you saved my sem i am also a student of you in udemy
@@arpansarkar7924 a space is just a character, like any other character
8.37 huffman code
you saved my time
Thank you for the clear explanation about Huffman Coding, Mr. Abdul Bari! It was excellent, really helps me to understand the concept better since you made the complex concept of Huffman coding become simpler. My favorite moment from this video is when you use a case to introduce and explain the greedy method in the beginning of the video, as well as when to illustrate the greedy method using the optimal pattern tree graph. This is a must-watch video as a computer science student!
Great explanation. Other videos try to explain it using a trick, but they clearly don't understand what's going on. This video clearly explains the greedy choice!
Your tree construction is wrong. The left side should be 4 and right side should be 5 while creating node 9.
16:11 A replace by B ...
how?
before 16:11 A repeats 3 times and B repeats 5 times...
That's another txt. so numbers should be changed.
concentration level = 9999 😄😄
@@AamirKhan-zy5yt bhai mera ppr tha full tnsn mn prh rha tha is ne or de di
Really Really amazing Explanation of the huffman Coding. After hours of pounding over other sites this video made this algoithm extremely clear and easy to understand and implement. Thank you.
I had a hard time understanding the coding table but you explained it very well, thank you!
i have a query. if we use Fixed size codes or Variable sized codes(huffman), the number bits to be sent for each characters are reduced for sure. While sending the table information, you mentioned
character(8bits) + its fixed or variable sized codes( lets 2 bits for example). How can we send just 2 bits ?? I think we need to send the frequencies of each character again so that tree is reconstructed at the receiving end. But again if we send frequencies, in case of the huffman example it will be = 45(message) + 40(ascii characters) + 40(frequency count) = 125. The same is the case with Fixed. Can you please clarify on this?
if it has to work the way you mentioned, my assumption is that this whole data A(01000010) A's Huffman(001) followed by B, C, D etc and the orignal data.
But i believe we need to have some kind of delimiters between each pair( character, huffman code) and the before the original data.
Hey Ravi, Your doubt is very genuine now read it carefully,
Let say you want to send a message above illustrated example in encoded form with the same frequency as told by sir, now, two things you must keep in mind
1. The same person writes the encoding and decoding message.
2. Your objective is to read(encode) the message not to count the occurrence of a letter.
--Your first doubt- You want to send the frequency of the letters with character+fixed or variable size code.
----------------You are sending the original table with encoded table with encoded message, the message will tell the length.( How go to second doubt).
--Your second doubt is you want a delimiter to identify each encoded bits.
---------------See, when you will construct the tree, it will generate the each encoded bits in such a way that "No Huffman code of given character will be prefix of another Huffman code".
Using this you will be able to extract each encoded message without any mistake.
For illustration----
In the above given problem
A- 001
B-10
C-11
D-01
E-000
Here you can not find a single encoded character which is the prefix in any other encoded character.
Hope it will help you.
Thanks
There is a mistake in last part.The tree is diiferent from the previously drawn tree.
can you please elaborate?
I was watching it everywhere on others channel but not able to understand clearly...
But somehow i have got your video and ultimately i can say that my concept has been cleared...
Thank u so much !
The explanation on the topic is concise and the way you explain it made it sound simple, thank you
A very clear explanation regarding the topic! Keep up the amazing work!
You are amazing, I cannot understand how this method works until I saw your video, thank you!
Understandable, succinct , well presented - throw out your text books and listen to this man.
Fantastic teaching style !!! Appreciate these videos !!! Thank you !!!
Very good explanation sir. I just realized in the first few minutes that this is how compressing data works. Really enjoy it.
Abdul, please keep doing what you are doing! You are a great teacher and a huge help to confused students. We all appreciate your teaching style very much. Well done!
I really appreciate your explanation regarding Huffman coding, especially regarding the coding and decoding. The explnation of the tree was reallyceasy to understand becuase of the great explanations and presentation.
A concept very well explained with clear voice. I can understand the scope of the problem in the introduction part. Thank you for the explanation.