วีดีโอ

I am working with fine tuning for the purpose of text summarization purpose. Recent days, I have been experimenting with certain ways to finetune GPT2 for text summarization especially on the datasets like CNN-Daily Mail, XSUM etc. Though I learnt that encoder-decoder models like BERT are always preferred for these tasks over GPT, I would like to figure out a way better to make use of GPT or LLAMA for this task. I am not successful in generating the concise summary and most times the generated summaries simply mimic or copy the text. My Steps: I used <|pos|> and <|sep|> tokens for padding in GPT2 and also used an instructional prefix “Write a concise summary”. Truncated input and output to contain tokens which are no more than 1024 Used LoRA with r=16, alpha=32 and drop rate as 0.1 Applied cross entropy loss with ignore_index=-100 to mask irrelevant tokens Could you share some ways in llama or gpt2 as to how effectively one could approach this. Please could you share some ideas. Also from 'openai.com/index/fine-tuning-gpt-2/' they mentioned the same case

Sir, I really like how you planned this LLM playlist. It’s easy to follow. Can you share tips on making such clear learning plans? It would really help me in learning new skills!

Very good session, it reinforces key concepts - and provides further clarification

Sir, I really like how you planned this LLM playlist. It’s easy to follow. Can you share tips on making such clear learning plans? It would really help me in learning new skills!❤

Outstanding. thank you so much and keep going.

Thank you so much!

This lecture is more like a revision session.

unless you're living under the rock ahahaha well said. fantastic English

Outstanding! Thank you so much

Best video about LLm so far

❣️

What nonsense talk about India becoming attractive? India always appeals to people who do not want to work and face competition.

It looks that many commentator agreed to your idea. I will put only the other side of the thought. 1. You said India is developing. It is not. There are still 400 million who cannot read and write and do not have enough to eat. You have been victim of lies from the ruling class. As a MIT how woul you belive India is in the right path. Just think again. India cannot even enroll everybody into school even now. 2. To set a new company and run it, a country with a rule of law is much better than India. You do not have to bribe. No comparison. You do not even have to visit goverment office to start a company in the US. 3. I have travelled 26 countries and lived in 6 of them. I know Indian are looked upon high in the US, unlike in the UK or other part of the world. I agree the green card issue but once you have it your are not second class anymore. 4. Watch hindi movie "Uchai" to find out what relatives are for you. Relatives are good only when there is no strugle to meet ends. 5. I am from the same continent as you but I have lived without spicy food for many years in while in Europe. Once you are out of Indian food culture, you never want to go to India restaurant. That's explains why there are so few Indian restaurants with compared to Chinese, Mexican, Amefican or Italian in the US. I never go to Indian resturant the way most of the people in the US do not go. 6. You talked about exporting commodities you produce in your company. That is the slavey mentality imposed upon you by the British. Why would you intentionally make things for foreigner for money. Your service will make life easier for foreigner. Why can you not make some things for Indian so that Indian would be better off. You logic fails here.

Excellent thx

Superb class Do u think u can redo the linear algebra class and bring it at par to these probability class ?

Wow u made such a complex concept so intuitive 👍

Always loves to learn from you

Thanks

I am jealous of you. The whole thing is that there is no appreciation of hard work. The recognition and fruits of your hard work is enjoyed by someone else. Just think how much of our taxes politicians enjoy to send their family abroad to live or on vacation to enjoy. Doctors, lawyers are being killed and reservation quota gives all the benefit to undeserved. Will muslims let a a hindu live? I saw a tamil movie AMARAN where a brahmin gave up his life for the sake of the country and they would not recognize it in the film, while his wife a christian is praised all through out the film. Where is justice?

Well done bro

Thanks for uploading!! Yes! Once you have family and children enrolled into education, it becomes very difficult to reverse migrate! As per some highly respected social thinkers, by 2040, the best of the brains in the world will be working in India to service India and the world to shape life for humanity into modern times!!!

Good sir

Just another startup boy

False positive and negative result. Interesting session

amazing work, all well structured and break down for all to understand. hearty cheers to the team.

Amazing Lecture

Kindly share the notes

Kindly provide the notes

Phenomenal! Thanks for sharing your knowledge. Do you have plans to make similar lecture series on Reinforcement Learning?

Thank you for sharing this knowledge with us. Hopefully we can learn and share with other ppl as well.

what are the prerequisites I should have before starting ML journey? No where I see maths part is covered, so it is on us to learn?

these transformers are physical device or an algorithm ?

where can i get your lecture notes

Thanks for the sincere and honest feedback.

This intuitive teaching approach makes Linear Algebra fascinating. Thank you, Dr. Panat.

It's becoming clear that with all the brain and consciousness theories out there, the proof will be in the pudding. By this I mean, can any particular theory be used to create a human adult level conscious machine. My bet is on the late Gerald Edelman's Extended Theory of Neuronal Group Selection. The lead group in robotics based on this theory is the Neurorobotics Lab at UC at Irvine. Dr. Edelman distinguished between primary consciousness, which came first in evolution, and that humans share with other conscious animals, and higher order consciousness, which came to only humans with the acquisition of language. A machine with only primary consciousness will probably have to come first. What I find special about the TNGS is the Darwin series of automata created at the Neurosciences Institute by Dr. Edelman and his colleagues in the 1990's and 2000's. These machines perform in the real world, not in a restricted simulated world, and display convincing physical behavior indicative of higher psychological functions necessary for consciousness, such as perceptual categorization, memory, and learning. They are based on realistic models of the parts of the biological brain that the theory claims subserve these functions. The extended TNGS allows for the emergence of consciousness based only on further evolutionary development of the brain areas responsible for these functions, in a parsimonious way. No other research I've encountered is anywhere near as convincing. I post because on almost every video and article about the brain and consciousness that I encounter, the attitude seems to be that we still know next to nothing about how the brain and consciousness work; that there's lots of data but no unifying theory. I believe the extended TNGS is that theory. My motivation is to keep that theory in front of the public. And obviously, I consider it the route to a truly conscious machine, primary and higher-order. My advice to people who want to create a conscious machine is to seriously ground themselves in the extended TNGS and the Darwin automata first, and proceed from there, by applying to Jeff Krichmar's lab at UC Irvine, possibly. Dr. Edelman's roadmap to a conscious machine is at arxiv.org/abs/2105.10461, and here is a video of Jeff Krichmar talking about some of the Darwin automata, th-cam.com/video/J7Uh9phc1Ow/w-d-xo.html

🎉 it’s much much better to return back and help build your nation. I wish I could go back but we have totally uprooted

Yeh Jo Des Hai Tera….tujhe hai pukaraaaa…India needs its children to help transform it. That’s the big difference between choosing India vs US. No one needs anyone in the US, so everyone keeps trying to be needed, often sadly all life long. If you want the satisfaction and happiness of doing something that really needs to be worked on for both one’s own and the greater good, it is India. America has American patriots to do that.

Thanks a lot . Aweeome.

Thanks a lot .Awesome

Amazing :D

Yes bro .. although I'm obviously not Indian

Do engineers ( Mechanical) need this? Or just perform sci Ml first?

Liked the venn diagram method of explanation, had never seen it explained anywhere before.

Awesome lecture 👍

Great insights! Wish you the best; your kind can thrive any place and not just India

In the code how does pip install knows to download dataset from huggingface

found this series from your Reddit post, really enjoying it so far. Thanks