What is information theory? | Journey into information theory | Computer Science | Khan Academy
ฝัง
- เผยแพร่เมื่อ 27 เม.ย. 2014
- A broad introduction to this field of study
Watch the next lesson: www.khanacademy.org/computing...
Missed the previous lesson? www.khanacademy.org/computing...
Computer Science on Khan Academy: Learn select topics from computer science - algorithms (how we solve common problems in computer science and measure the efficiency of our solutions), cryptography (how we protect secret information), and information theory (how we encode and compress information).
About Khan Academy: Khan Academy is a nonprofit with a mission to provide a free, world-class education for anyone, anywhere. We believe learners of all ages should have unlimited access to free educational content they can master at their own pace. We use intelligent software, deep data analytics and intuitive user interfaces to help students and teachers around the world. Our resources cover preschool through early college education, including math, biology, chemistry, physics, economics, finance, history, grammar and more. We offer free personalized SAT test prep in partnership with the test developer, the College Board. Khan Academy has been translated into dozens of languages, and 100 million people use our platform worldwide every year. For more information, visit www.khanacademy.org, join us on Facebook or follow us on Twitter at @khanacademy. And remember, you can learn anything.
For free. For everyone. Forever. #YouCanLearnAnything
Subscribe to Khan Academy’s Computer Science channel: / channel
Subscribe to Khan Academy: th-cam.com/users/subscription_...
![[UNCUT] รัฐสั่งหยุดปล่อยคลื่น! แต่หยุดพลังปะทุ “น้องหญิง” ไม่ได้ I คนดังนั่งเคลียร์](http://i.ytimg.com/vi/RmQh47eIiV0/mqdefault.jpg)
Hello everyone, just here to say I stumbled to a side of TH-cam that is blowing my mind right now
Let your mind grow
Don't let it stop expanding
It’s amazing
Same here
Elon musk had an interest in information. So I thought.... Maybe I should too... Thanks for your comments
String theory?
I must say that this is the best intro to a topic I have ever heard, it did it's task, to make me curious about the topic and willing to learn, perfectly. I don't know what exactly caught me, but there's something special in this particular combination of words, pronunciations and sounds.
Dejan Bogosavljev awesome I hope you enjoy the rest of the series let me know how it goes
Just finished it, what a ride. Thanks for posing all of this!
+Dejan Bogosavljev Good news. Episode three is happening! Stay tuned.
0
Good morning my all Facebook friends
In physics, information is "the distinction between things".
In chemistry its the relation between things.
Gosh ...that tearing apart of page from the book hurts...
I felt exactly the same!!!
Love all the shots and image resources used in this video
I like this channel. I'm already teaching this topic for student in Iraq.
One my favorite topics!! Explains much.
This is explains why Information Literacy is so important to any Great Scholar 💯
2:22 based on 2:42 is simply not true. "Information" refers to the length, complexity and meaning of the message, while bits are just one unit among many others for transmitting/encoding state changes. For information, it's not valid that its encoding is necessarily binary, and if so, to encode/express an information message in a binary format/medium, the amount of bits needed can explode, because in reality, information is hardly emitted by an exclusively binary source without any context, so encoding/translating/converting such messages into the artificial binary encoding scheme increases the amount of bits needed in order to represent the message loss-lessly, preserving its informational meaning.
this intro is gold
Omg I have an idea yayyy
Say we take the bit as the most fundamental unit of measurement for the book in question in this video, and measure its bits.
But then we rearrange the sentences of this book to be as informationally compact and direct as possible while still maintaining the original meaning: he rearranged book is now composed of less bits, although the total meaning of the first book and the rearranged book is still the same.
Does this insinuate that the number of bits is somewhat arbitrary when measured to meaning itself?
Excellent introduction for someone with no idea about the subject. But did u really have to tear the book :) ?
This video/topic freaks me out
How many bits? Have fun answering the question with me? (I think research is fun.) How many bits in a hard disk? How many bits in the human mind? How any bits in the universe? If you would like to have a session of pondering about these questions by having a conversation and researching the web, contact me.
Where is the full series?
I didnt know this was a legit theory in science. I was just telling someone the other day how all anything is in the universe is just data. Everything in existence is just a compilation of data. Everything. Weird concept but thats reality.
Intriguing
Computational Irreducibility and Computational Equivalence is more important than Information Theory.
Measuring information by its entropy is like measuring two points on the globe by how far away they are from the equator. Sure, they can be compared, but they aren't actually being directly compared to each other. This is what's always bothered me about this kind of metric for information.
Yes, me too. Density put in a leash between 5 and 5.
Traduit en toute les langues sauf le français, nikel 👌
Madan gupta from jammu kashmir state jammu tawi india
Studying elon musk and he got me in a rabbit hole
I hate how surreal this video is
Whoah hold on can any information be stored in bits? Isn't that true only if it's digitized? Human memorizes aren't stored in bits AFAIK.
can you tell me the differnce between 'information science' and information theory' with suitable examples?
cynthia mandal info theory is the scale, info science is you giving me your phone numbwr
Information science is a field that focuses on how information is organized, processed, and used effectively. It deals with the study of information systems, information management, and the practical applications of information in various domains. Information scientists explore ways to collect, store, retrieve, and analyze information to support decision-making, knowledge sharing, and problem-solving.
Example: Imagine you're working in a library, and you want to make it easier for people to find books. An information scientist would study how books are organized, create classification systems, design user-friendly catalogs or databases, and develop efficient search algorithms to help people locate the books they need.
Information theory, on the other hand, is a mathematical and theoretical discipline that focuses on quantifying and measuring information. It explores fundamental concepts such as data compression, coding, transmission, and the limits of information transfer. Information theory provides a framework for understanding how information can be efficiently transmitted and processed, regardless of the specific content or meaning of the information.
Example: Think about sending a text message to a friend. Information theory is concerned with how to transmit that message efficiently and accurately. It deals with questions like: How much information can be transmitted over a limited bandwidth? How can we compress the message to save storage space or reduce transmission time? Information theorists develop mathematical models and algorithms to optimize the transmission and processing of information in various communication systems.
In summary, information science focuses on the practical aspects of organizing and utilizing information, while information theory deals with the mathematical principles behind how information is quantified, transmitted, and processed efficiently.
Can you encrypt odors ?
nope
but not scents
@@camilserapian7675 lol
The composition of a compound is an entirely different thing from the sensation which it elicits from a nervous system with consciousness. That's the fun part
@@marcus8710 So you'll realize that you are encrypting a chemical molecule atom by atom .
Neo from the matrix loading right now.
“The bit a unit of surprise” what?
What does the " cave " have to do with it? Plenty of animals have learned to communicate without a cave.
Thinking of reality as information relies on the fallacy that all ideas are on the same level of abstraction.
For example, saying that an almost perfectly defined, not very abstract concept, like a specific chair, is on the same level of abstraction as a very loosely defined, very abstract concept, like pride, is fallacious.
This is why computers still cannot think as critically and as creatively as humans do. Artificial intelligence relies on the false assumption that all concepts are perfectly defined and at the same level of abstraction. This presumed single level of abstraction is called “information”.
For everything to be on the same level of abstraction, one could only look at the Universe at the infinitesimal level. Here, the level of abstraction is zero. It’s the most fundamental level of reality.
But of course that would be computationally impossible, as well as nonsensical because at the infinitesimal level, there are no such things as observers, like humans or computers.
Deep logical thought provoking
To me, reality is only a concept that affects the observer. Assume a world with no observers, would such a world physically exist? If so, how do you prove it without being able to prove that it exists, or existed in the first place. Computer's are not abstract, they don't rely on any abstraction as they are physical machines, if we are not talking about automata. How we manipulate the machine to create systems rely on abstract principles like "information" as they can be more productively put into use that way rather than thinking and tracking each electron and their energy.
And if by AI, you are referring to artificial neural networks, they rely upon statistical regression to "predict" a pattern to a given set of input based on algorithms like backpropagation. While computer's still cannot think anything abstract like humans to be critical or creative in the same sense as humans, they have a lot other uses if you haven't noticed. People used their creativity to come up with a solution to connect each other wherever they are situated, and they came up with transistors to revolutionize information processing. So who is to say that humans would fail to make computers compute reality far better than humans, with or without the creativity and critically like us? (
Watch this video high as fuck just trust me
I believe everyone who has ever done shrooms is aware of this info. Or is that just me?
anyone who's been manic too
"Too Much Information!" ~ The Police
Shout out CpE 3A
Also anyone here from computer class
Me
Why did you say "we return to the cave"? Is that some sort of refrence i don't get or what
Possibly Plato's cave allegory idk.
Visuals are destructive.
No way people here past 2022
*INFORMATION THEORY ESTABLISHES a MIND is ALWAYS the ORIGIN of INFORMATION, SO DNA CODED INFORMATION COMES FROM...*
wrr
In the Christian bible, this paradox/conundrum is referred to as the Tower of Babel ...
Yeah, I would think so. Cant find our satisfaction in information but it is the way yo go about life right?
no such thing as dna or not or powerx excix etc about it
💤
wrg
Elon 💖
fElon
*CHILDISH ATHEISM?*
*One small child says to another, "I think cellphones grow on trees."*
*The other child responds, "I think someone makes them."*
*The first child then replies, "Nah, until I can figure out how to make one on my own I won't believe anyone else can make cellphones."*
CHILDISH THEISM?
One small child says to another, "I think cellphones are created by God."
The other says, "I think regular people create them."
The first child then replies, "Nah, because I can't figure out how to create one on my own they must be created by God."
@@ihmejakki2731 *I guess you failed to understand the video. Information theory is a well-established theorem that is easily analogous to the information discovered in the genetic code of DNA.*
*So the point of my illustration is that the first child is basing his expectation on what is observable, provable. Whereas the second child is not.*
*Hence, any hypothesis that the information encoded in DNA somehow came into existence by undirected random chance is, well shall we say, bullocks! And resembles the naïve mind of a child (or smells like the deceptive practitioners of blind faith found among the dumb masses clinging to world religious institutions & organizations).*
Again, a wrong definition of what "amount of information" is. "A bit is linked to a very simple idea, the answer to a YES or NO question.Think of it as the language of coins." That YES OR NO question is assuming that the yes and no correct answers refer to one of two events which are exactly equally probable. IF you do not explain the PROBABILITY then your definition is TOTALLY incorrect and confusing. Too bad it has so many views.
I
Javier Livia's Cantu
.
Furthermore, the "yes" and "no" binary informational encoding makes in itself no statement about coins or letters or hyroglyphs, therefore this particular type of information limited to yes/no without any context or meaning doesn't say anything about probabilities or amounts of "information" other than what's needed by the binary medium for information encoding, regardless, separate and not related to the actual information that's lined up for transmission.
Thanks for wasting my time.
So poorly done