Category Archives: Entropy/Information

Q: Since the real-world does all kinds of crazy calculations in no time, can we use physics to calculate stuff?

The original question was: I’ve heard somewhere that they’re also trying to build computers using molecules, like DNA. In general would it work to try and simulate a factoring algorithm using real world things, and then let the physics of … Continue reading

Posted in -- By the Physicist, Computer Science, Engineering, Entropy/Information, Physics | 6 Comments

Q: Does how you deal cards affect how random they are?

The original question was: [My wife and I] always shuffle the deck at least 4-5 times before dealing.  But I’m sure that’s not enough and need some guidance.  Does the game previously played influence the amount of shuffling required to … Continue reading

Posted in -- By the Physicist, Entropy/Information, Math | 3 Comments

Q: The information contained in a big system isn’t the same as the amount of information in its parts. Why?

The original question was: Information doesn’t behave like any other quantifiable property. For example, to describe something which can be in any of 8 states, I would need 3 bits of information. To describe something which can be in any … Continue reading

Posted in -- By the Physicist, Entropy/Information, Math | Leave a comment

Q: Is it possible to objectively quantify the amount of information a sentence contains?

The original question was: It seems to me that it’s impossible to measure the information content of a message without considering the recipient of the message. For example, one might say that a coin toss generates a single bit of … Continue reading

Posted in -- By the Physicist, Entropy/Information | 3 Comments

Q: Why does the entropy of universe always increase, and what is the heat death of the universe?

Physicist: The increase of entropy is just how a scientist talks about the fact that the universe tends to do the most likely thing.  For example, if you throw a bucket of dice you’ll find that about a sixth of … Continue reading

Posted in -- By the Physicist, Entropy/Information, Physics | 9 Comments

Q: What does a measurement in quantum mechanics do?

Physicist: This is a follow up of this post, that would’ve been too long and meandering with this included.  To sum up that post, a “measurement” is an interaction that exchanges information. In the Copenhagen interpretation, what that measurement does … Continue reading

Posted in -- By the Physicist, Entropy/Information, Philosophical, Physics, Quantum Theory | 9 Comments