Latest LQ Deal: Linux Power User Bundle
Go Back > Blogs > Computational Entropy
User Name


De-obfuscation of the term Entropy and its relevance to computing
Rate this Entry

1.2 Entropy is Confused

Posted 03-02-2018 at 06:11 PM by Gyroman
Updated 03-02-2018 at 06:16 PM by Gyroman

I hope my last post demonstrated the unreliability of the Wikipedia on this subject.. more to come on that point.

If this blog inspires your interest in the subject and like most people here you are inclined to follow up with your own research, I encourage you to do so and confirm my conclusions.. I would only caution not to comment adversely unless actually you know what you are talking about.. Questions accepted anytime..

A fair test question would be "Can you explain why the Clausius heat equation for entropy change is only valid for a reversible processes or a system at equilibrium?" Which raises the rather obvious question: If a system is in equilibrium then thermodynamically speaking nothing can happen! We'll get to that.

Please don't get me wrong I am not just trying to be a smart arse. There are a lot more smarter arses around here than me.. I sincerely want to help everyone with the mildest curiosity in this subject to a) understand there is a problem and b) that it has implications for us all. In particular I want to relate the true meaning of entropy to computing in general as it is a particularly useful example of it..

Most of you will be well acquainted with the very low probability of writing a bug free page of code first time. Its no different mathematically speaking to say dealing a pair of aces in a hand of poker.. and its the very same reason you can reliably breath air containing about 20% oxygen wherever you go and heat always (of itself), moves from hot to cold. In fact from quantum physics (after Werner Heisenberg) Neil Turok concludes in his reality lecture "everything is a probability".. Even human thinking and reason..

Trivially obvious to you will be the fact the longer the code the more chance of bugs. What may not be so obvious is, that is not a linear relationship. Double the code is not just double the bug problem or probability of bugs.. Its a "power" or exponential law.

The take away line today is probability is at the heart of entropy and its true meaning. Its also why a proper definition of complexity was required which links complexity to entropy. Regards.
Posted in Uncategorized
Views 716 Comments 0
« Prev     Main     Next »
Total Comments 0




All times are GMT -5. The time now is 09:51 AM.

Main Menu
Write for LQ is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
Facebook: linuxquestions Google+: linuxquestions
Open Source Consulting | Domain Registration