LinuxQuestions.org
Download your favorite Linux distribution at LQ ISO.
Go Back   LinuxQuestions.org > Blogs > Computational Entropy
User Name
Password

Notices


De-obfuscation of the term Entropy and its relevance to computing
Rate this Entry

1.2 Entropy is Confused

Posted 03-02-2018 at 05:11 PM by Gyroman
Updated 03-02-2018 at 05:16 PM by Gyroman

I hope my last post demonstrated the unreliability of the Wikipedia on this subject.. more to come on that point.

If this blog inspires your interest in the subject and like most people here you are inclined to follow up with your own research, I encourage you to do so and confirm my conclusions.. I would only caution not to comment adversely unless actually you know what you are talking about.. Questions accepted anytime..

A fair test question would be "Can you explain why the Clausius heat equation for entropy change is only valid for a reversible processes or a system at equilibrium?" Which raises the rather obvious question: If a system is in equilibrium then thermodynamically speaking nothing can happen! We'll get to that.

Please don't get me wrong I am not just trying to be a smart arse. There are a lot more smarter arses around here than me.. I sincerely want to help everyone with the mildest curiosity in this subject to a) understand there is a problem and b) that it has implications for us all. In particular I want to relate the true meaning of entropy to computing in general as it is a particularly useful example of it..

Most of you will be well acquainted with the very low probability of writing a bug free page of code first time. Its no different mathematically speaking to say dealing a pair of aces in a hand of poker.. and its the very same reason you can reliably breath air containing about 20% oxygen wherever you go and heat always (of itself), moves from hot to cold. In fact from quantum physics (after Werner Heisenberg) Neil Turok concludes in his reality lecture "everything is a probability".. Even human thinking and reason..

Trivially obvious to you will be the fact the longer the code the more chance of bugs. What may not be so obvious is, that is not a linear relationship. Double the code is not just double the bug problem or probability of bugs.. Its a "power" or exponential law.

The take away line today is probability is at the heart of entropy and its true meaning. Its also why a proper definition of complexity was required which links complexity to entropy. Regards.
Posted in Uncategorized
Views 694 Comments 0
« Prev     Main     Next »
Total Comments 0

Comments

 

  



All times are GMT -5. The time now is 08:13 AM.

Main Menu
Advertisement
Advertisement
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
Facebook: linuxquestions Google+: linuxquestions
Open Source Consulting | Domain Registration