{"id":8351,"date":"2012-06-07T20:48:39","date_gmt":"2012-06-08T03:48:39","guid":{"rendered":"http:\/\/blogs.discovermagazine.com\/cosmicvariance\/?p=8351"},"modified":"2012-06-07T20:48:39","modified_gmt":"2012-06-08T03:48:39","slug":"evolution-entropy-and-information","status":"publish","type":"post","link":"https:\/\/preposterousuniverse.com\/blog\/2012\/06\/07\/evolution-entropy-and-information\/","title":{"rendered":"Evolution, Entropy, and Information"},"content":{"rendered":"

Okay, sticking to my desire to blog rather than just tweet (we’ll see how it goes): here’s a great post by John Baez<\/a> with the forbidding title “Information Geometry, Part 11.” But if you can stomach a few equations, there’s a great idea being explicated, which connects evolutionary biology to entropy and information theory.<\/p>\n

There are really two points. The first is a bit of technical background you can ignore if you like, and skip to the next paragraph. It’s the idea of “relative entropy” and its equivalent “information” formulation. Information can be thought of as “minus the entropy,” or even better “the maximum entropy possible minus the actual entropy.” If you know that a system is in a low-entropy state, it’s in one of just a few possible microstates, so you know a lot about it. If it’s high-entropy, there are many states that look that way, so you don’t have much information about it. (Aside to experts: I’m kind of shamelessly mixing Boltzmann entropy and Gibbs entropy, but in this case it’s okay, and if you’re an expert you understand this anyway.) John explains that the information (and therefore also the entropy) of some probability distribution is always relative<\/em> to some other probability distribution, even if we often hide that fact by taking the fiducial probability to be uniform (… in some variable). The relative information between two distributions can be thought of as how much you don’t<\/em> know about one distribution if you know the other one; the relative information between a distribution and itself is zero.<\/p>\n

The second point has to do with the evolution of populations in biology (or in analogous fields where we study the evolution of populations), following some ideas of John Maynard Smith<\/a>. Make the natural assumption that the rate of change of a population is proportional to the number of organisms in that population, where the “constant” of proportionality is a function of all the other populations. That is: imagine that every member of the population breeds at some rate that depends on circumstances. Then there is something called an evolutionarily stable state<\/em>, one in which the relative populations (the fraction of the total number of organisms in each species) is constant. An equilibrium configuration, we might say.<\/p>\n

Then the take-home synthesis is this: if you are not<\/em> in an evolutionarily stable state, then as your population evolves, the relative information between the actual state and the stable one decreases<\/em> with time. Since information is minus entropy, this is a Second-Law-like behavior. But the interpretation is that the population is “learning” more and more about the stable state, until it achieves that state and knows all there is to know!<\/p>\n

Okay, you can see why tweeting is seductive. Without the 140-character limit, it’s hard to stop typing, even if I try to just link and give a very terse explanation. Hopefully I managed to get all the various increasing\/decreasing pointing in the right direction…<\/p>\n","protected":false},"excerpt":{"rendered":"

Okay, sticking to my desire to blog rather than just tweet (we’ll see how it goes): here’s a great post by John Baez with the forbidding title “Information Geometry, Part 11.” But if you can stomach a few equations, there’s a great idea being explicated, which connects evolutionary biology to entropy and information theory. There […]<\/p>\n","protected":false},"author":4,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[28],"tags":[],"class_list":["post-8351","post","type-post","status-publish","format-standard","hentry","category-science"],"jetpack_featured_media_url":"","_links":{"self":[{"href":"https:\/\/preposterousuniverse.com\/blog\/wp-json\/wp\/v2\/posts\/8351","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/preposterousuniverse.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/preposterousuniverse.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/preposterousuniverse.com\/blog\/wp-json\/wp\/v2\/users\/4"}],"replies":[{"embeddable":true,"href":"https:\/\/preposterousuniverse.com\/blog\/wp-json\/wp\/v2\/comments?post=8351"}],"version-history":[{"count":0,"href":"https:\/\/preposterousuniverse.com\/blog\/wp-json\/wp\/v2\/posts\/8351\/revisions"}],"wp:attachment":[{"href":"https:\/\/preposterousuniverse.com\/blog\/wp-json\/wp\/v2\/media?parent=8351"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/preposterousuniverse.com\/blog\/wp-json\/wp\/v2\/categories?post=8351"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/preposterousuniverse.com\/blog\/wp-json\/wp\/v2\/tags?post=8351"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}