25 papers · ranked by Valyu relevance
Peng Xu, Yamin Sayyari, Saad Ihsan Butt, Ercan Kuruoglu
In this paper, we present the concept of the logical entropy of order m, logical mutual information, and the logical entropy for information sources. We found upper and lower bounds for the logical entropy of a random variable by using convex functions. We show that the logical entropy of the joint distributions…
Jing Liu, Jianguo Xie, Lu Chao, Han Wu + 3 more
'Huamin Feng'] Semiconductor superlattice true random number generator (SSL-TRNG) has an outstanding practical property on high-throughput and high-security cryptographic applications. Security in random number generators is closely related to the min-entropy of the raw output because feeding cryptographic applications…
YanXia Liu, WeiMin Li, Chao Yang, JianJia Wang
The rapid development of social networking platforms has accelerated the spread of false information. Effective source location methods are essential to control the spread of false information. Most existing methods fail to make full use of the infection of neighborhood information in nodes, resulting in a poor source…
Kirandeep Kaur, Jack O’Brien-Cairney, Gaurav Singh, Manoj Upadhya + 12 more
Epilepsy has long been conceptualised as a disorder in which aberrant brain dynamics extend beyond the epileptogenic zone. Evidence demonstrates that loss of entropy is a generic feature of pathological dynamics in the brain, including the ictal state. However, the impact of recurrent seizures on entropy in the…
Jordão Natal, Ivonete Ávila, Victor Batista Tsukahara, Marcelo Pinheiro + 3 more
'Marcelo Pinheiro' 'Carlos Dias Maciel' 'José A. Tenreiro Machado' 'Leonid M. Martyushev'] Entropy is a concept that emerged in the 19th century. It used to be associated with heat harnessed by a thermal machine to perform work during the Industrial Revolution. However, there was an unprecedented scientific revolution…
Authors not listed
Gibbs’ paradox—the apparent discontinuity in mixing entropy for gases of varying similarity and the seeming reversibility of mixing-separation cycles—has resisted fully satisfactory resolution for 150 years. We present a solution based on categorical state theory, which posits that physical con f igurations are…
Stephanie C. Leach, Hannah Hollow, Jiefeng Jiang, Kai Hwang
Adaptive behavior requires integrating information from multiple sources. These sources can originate from distinct channels, such as internally maintained latent cognitive representations or externally presented sensory cues. Because these signals are often stochastic and carry inherent uncertainty, integration is…
Naveen Kumar, Ambesh Dixit, Vivek Vijay
Entropy has emerged as a dynamic, interdisciplinary, and widely accepted quantitative measure of uncertainty across different disciplines. A unified understanding of entropy measures, supported by a detailed review of their theoretical foundations and practical applications, is crucial to advance research across…
Mohsen Farshad
Providing a simple description of entropy as the foundation of thermodynamics is necessary for researchers in explaining physical phenomena in the universe. Here we dive deep into the meaning of entropy starting from the basics and ending with the Newton's second law of motion which may be rooted in a hidden dimension…
David Ellerman
We live in the information age. Claude Shannon, as the father of the information age, gave us a theory of communications that quantified an "amount of information," but, as he pointed out, "no concept of information itself was defined." Logical entropy provides that definition. Logical entropy is the natural measure of…
Demetris Koutsoyiannis, G.-Fivos Sargentis, Philip Broadbridge
While entropy was introduced in the second half of the 19th century in the international vocabulary as a scientific term, in the 20th century it became common in colloquial use. Popular imagination has loaded “entropy” with almost every negative quality in the universe, in life and in society, with a dominant meaning…
Amitava Roy, Vishwesh Venkatraman, Tibra Ali
Inspired by black hole thermodynamics, the area law that entropy is proportional to horizon area has been proposed in quantum entanglement entropy and has largely maintained its validity. This article shows that the area law is also valid for the thermodynamic entropy of molecules. We showed that the gas-phase entropy…
Luke Allen Myers, Nigel Lee En Hew, Shun‐Li Shang, Zi‐Kui Liu
The recursive property of entropy is well known in the field of information theory; however, the concept is rarely used in the field of thermodynamics, despite being the field where the concept of entropy originated. This work shows that the equation for entropy used in the zentropy, which is an exact multiscale…
Phil Attard
In 1948 Claude E. Shannon published a paper on the mathematical theory of communications that quickly became a classic. It established the field of information theory, which is vital to disciplines such as genomics, cryptology, computer science, network engineering, signal processing, data storage, quantum informatics…
Tarek Tohme, William Bialek
At the 2023 Les Houches Summer School on Theoretical Biological Physics, several students asked for some background on information theory, and so we added a tutorial to the scheduled lectures. This is largely a transcript of that tutorial, lightly edited. It covers basic definitions and context rather than detailed…
Arieh Ben-Naim, Antonio M. Scarfone, Miguel Rubi
In 2015, I wrote a book with the same title as this article. The book’s subtitle is: “What we know and what we do not know.” On the book’s dedication page, I wrote: **“This book is dedicated to readers of popular science books who are baffled, perplexed, puzzled, astonished, confused, and discombobulated by reading…
Pedro A.M. Mediano, Fernando E. Rosas, Andrea I. Luppi, Valdas Noreika + 4 more
Quantifying the complexity of neural activity has provided fundamental insights into cognition, consciousness, and clinical conditions. However, the most widely used approach to estimate the complexity of neural dynamics, Lempel-Ziv complexity (LZ), has fundamental limitations that substantially restrict its domain of…
Stephanie Wankowicz, James Fraser
During protein folding, proteins transition from a disordered polymer into a globular structure, markedly decreasing their conformational degrees of freedom and consequently leading to a substantial reduction in entropy. Nonetheless, folded proteins still retain significant entropy as they fluctuate between the…
Stephanie Wankowicz, James Fraser
During protein folding, proteins transition from a disordered polymer into a globular structure, markedly decreasing their conformational degrees of freedom and consequently leading to a substantial reduction in entropy. Nonetheless, folded proteins still retain significant entropy as they fluctuate between the…
Yoshiharu Mukouyama, Kenya Tanaka, Shuji Nakanishi, Yoshihiro Nakato
The emergence of life on Earth has attracted intense attention but remains unclear. A key problem is that the question of how living organisms can exhibit self-organizing ability that leads to highly ordered structures and active free independent behavior remains unanswered. This work reveals, by computer simulation…
Elizabeth A Stoll
Neuronal populations in the cerebral cortex engage in probabilistic coding, effectively encoding the state of the surrounding environment with high accuracy and extraordinary energy efficiency. A new approach models the inherently probabilistic nature of cortical neuron signaling outcomes as a thermodynamic process of…
Didier Lairez, Miguel Rubi
In the theory of special relativity, energy can be found in two forms: kinetic energy and rest mass. The potential energy of a body is actually stored in the form of rest mass, the interaction energy too, but temperature is not. Information acquired about a dynamical system can be potentially used to extract useful…
Andreas Schlatter, R. E. Kastner
A key tenet of the Transactional Interpretation of Quantum Mechanics is the idea that photon absorption localizes the absorbing material system. In doing so, it measures the location of the absorber and hence reduces information entropy which in turn needs to be balanced by appropriate entropy production, if there is a…
Yoshiharu Mukouyama, Kenya Tanaka, Shuji Nakanishi, Yoshihiro Nakato
The emergence of life on Earth has attracted intense attention but remains unclear. A key problem is that the question of how living organisms can exhibit self-organizing ability that leads to highly ordered structures and active free independent behavior remains unanswered. This work reveals, by computer simulation…
D. Lairez
Landauer's principle states that the logical irreversibility of an operation, such as erasing one bit, whatever its physical implementation, necessarily implies its thermodynamical irreversibility. In this paper, a very simple counterexample of physical implementation (that uses a two-to-one relation between logic and…