27 papers · ranked by Valyu relevance
Peng Xu, Yamin Sayyari, Saad Ihsan Butt, Ercan Kuruoglu
In this paper, we present the concept of the logical entropy of order m, logical mutual information, and the logical entropy for information sources. We found upper and lower bounds for the logical entropy of a random variable by using convex functions. We show that the logical entropy of the joint distributions…
Julius Vetter, Guy Moss, Cornelius Schröder, Richard Gao + 1 more
'Jakob H. Macke'] Scientific modeling applications often require estimating a distribution of parameters consistent with a dataset of observations—an inference task also known as source distribution estimation. This problem can be ill-posed, however, since many different source distributions might produce the same…
Rocco Gaudenzi
Since its inception, the concept of entropy has been known under a variety of guises and been used in an increasing number of contexts, achieving an almost rock star-like status in both the sciences and popular culture. The three most prominent “styles” which entropy has been (re)told in and which have determined its…
Mickael Zbili, Sylvain Rama
Calculations of entropy of a signal or mutual information between two variables are valuable analytical tools in the field of neuroscience. They can be applied to all types of data, capture nonlinear interactions and are model independent. Yet the limited size and number of recordings one can collect in a series of…
Omri Tal, Tat Dat Tran, Jacobus Portegies
We demonstrate an application of a core notion of information theory, that of typical sequences and their related properties, to analysis of population genetic data. Based on the asymptotic equipartition property (AEP) for non-stationary discrete-time sources producing independent symbols, we introduce the concepts of…
Leonardo R. Gama, Guilherme Giovanini, Gábor Balázsi, Alexandre F. Ramos
The promoter state of a gene and its expression levels are modulated by the amounts of transcription factors interacting with its regulatory regions. Hence, one may interpret a gene network as a communicating system in which the state of the promoter of a gene (the source) is communicated by the amounts of…
YanXia Liu, WeiMin Li, Chao Yang, JianJia Wang
The rapid development of social networking platforms has accelerated the spread of false information. Effective source location methods are essential to control the spread of false information. Most existing methods fail to make full use of the infection of neighborhood information in nodes, resulting in a poor source…
Yunus A. Çengel, Milivoje M. Kostic, Jean-Noël Jaubert
The term entropy is used in different meanings in different contexts, sometimes in contradictory ways, resulting in misunderstandings and confusion. The root cause of the problem is the close resemblance of the defining mathematical expressions of entropy in statistical thermodynamics and information in the…
Ravishankar Ramanathan
The extraction of randomness from weakly random seeds is a problem of central importance with multiple applications. In the device-independent setting, this problem of quantum randomness amplification has been mainly restricted to specific weak sources of Santha-Vazirani type, while extraction from the general…
Authors not listed
Gibbs’ paradox—the apparent discontinuity in mixing entropy for gases of varying similarity and the seeming reversibility of mixing-separation cycles—has resisted fully satisfactory resolution for 150 years. We present a solution based on categorical state theory, which posits that physical con f igurations are…
Marko Popovic
Entropy concept was introduced by Clausius 160 years ago, and has been continually enriched, developed and interpreted by the researchers in many different scientific disciplines ever since. Thermodynamics and other scientific disciplines face several simple but crucial questions concerning the entropy concept. Thus…
Xin Li
We continue the study of constructing explicit extractors for independent general weak random sources. The ultimate goal is to give a construction that matches what is given by the probabilistic method — an extractor for two independent n-bit weak random sources with minentropy as small as log n + O(1). Previously, the…
Arieh Ben-Naim
The idea that entropy is associated with the “arrow of time” has its roots in Clausius’s statement on the Second Law: “Entropy of the Universe always increases.” However, the explicit association of the entropy with time’s arrow arises from Eddington. In this article, we start with a brief review of the idea that the…
Amitava Roy, Vishwesh Venkatraman, Tibra Ali
Inspired by black hole thermodynamics, the area law that entropy is proportional to horizon area has been proposed in quantum entanglement entropy and has largely maintained its validity. This article shows that the area law is also valid for the thermodynamic entropy of molecules. We showed that the gas-phase entropy…
Rafael D. Sorkin
We express the entropy of a scalar field φ directly in terms of its spacetime correlation function W(x, y) = hφ(x)φ(y)i, assuming that the higher correlators are of "Gaussian" form. The resulting formula associates an entropy S ( R) to any spacetime region R ; and when R is globally hyperbolic with Cauchy surface Σ …
Mohsen Farshad
Providing a simple description of entropy as the foundation of thermodynamics is necessary for researchers in explaining physical phenomena in the universe. Here we dive deep into the meaning of entropy starting from the basics and ending with the Newton's second law of motion which may be rooted in a hidden dimension…
Phil Attard
It is shown that the standard expression for the information entropy, originally due to Shannon, is only valid for a particular set of states. For the general case of statistical mechanics, one needs to include an additional term in the expression for the entropy as a function of the probability. A simple derivation of…
Rainer Feistel
In conventional textbook thermodynamics, entropy is a quantity that may be calculated by different methods, for example experimentally from heat capacities (following Clausius) or statistically from numbers of microscopic quantum states (following Boltzmann and Planck). It had turned out that these methods do not…
Arieh Ben-Naim, Antonio M. Scarfone, Miguel Rubi
In 2015, I wrote a book with the same title as this article. The book’s subtitle is: “What we know and what we do not know.” On the book’s dedication page, I wrote: **“This book is dedicated to readers of popular science books who are baffled, perplexed, puzzled, astonished, confused, and discombobulated by reading…
Stephanie Wankowicz, James Fraser
During protein folding, proteins transition from a disordered polymer into a globular structure, markedly decreasing their conformational degrees of freedom and consequently leading to a substantial reduction in entropy. Nonetheless, folded proteins still retain significant entropy as they fluctuate between the…
Stephanie Wankowicz, James Fraser
During protein folding, proteins transition from a disordered polymer into a globular structure, markedly decreasing their conformational degrees of freedom and consequently leading to a substantial reduction in entropy. Nonetheless, folded proteins still retain significant entropy as they fluctuate between the…
Yoshiharu Mukouyama, Kenya Tanaka, Shuji Nakanishi, Yoshihiro Nakato
The emergence of life on Earth has attracted intense attention but remains unclear. A key problem is that the question of how living organisms can exhibit self-organizing ability that leads to highly ordered structures and active free independent behavior remains unanswered. This work reveals, by computer simulation…
Didier Lairez, Miguel Rubi
In the theory of special relativity, energy can be found in two forms: kinetic energy and rest mass. The potential energy of a body is actually stored in the form of rest mass, the interaction energy too, but temperature is not. Information acquired about a dynamical system can be potentially used to extract useful…
David P. Shorten, Richard E. Spinney, Joseph T. Lizier
Transfer entropy (TE) is a widely used measure of directed information flows in a number of domains including neuroscience. Many real-world time series in which we are interested in information flows come in the form of (near) instantaneous events occurring over time, including the spiking of biological neurons, trades…
Yoshiharu Mukouyama, Kenya Tanaka, Shuji Nakanishi, Yoshihiro Nakato
The emergence of life on Earth has attracted intense attention but remains unclear. A key problem is that the question of how living organisms can exhibit self-organizing ability that leads to highly ordered structures and active free independent behavior remains unanswered. This work reveals, by computer simulation…
Umberto Lucia, Giulia Grisolia
Causality is the relationship between causes and effects. Following Relativity, any cause of an event must always be in the past light cone of the event itself, but causes and effect must always be related to some interactions. In this paper, causality is developed as a consequence of the analysis of the Einstein…
Umberto Lucia, Giulia Grisolia
Causality is the relationship between causes and effects. Following Relativity, any cause of an event must always be in the past light cone of the event itself, but causes and effect must always be related to some interactions. In this paper, causality is developed as a consequence of the analysis of the Einstein…