21 papers · ranked by Valyu relevance
Ali Akhavi, Eda Cesaratto, Frédéric Paccaut, Pablo Rotondo + 1 more
'Brigitte Vallée'] Abstract. A probabilistic source is defined as the set of infinite words (over a given denumerable alphabet) endowed with a probability µ. The paper deals with general binary sources where the distribution of any symbol (0 or 1) may depend on an unbounded part of the previous history. The paper…
Marco Martalo', R. Raheli
— This paper discusses and analyzes various models of binary correlated sources, which may be relevant in several distributed communication scenarios. These models are statistically characterized in terms of joint Probability Mass Function (PMF) and covariance. Closed-form expressions for the joint entropy of the…
Agnieszka Pregowska, Janusz Szczepanski, Eligiusz Wajnryb
Background Explaining how the brain processing is so fast remains an open problem (van Hemmen JL, Sejnowski T., 2004). Thus, the analysis of neural transmission (Shannon CE, Weaver W., 1963) processes basically focuses on searching for effective encoding and decoding schemes. According to the Shannon fundamental…
Leonardo R. Gama, Guilherme Giovanini, Gábor Balázsi, Alexandre F. Ramos
The promoter state of a gene and its expression levels are modulated by the amounts of transcription factors interacting with its regulatory regions. Hence, one may interpret a gene network as a communicating system in which the state of the promoter of a gene (the source) is communicated by the amounts of…
Rui She, Shanyun Liu, Pingyi Fan
Different probabilities of events attract different attention in many scenarios such as anomaly detection and security systems. To characterize the events’ importance from a probabilistic perspective, the message importance measure (MIM) is proposed as a kind of semantics analysis tool. Similar to Shannon entropy, the…
James V. Stone
Shannon's mathematical theory of communication defines fundamental limits on how much information can be transmitted between the different components of any man-made or biological system. This paper is an informal but rigorous introduction to the main ideas implicit in Shannon's theory. An annotated reading list is…
A. J. Gutknecht, M. Wibral, A. Makkeh
Partial information decomposition (PID) seeks to decompose the multivariate mutual information that a set of source variables contains about a target variable into basic pieces, the so-called ‘atoms of information’. Each atom describes a distinct way in which the sources may contain information about the target. For…
Madhur Srivastava
The paper presents a binarization scheme that converts non-binary data into a set of binary strings. At present, there are many binarization algorithms, but they are optimal for only specific probability distributions of the data source. Overcoming the problem, it is shown in this paper that the presented binarization…
Authors not listed
In this work, we present EquiNet, a neural network for predicting vapor–liquid equilibrium (VLE) in novel binary mixtures through direct estimation of activity coefficients and vapor pressures. The model embeds a classic excess-Gibbs free energy formulation, ensuring Gibbs–Duhem consistency on all predicted activity…
Leonardo R. Gama, Guilherme Giovanini, Gábor Balázsi, Alexandre F. Ramos
The promoter state of a gene and its expression levels are modulated by the amounts of transcription factors interacting with its regulatory regions. Hence, one may interpret a gene network as a communicating system in which the state of the promoter of a gene (the source) is communicated by the amounts of…
T. Natusch
| 1. | Introduction | 1 | | --- | --- | --- | | 2. | Information theoretic basis of data compression techniques | 1 | | 3. | Data Compression | 3 | | 4. | Source Entropy | 3 | | 5. | The nature of radio sources and the output response of a receiving system | 5 | | 6. | The case of 2 bit VLBI data streams | 7 | | 7. | 8…
András Telcs, Raúl Alcaraz
We develop a finite-resolution empirical framework for applying nonnegative Mages-Anastasiadi-Rohner partial information decomposition (MAR-PID) to continuous and non-binary discrete variables. The variables are represented by recursive quantile binarization. This provides a balanced binary-tree representation at each…
Keiji Ota, Anthony Ciston, Patrick Haggard, Thibault Gajdos Preuss + 1 more
A key challenge in today’s fast-paced digital world is to integrate information from various sources, which differ in their reliability. Yet, little is known about how explicit probabilistic information about the likelihood that a source provides correct information is used in decision-making. Here, we investigated how…
Henry Pinkard, Laura Waller
Though originally developed for communications engineering, information theory contains mathematical tools with numerous applications in science and engineering. These tools can be used to characterize the fundamental limits of data compression and transmission in the presence of noise. Here, we present a practical…
R. Craig Herndon
The Oxford Computer Science Dictionary contains a general and a technical definition of information [1]. Generally, information is whatever can cause a human mind to change its opinion about the current state of the real world. Technically, information is whatever contributes to a reduction in the uncertainty of the…
Mireille Conrad, Renaud B Jolivet
Information theory has become an essential tool of modern neuroscience. It can however be difficult to apply in experimental contexts when acquisition of very large datasets is prohibitive. Here, we compare the relative performance of two information theoretic measures, mutual information and transfer entropy, for the…
Simon Boothroyd, Owen Madin, David Mobley, Lee-Ping Wang + 2 more
Developing a sufficiently accurate classical force field representation of molecules is key to realizing the full potential of molecular simulation as a route to gaining fundamental insight into a broad spectrum of chemical and biological phenomena. This is only possible, however, if the many complex interactions…
Authors not listed
Solubility is a crucial property of each organic compound, impacting its potential applications in synthetic chemistry, materials science and drug design. Moreover, in technological processes mixtures of solvents are often utilized, making the solubility assessment more complicated. Predicting solubility values in…
Keiji Ota, Anthony Ciston, Patrick Haggard, Thibault Gajdos Preuss + 1 more
A key challenge in today’s fast-paced digital world is to integrate information from various sources, which differ in their reliability. Yet, little is known about how explicit probabilistic information on the likelihood of a source to provide correct information is used in decision-making. Here, we investigated how…
Tobias Mages, Elli Anastasiadi, Christian Rohner, Daniel Chicharro
Partial information decompositions (PIDs) aim to categorize how a set of source variables provides information about a target variable redundantly, uniquely, or synergetically. The original proposal for such an analysis used a lattice-based approach and gained significant attention. However, finding a suitable…
Joseph T. Lizier, Benjamin Flecker, Paul L. Williams
—Distributed computation in artificial life and complex systems is often described in terms of component operations on information: information storage, transfer and modification. Information modification remains poorly described however, with the popularly-understood examples of glider and particle collisions in…