20 papers · ranked by Valyu relevance
Ali Akhavi, Eda Cesaratto, Frédéric Paccaut, Pablo Rotondo + 1 more
'Brigitte Vallée'] Abstract. A probabilistic source is defined as the set of infinite words (over a given denumerable alphabet) endowed with a probability µ. The paper deals with general binary sources where the distribution of any symbol (0 or 1) may depend on an unbounded part of the previous history. The paper…
Artemy Kolchinsky, Daniel Chicharro
The partial information decomposition (PID) aims to quantify the amount of redundant information that a set of sources provides about a target. Here, we show that this goal can be formulated as a type of information bottleneck (IB) problem, termed the “redundancy bottleneck” (RB). The RB formalizes a tradeoff between…
Tobias Mages, Christian Rohner, Daniel Chicharro
The idea of a partial information decomposition (PID) gained significant attention for attributing the components of mutual information from multiple variables about a target to being unique, redundant/shared or synergetic. Since the original measure for this analysis was criticized, several alternatives have been…
T. B. Littenberg, Ananthu K. Lali
Some electromagnetically observed ultra-compact binaries will be strong gravitational wave sources for space-based detectors like the Laser Interferometer Space Antenna (LISA). These sources have historically been referred to as "verification binaries" under the assumption that they will be exploited to assess mission…
András Telcs, Raúl Alcaraz
We develop a finite-resolution empirical framework for applying nonnegative Mages-Anastasiadi-Rohner partial information decomposition (MAR-PID) to continuous and non-binary discrete variables. The variables are represented by recursive quantile binarization. This provides a balanced binary-tree representation at each…
Keiji Ota, Anthony Ciston, Patrick Haggard, Thibault Gajdos Preuss + 1 more
A key challenge in today’s fast-paced digital world is to integrate information from various sources, which differ in their reliability. Yet, little is known about how explicit probabilistic information about the likelihood that a source provides correct information is used in decision-making. Here, we investigated how…
Elsa Dupraz, Ismaila Salihou Adamou, Reza Asvadi, Tad Matsumoto
Testing Authors: ['Elsa Dupraz' 'Ismaila Salihou Adamou' 'Reza Asvadi' 'Tad Matsumoto'] Abstract—This paper investigates practical coding schemes for Distributed Hypothesis Testing (DHT). While the literature has extensively analyzed the information-theoretic performance of DHT and established bounds on Type-II error…
Authors not listed
In this work, we present EquiNet, a neural network for predicting vapor–liquid equilibrium (VLE) in novel binary mixtures through direct estimation of activity coefficients and vapor pressures. The model embeds a classic excess-Gibbs free energy formulation, ensuring Gibbs–Duhem consistency on all predicted activity…
Henry Pinkard, Laura Waller
Though originally developed for communications engineering, information theory contains mathematical tools with numerous applications in science and engineering. These tools can be used to characterize the fundamental limits of data compression and transmission in the presence of noise. Here, we present a practical…
Jianfeng Xu
To formulate an universal framework of information theory is beneficial. This study proves that the sextuple model of the objective information theory (OIT) is a sufficient and necessary condition for discussing information with four basic postulations. It is demonstrated for each metric defined in the OIT, there is a…
Pradeep Kr. Banerjee, Daniel Chicharro
The problem of constructing information measures with a well-defined interpretation is of fundamental significance in information theory. A good definition of an information measure entails certain desirable properties while also providing answers to operational problems. In this work, we investigate the properties of…
Simon Boothroyd, Owen Madin, David Mobley, Lee-Ping Wang + 2 more
Developing a sufficiently accurate classical force field representation of molecules is key to realizing the full potential of molecular simulation as a route to gaining fundamental insight into a broad spectrum of chemical and biological phenomena. This is only possible, however, if the many complex interactions…
Jia Lu, Ryan Tsoi, Nan Luo, Yuanchi Ha + 8 more
Dynamical systems often generate distinct outputs according to different initial conditions, and one can infer the corresponding input configuration given an output. This property captures the essence of information encoding and decoding. Here, we demonstrate the use of self-organized patterns, combined with machine…
R. Craig Herndon
The Oxford Computer Science Dictionary contains a general and a technical definition of information [1]. Generally, information is whatever can cause a human mind to change its opinion about the current state of the real world. Technically, information is whatever contributes to a reduction in the uncertainty of the…
Grenville J. Croll, Boris Ryabko
The distribution of prime numbers has long been viewed as a balance between order and randomness. In this work, we investigate the relationship between entropy, periodicity, and primality through the computational framework of the binary derivative. We prove that periodic numbers are composite in all bases except for a…
Jiakun Liu, Shuo Shao, Wenyi Zhang, H. Vincent Poor
A new source model, which consists of an intrinsic state part and an extrinsic observation part, is proposed and its information-theoretic characterization, namely its rate-distortion function, is defined and analyzed. Such a source model is motivated by the recent surge of interest in the semantic aspect of…
Authors not listed
Solubility is a crucial property of each organic compound, impacting its potential applications in synthetic chemistry, materials science and drug design. Moreover, in technological processes mixtures of solvents are often utilized, making the solubility assessment more complicated. Predicting solubility values in…
Denız Gündüz, Zhijin Qin, Iñaki Estella Aguerri, Harpreet S. Dhillon + 4 more
'Zhaohui Yang' 'Aylin Yener' 'Kai‐Kit Wong' 'Chan‐Byoung Chae'] Abstract—Communication systems to date primarily aim at reliably communicating bit sequences. Such an approach provides efficient engineering designs that are agnostic to the meanings of the messages or to the goal that the message exchange aims to…
Nina M. van Mastrigt, Katinka van der Kooij, Jeroen B. J. Smeets
Human movement is inevitably variable. This variability can be seen as a constraint to overcome, but it may also be a feature: being variable may result in the discovery of better movement solutions. Especially when feedback is limited to binary information on movement success or failure, variability is key for…
Tobias Mages, Elli Anastasiadi, Christian Rohner, Daniel Chicharro
Partial information decompositions (PIDs) aim to categorize how a set of source variables provides information about a target variable redundantly, uniquely, or synergetically. The original proposal for such an analysis used a lattice-based approach and gained significant attention. However, finding a suitable…