14 papers · ranked by Valyu relevance
Niklas Gassner, Julia Lieb, Abhinaba Mazumder, Michael Schaller
In this paper, we present a framework for generic decoding of convolutional codes, which allows us to do cryptanalysis of code-based systems that use convolutional codes as public keys. We then apply this framework to information set decoding, study success probabilities and give tools to choose variables. Finally, we…
Sarah Anhala Cepeda-Humerez, Jakob Ruess, Gašper Tkačik, Alexandre V. Morozov
'Alexandre V. Morozov'] Across diverse biological systems-ranging from neural networks to intracellular signaling and genetic regulatory networks-the information about changes in the environment is frequently encoded in the full temporal dynamics of the network nodes. A pressing data-analysis challenge has thus been to…
Saurabh Bhardwaj, Yizhi Wang, Guoqiang Yu, Yue Wang
Deep learning models have been widely used in many supervised learning applications. However, these models suffer from overfitting due to various types of uncertainty with deteriorating performance when facing data biases, class imbalance, or noise propagation. The Information-Set Deep learning (ISDL) architectures…
David Kracht, Steffen Schober
Background Barcode multiplexing is a key strategy for sharing the rising capacity of next-generation sequencing devices: Synthetic DNA tags, called barcodes, are attached to natural DNA fragments within the library preparation procedure. Different libraries, can individually be labeled with barcodes for a joint…
Jan Lewandowsky, Gerhard Bauch, Maximilian Stark, Jerry D. Gibson
Digital communication receivers extract information about the transmitted data from the received signal in subsequent processing steps, such as synchronization, demodulation and channel decoding. Technically, the receiver-side signal processing for conducting these tasks is complex and hence causes bottleneck…
Artemy Kolchinsky, Eckehard Olbrich
We consider the “partial information decomposition” (PID) problem, which aims to decompose the information that a set of source random variables provide about a target random variable into separate redundant, synergistic, union, and unique components. In the first part of this paper, we propose a general framework for…
Edgar Beck, Carsten Bockelmann, Armin Dekorsy, Changchuan Yin
Motivated by the recent success of Machine Learning (ML) tools in wireless communications, the idea of semantic communication by Weaver from 1949 has gained attention. It breaks with Shannon’s classic design paradigm by aiming to transmit the meaning of a message, i.e., semantics, rather than its exact version and…
Guillaume Frèche, Matthieu R. Bloch, Michel Barret
This paper introduces an explicit covert communication code for binary-input asynchronous discrete memoryless channels based on binary polar codes, in which legitimate parties exploit uncertainty created by both the channel noise and the time of transmission to avoid detection by an adversary. The proposed code jointly…
Dor Tsur, Haim Permuter, Kichun Lee
Despite the widespread use of information measures in analyzing probabilistic systems, effective visualization tools for understanding complex dependencies in sequential data are scarce. In this work, we introduce the information matrix (InfoMat), a novel and intuitive matrix representation of information transfer in…
Conor Finn, Joseph T. Lizier
What are the distinct ways in which a set of predictor variables can provide information about a target variable? When does a variable provide unique information, when do variables share redundant information, and when do variables combine synergistically to provide complementary information? The redundancy lattice…
Pierre Baudot, Monica Tapia, Daniel Bennequin, Jean-Marc Goaillard
This paper presents methods that quantify the structure of statistical interactions within a given data set, and were applied in a previous article. It establishes new results on the k-multivariate mutual-information ( $I_{k}$) inspired by the topological formulation of Information introduced in a serie of studies. In…
Michail Gkagkos, Charalambos D. Charalambous, Eduard Jorswieck
The main focus of this paper is the derivation of the structural properties of the test channels of Wyner’s operational information rate distortion function (RDF), $R¯(Δ_{X})$, for arbitrary abstract sources and, subsequently, the derivation of additional properties for a tuple of multivariate correlated, jointly…
Nicholas M. Timme, Christopher Lapish
Understanding how neural systems integrate, encode, and compute information is central to understanding brain function. Frequently, data from neuroscience experiments are multivariate, the interactions between the variables are nonlinear, and the landscape of hypothesized or possible interactions between variables is…
Tobias Mages, Christian Rohner, Daniel Chicharro
The idea of a partial information decomposition (PID) gained significant attention for attributing the components of mutual information from multiple variables about a target to being unique, redundant/shared or synergetic. Since the original measure for this analysis was criticized, several alternatives have been…