23 papers · ranked by Valyu relevance
Flamich, Gergely
This thesis is the result of my own work and includes nothing which is the outcome of work done in collaboration except as declared in the preface and specified in the text. It is not substantially the same as any work that has already been submitted, or, is being concurrently submitted, for any degree, diploma or…
Yibiao Rong, Xia Zhang, Jianyu Lin, Amelia Carolina Sparavigna
In our previous work, by combining the Hilbert scan with the symbol grouping method, efficient run-length-based entropy coding was developed, and high-efficiency image compression algorithms based on the entropy coding were obtained. However, the 2-D Hilbert curves, which are a critical part of the above-mentioned…
Henry Pinkard, Laura Waller
Though originally developed for communications engineering, information theory contains mathematical tools with numerous applications in science and engineering. These tools can be used to characterize the fundamental limits of data compression and transmission in the presence of noise. Here, we present a practical…
Byron H. Price, Jeffrey P. Gavornik
While it is universally accepted that the brain makes predictions, there is little agreement about how this is accomplished and under which conditions. Accurate prediction requires neural circuits to learn and store spatiotemporal patterns observed in the natural environment, but it is not obvious how such information…
Sriram Vajapeyam
Conceptually, information can be thought of as being stored in or transmitted as variables that can take on different values. A variable can be thought of as a unit of storage that can take on, at different times, one of several different specified values, following some process for taking on those values. Informally…
Yasir Iqbal, Oh-Jin Kwon, Roman Starosolski
The JPEG format, consisting of a set of image compression techniques, is one of the most commonly used image coding standards for both lossy and lossless image encoding. In this format, various techniques are used to improve image transmission and storage. In the final step of lossy image coding, JPEG uses either…
Aida Koch, Alix Petit
In this article, we will analyze in detail the coding limit of an individual sequence by introducing the latest developments brought by the Set Shaping Theory. This new theory made us realize that there is a huge difference between source entropy and zero order empirical entropy. Understanding the differences between…
Mickael Zbili, Sylvain Rama
Calculations of entropy of a signal or mutual information between two variables are valuable analytical tools in the field of neuroscience. They can be applied to all types of data, capture non-linear interactions and are model independent. Yet the limited size and number of recordings one can collect in a series of…
Gangtao Xin, Pingyi Fan, Khaled B. Letaief, Amelia Carolina Sparavigna
'Amelia Carolina Sparavigna'] This paper focuses on the ultimate limit theory of image compression. It proves that for an image source, there exists a coding method with shapes that can achieve the entropy rate under a certain condition where the shape-pixel ratio in the encoder/decoder is $O((1/logt))$. Based on the…
Mickael Zbili, Sylvain Rama
Calculations of entropy of a signal or mutual information between two variables are valuable analytical tools in the field of neuroscience. They can be applied to all types of data, capture nonlinear interactions and are model independent. Yet the limited size and number of recordings one can collect in a series of…
James V. Stone
Shannon's mathematical theory of communication defines fundamental limits on how much information can be transmitted between the different components of any man-made or biological system. This paper is an informal but rigorous introduction to the main ideas implicit in Shannon's theory. An annotated reading list is…
Karthi Balasubramanian, Gayathri R Prabhu, V. K. Lakshmipriya, Maneesha Krishnan + 2 more
'Maneesha Krishnan' 'R. Praveena' 'Nithin Nagaraj'] Data compression algorithms are generally perceived as being of interest for data communication and storage purposes only. However, their use in the field of data classification and analysis is also of equal importance. Automatic data classification and analysis finds…
Kieran G. Larkin
It is not obvious how to extend Shannon's original information entropy to higher dimensions, and many different approaches have been tried. We replace the English text symbol sequence originally used to illustrate the theory by a discrete, bandlimited signal. Using Shannon's later theory of sampling we derive a new and…
Andrzej Chmielowiec, Paweł Litwin, Philip Broadbridge, Raúl Alcaraz
This article deals with compression of binary sequences with a given number of ones, which can also be considered as a list of indexes of a given length. The first part of the article shows that the entropy H of random n-element binary sequences with exactly k elements equal one satisfies the inequalities…
Stephanie Wankowicz, James Fraser
During protein folding, proteins transition from a disordered polymer into a globular structure, markedly decreasing their conformational degrees of freedom and consequently leading to a substantial reduction in entropy. Nonetheless, folded proteins still retain significant entropy as they fluctuate between the…
Stephanie Wankowicz, James Fraser
During protein folding, proteins transition from a disordered polymer into a globular structure, markedly decreasing their conformational degrees of freedom and consequently leading to a substantial reduction in entropy. Nonetheless, folded proteins still retain significant entropy as they fluctuate between the…
Authors not listed
Gibbs’ paradox—the apparent discontinuity in mixing entropy for gases of varying similarity and the seeming reversibility of mixing-separation cycles—has resisted fully satisfactory resolution for 150 years. We present a solution based on categorical state theory, which posits that physical con f igurations are…
Ian Holmes
We describe a strategy for constructing codes for DNA-based information storage by serial composition of weighted finite-state transducers. The resulting state machines can integrate correction of substitution errors; synchronization by interleaving watermark and periodic marker signals; conversion from binary to…
Rodrick Wallace
The living state is cognitive at every scale and level of organization. Since it is possible to associate a broad class of cognitive processes with ‘dual’ information sources, many pathologies can be addressed using statistical models based on the Shannon Coding, the Shannon-McMillan Source Coding, the Rate Distortion…
Mohsen Farshad
The energy and entropy, expressed in free energy, determine the behavior of a system. Therefore, infinite knowledge of these two quantities leads to precise prediction of the system's trajectories. Here, we study how the energy and entropy affect the distribution of a two-component system in a box. First, using a…
Mohsen Farshad
Providing a simple description of entropy as the foundation of thermodynamics is necessary for researchers in explaining physical phenomena in the universe. Here we dive deep into the meaning of entropy starting from the basics and ending with the Newton's second law of motion which may be rooted in a hidden dimension…
Azat Akhmetov, Andrew D. Ellington, Edward M. Marcotte
Encoding arbitrary digital information in DNA has attracted attention as a potential avenue for large scale and long term data storage. However, in order to enable DNA data storage technologies there needs to be improvements in data storage fidelity (tolerance to mutation), the facility of writing and reading the data…
Jia Lu, Ryan Tsoi, Nan Luo, Yuanchi Ha + 8 more
Dynamical systems often generate distinct outputs according to different initial conditions, and one can infer the corresponding input configuration given an output. This property captures the essence of information encoding and decoding. Here, we demonstrate the use of self-organized patterns, combined with machine…