25 papers · ranked by Valyu relevance
Mario Mastriani
— A new binary (bit-level) lossless compression catalyst method based on a modular arithmetic, called Binary Allocation via Modular Arithmetic (BAMA), has been introduced in this paper. In other words, BAMA is for storage and transmission of binary sequences, digital signal, images and video, also streaming and all…
Changqing Zhao, Ling Xia Liao, Guomin Chen, Han-Chieh Chao + 2 more
'Javier Prieto' 'Mehmet Rasit Yuce'] The accurate and efficient classification of network traffic, including malicious traffic, is essential for effective network management, cybersecurity, and resource optimization. However, traffic classification methods in modern, complex, and dynamic networks face significant…
Gabriel Signoretti, Marianne Silva, Pedro Andrade, Ivanovitch Silva + 6 more
'Emiliano Sisinni' 'Paolo Ferrari' 'Eyhab Al-Masri' 'Chi-Hua Chen' 'Alireza Souri' 'Olivera Kotevska'] Currently, the applications of the Internet of Things (IoT) generate a large amount of sensor data at a very high pace, making it a challenge to collect and store the data. This scenario brings about the need for…
Sebastian Deorowicz, Szymon Grabowski
Post-Sanger sequencing methods produce tons of data, and there is a general agreement that the challenge to store and process them must be addressed with data compression. In this review we first answer the question “why compression” in a quantitative manner. Then we also answer the questions “what” and “how”, by…
M Baritha Begum, N. Deepa, Mueen Uddin, Rajesh Kaluri + 2 more
'Maha Abdelhaq' 'Raed Alsaqour'] Data stored on physical storage devices and transmitted over communication channels often have a lot of redundant information, which can be reduced through compression techniques to conserve space and reduce the time it takes to transmit the data. The need for adequate security…
Anas Al-okaily, Abdelghani Tbakhi
Data compression is a challenging and increasingly important problem. As the amount of data generated daily continues to increase, efficient transmission and storage has never been more critical. In this study, a novel encoding algorithm is proposed, motivated by the compression of DNA data and associated…
Senik Matinyan, Jan Pieter Abrahams
High-throughput data collection in crystallography poses significant challenges in handling massive amounts of data. Here, we present TERSE, a novel lossless compression algorithm specifically designed for diffraction data. We compare TERSE with the established lossless compression algorithms implemented in gzip, CBF…
Milan Klöwer, Miha Razinger, Juan J. Dominguez, Peter D. Düben + 1 more
'Tim N. Palmer'] Hundreds of petabytes are produced annually at weather and climate forecast centers worldwide. Compression is essential to reduce storage and to facilitate data sharing. Current techniques do not distinguish the real from the false information in data, leaving the level of meaningful precision…
Jiujing Zhang, Zhitao Shen, Shiyu Yang, Lingkai Meng + 6 more
'Jia Wang' 'Yue Li' 'Qinhui Sun' 'Wenjie Zhang' 'Xuemin Lin'] JIUJING ZHANG∗ , Guangzhou University & University of New South Wales, China & Australia ZHITAO SHEN, Ant Group, China SHIYU YANG† , Guangzhou University, China LINGKAI MENG, Ant Group & Antai College of Economics and Management, Shanghai Jiao Tong…
Runzhao Yang, Tingxiong Xiao, Yuxiao Cheng, Anan Li + 7 more
Efficient storage and sharing of massive biomedical data would open up their wide accessibility to different institutions and disciplines. However, compressors tailored for natural photos/videos are rapidly limited for biomedical data, while emerging deep learning based methods demand huge training data and are…
Rajneil Baruah, Vaskar Deka, M. P. Bhuyan
With the rapid growing of data and number of applications, there is a crucial need of dictionary based reversible transformation techniques to increase the efficiency of the compression algorithms and hence contribute towards the enhancement in compression ratio. Performance analysis of compression methods in…
Alice Tor, Yuxin Wu, Stephen E Clarke, Lisa Yamada + 2 more
The complexity of neural data changes as the brain processes information during events. Universal lossless compression algorithms, which are broadly applicable and grounded in information theory, identify and exploit redundancies in data in order to compress it to essentially-optimal sizes regardless of underlying…
Juncai Xu, Weidong Zhang, Qingwen Ren, Xin Xie + 1 more
There is a special type of text which the order of the rows makes no difference (e.g., a word list). To compress these special texts, the traditional lossless compression method is not the ideal choice. A new method that can achieve better compression results for this type of texts is proposed. The texts are…
Yang Han, Guangjun Qin, Yongqing Hu
In data storage and transmission, file compression is a common technique for reducing the volume of data, reducing data storage space and transmission time and bandwidth. However, there are significant differences in the compression performance of different types of file formats, and the benefits vary. In this paper…
Muhammad Usama, Nordin Zakaria, Houbing Song
Data compression and encryption are key components of commonly deployed platforms such as Hadoop. Numerous data compression and encryption tools are presently available on such platforms and the tools are characteristically applied in sequence, i.e., compression followed by encryption or encryption followed by…
Miaoshan Lu, Junjie Tong, Ruimin Wang, Shaowei An + 2 more
Mass spectrum (MS) data volumes increase with an improved ion acquisition ratio and a highly accurate mass spectrometer. However, the most widely used data format, mzML, does not take advantage of compression methods and improved read performances. Several compression algorithms have been proposed in recent years, and…
Mohammad Hosseini
—Today, with the growing demands of information storage and data transfer, data compression is becoming increasingly important. Data Compression is a technique which is used to decrease the size of data. This is very useful when some huge files have to be transferred over networks or being stored on a data storage…
Sebastian Deorowicz, Joanna Walczyszyn, Agnieszka Debudaj-Grabysz
Bioinformatics databases grow rapidly and achieve values hardly to imagine a decade ago. Among numerous bioinformatics processes generating hundreds of GB is multiple sequence alignments of protein families. Its largest database, i.e., Pfam, consumes 40–230 GB, depending of the variant. Storage and transfer of such…
Jaime Salvador–Meneses, Zoila Ruiz–Chavez, Jose Garcia–Rodriguez
The kNN (k-nearest neighbors) classification algorithm is one of the most widely used non-parametric classification methods, however it is limited due to memory consumption related to the size of the dataset, which makes them impractical to apply to large volumes of data. Variations of this method have been proposed…
Gaurav Vijayvargiya, Sanjay Silakari, Rajeev Pandey
—This paper addresses about various image compression techniques. On the basis of analyzing the various image compression techniques this paper presents a survey of existing research papers. In this paper we analyze different types of existing method of image compression. Compression of an image is significantly…
Daniel Probst
Last year, a preprint gained notoriety, proposing that a k-nearest neighbour classifier is able to outperform large-language models using compressed text as input and normalised compression distance (NCD) as a metric. In chemistry and biochemistry, molecules are often represented as strings, such as SMILES for small…
Jan Weinreich, Daniel Probst
In recent years, natural language processing approaches to machine learning, most prominently deep neural network-based transformers, have been extensively applied to molecular classification and regression tasks, including the prediction of pharmacokinetic and quantum-chemical properties. However, models based on deep…
Anders Andreasen, Maria Bonto, Fernando Montero
– This paper presents a framework for optimisation and techno-economic analysis of various pressurisation pathways for CO2 pipeline transportation. The pressurisation pathways include a conventional compression only case from initial to final pressure, a sub-critical compression part followed by cooling, liquefaction…
Authors not listed
Cost effective and reliable hydrogen compression remains a challenging barrier in the wide-spread adoption of hydrogen as an energy carrier. The prevailing technology of mechanical compression suffers from several drawbacks, some of which can be addressed by non-mechanical compression strategies (e.g., electrochemical…
Felix Zeller, Chieh-Min Hsieh, Wilke Dononelli, Tim Neudecker
The field of liquid-phase and solid-state high-pressure chemistry has exploded since the advent of the diamond anvil cell, an experimental technique that allows the application of pressures up to several hundred gigapascal. To complement high-pressure experiments, a large number of computational tools have been…