11 papers · ranked by Valyu relevance
Amballa, Avinash
Recent studies have demonstrated the effectiveness of position encoding in transformer architectures. By incorporating positional information, this approach provides essential guidance for modeling dependencies between elements across different sequence positions. We introduce CoPE (a lightweight Complex Positional…
P. A. Golovinski, V. A. Astapenko
Decision-making in the control of complex systems is based on the analysis of multidimensional data. These data need to recognize them and establish functional dependences. The search for effective methods to the pattern recognition is continued. An essential step in the development of the effective methods of encoding…
Sindy Löwe, Phillip Lippe, Maja Rudolph, Max Welling
Object-centric representations form the basis of human perception, and enable us to reason about the world and to systematically generalize to new settings. Currently, most works on unsupervised object discovery focus on slot-based approaches, which explicitly separate the latent representations of individual objects.…
Benyou Wang, Donghao Zhao, Christina Lioma, Qiuchi Li + 2 more
'Jakob Grue Simonsen'] Sequential word order is important when processing text. Currently, neural networks (NNs) address this by modeling word position using position embeddings. The problem is that position embeddings capture the position of individual words, but not the ordered relationship (e.g., adjacency or…
Fu Chen, Qinglin Zhao, Li Feng, Longfei Tang + 2 more
'Haitao Huang'] Abstract—Self-attention has revolutionized classical machine learning, yet existing quantum self-attention models underutilize quantum states' potential due to oversimplified or incomplete mechanisms. To address this limitation, we introduce the Quantum Complex-Valued Self-Attention Model (QCSAM), the…
Kien Nguyen, Clinton Fookes, Sridha Sridharan, Arun Ross
—In this work, we design a fully complex-valued neural network for the task of iris recognition. Unlike the problem of general object recognition, where real-valued neural networks can be used to extract pertinent features, iris recognition depends on the extraction of both phase and magnitude information from the…
Héctor Zenil, Luan Carlos de Sena Monteiro
carriers given by the Weierstrass function's components Authors: ['Héctor Zenil' 'Luan Carlos de Sena Monteiro'] In many contexts of communication, the communication capabilities of the involved actors cannot be known beforehand, whether it is a cell, a plant, an insect, or even a life form unknown to Earth. Regardless…
Johannes Ballé, Valero Laparra, Eero P. Simoncelli
We describe an image compression method, consisting of a nonlinear analysis transformation, a uniform quantizer, and a nonlinear synthesis transformation. The transforms are constructed in three successive stages of convolutional linear filters and nonlinear activation functions. Unlike most convolutional neural…
Scott Purdy
Hierarchical Temporal Memory (HTM) is a biologically inspired machine intelligence technology that mimics the architecture and processes of the neocortex. In this white paper we describe how to encode data as Sparse Distributed Representations (SDRs) for use in HTM systems. We explain several existing encoders, which…
Alaa Eldin Rohiem Shehata, Hassan Yakout El-Arsh
—Arithmetic Coding is an efficient lossless compression scheme applied for many multimedia standards such as JPEG, JPEG2000, H.263, H.264 and H.265. Due to nonlinearity, high error propagation and high error sensitivity of arithmetic coders, many techniques have been developed for extending the usage of arithmetic…
Yibo Yang, Stephan Mandt, Lucas Theis
Neural compression is the application of neural networks and other machine learning methods to data compression. Recent advances in statistical machine learning have opened up new possibilities for data compression, allowing compression algorithms to be learned end-to-end from data using powerful generative models such…