15 papers · ranked by Valyu relevance
Preetum Nakkiran
For a given distribution, learning algorithm, and performance metric, the rate of convergence (or datascaling law) is the asymptotic behavior of the algorithm's test performance as a function of number of train samples. Many learning methods in both theory and practice have power-law rates, i.e. performance scales as n…
Siyuan Guo, Bernhard Schölkopf
We study the problem of building an efficient learning system. Efficient learning processes information in the least time, i.e., building a system that reaches a desired error threshold with the least number of observations. Building upon least action principles from physics, we derive classic learning algorithms…
Jagdeep Singh Bhatia
This work describes simple and efficient algorithms for interactively learning non-binary concepts in the learning from random counter-examples (LRC) model. Here, learning takes place from random counter-examples that the learner receives in response to their proper equivalence queries. In this context, the learning…
Felix Petersen
Classic algorithms and machine learning systems like neural networks are both abundant in everyday life. While classic computer science algorithms are suitable for precise execution of exactly dened tasks such as nding the shortest path in a large graph, neural networks allow learning from data to predict the most…
Daniel Tanneberg, Elmar Rueckert, Jan Peters
A key feature of intelligent behaviour is the ability to learn abstract strategies that scale and transfer to unfamiliar problems. An abstract strategy solves every sample from a problem class, no matter its representation or complexity – like algorithms in computer science. Neural networks are powerful models for…
Ilir Çapuni, Veljko Milutinović
This is a mini survey of ten specific algorithms for optimization and learning, combined with an analysis of their suitability for dataflow implementations in future supercomputers on a chip, as described in [1], and their suitability for GaAs technology, which is also an option for future supercomputers on a chip.
Chuyu Xiong
In [1], we introduced mechanical learning and proposed 2 approaches to mechanical learning. Here, we follow one such approach to well describe the objects and the processes of learning. We discuss 2 kinds of patterns: objective and subjective pattern. Subjective pattern is crucial for learning machine. We prove that…
Petar Veličković, Charles Blundell
Algorithms have been fundamental to recent global technological advances and, in particular, they have been the cornerstone of technical advances in one field rapidly being applied to another. We argue that algorithms possess fundamentally different qualities to deep learning methods, and this strongly suggests that…
Amir Ramezani Dooraki
Artificial intelligence recently had a great advancements caused by the emergence of new processing power and machine learning methods. Having said that, the learning capability of artificial intelligence is still at its infancy comparing to the learning capability of human and many animals. Many of the current…
George Leu, Jiangjun Tang
Machine education is an emerging research field that focuses on the problem which is inverse to machine learning. To date, the literature on educating machines is still in its infancy. A fairly low number of methodology and method papers are scattered throughout various formal and informal publication avenues, mainly…
Niklas Kühl, Marc Goutier, Lucas Baier, Clemens Wolff + 1 more
'Dominik Martin'] The capabilities of supervised machine learning (SML), especially compared to human abilities, are being discussed in scientific research and in the usage of SML. This study provides an answer to how learning performance differs between humans and machines when there is limited training data. We have…
Jinsook Kim, Jinho Kang
We critically review three major theories of machine learning and provide a new theory according to which machines learn a function when the machines successfully compute it. We show that this theory challenges common assumptions in the statistical and the computational learning theories, for it implies that learning…
Sairaam Venkatraman, S. Balasubramanian, R Raghunatha Sarma
The problem of attempting to learn the mapping between data and labels is the crux of any machine learning task. It is, therefore, of interest to the machine learning community on practical as well as theoretical counts to consider the existence of a test or criterion for deciding the feasibility of attempting to…
Yuxin Chen, Adish Singla, Oisin Mac Aodha, Pietro Perona + 1 more
'Yisong Yue'] In real-world applications of education, an effective teacher adaptively chooses the next example to teach based on the learner's current state. However, most existing work in algorithmic machine teaching focuses on the batch setting, where adaptivity plays no role. In this paper, we study the case of…
Ahmad Hammoudeh, Sara Tedmori, Nadim Obeid
Although learning from data is effective and has achieved significant milestones, it has many challenges and limitations. Learning from data starts from observations and then proceeds to broader generalizations. This framework is controversial in science, yet it has achieved remarkable engineering successes. This paper…