27 papers · ranked by Valyu relevance
Daniela Kalwarowskyj, Erich Schikuta
This paper describes the design and implementation of parallel neural networks (PNNs) with the novel programming language Golang. We follow in our approach the classical Single-Program Multiple-Data (SPMD) model where a PNN is composed of several sequential neural networks, which are trained with a proportional share…
Ludvig Ericson, Rendani Mbuvha
—Artificial Neural Networks (ANNs) have received increasing attention in recent years with applications that span a wide range of disciplines including vital domains such as medicine, network security and autonomous transportation. However, neural network architectures are becoming increasingly complex and with an…
Yang Liu, Jie Yang, Yuan Huang, Lixiong Xu + 2 more
Artificial neural networks (ANNs) have been widely used in pattern recognition and classification applications. However, ANNs are notably slow in computation especially when the size of data is large. Nowadays, big data has received a momentum from both industry and academia. To fulfill the potentials of ANNs for big…
Yuru Song, Marcus K. Benna
Cortical neurons often establish multiple synaptic contacts with the same postsynaptic neuron. To avoid functional redundancy of these parallel synapses, it is crucial that each synapse exhibits distinct computational properties. Here we model the current to the soma contributed by each synapse as a sigmoidal…
Guang Ping He
We find experimentally that when artificial neural networks are connected in parallel and trained together, they display the following properties. (i) When the parallel-connected neural network (PNN) is optimized, each sub-network in the connection is not optimized. (ii) The contribution of an inferior sub-network to…
Jaipriya D., Sriharipriya K. C., Saeed Mian Qaisar
In recent years, the utilization of motor imagery (MI) signals derived from electroencephalography (EEG) has shown promising applications in controlling various devices such as wheelchairs, assistive technologies, and driverless vehicles. However, decoding EEG signals poses significant challenges due to their…
Yuru Song, Marcus K. Benna
Cortical neurons often establish multiple synaptic contacts with the same postsynaptic neuron. To avoid functional redundancy of these parallel synapses, it is crucial that each synapse exhibits distinct computational properties. Here we model the current to the soma contributed by each synapse as a sigmoidal…
Yuru Song, Marcus K. Benna, Jonathan David Touboul
Cortical neurons often establish multiple synaptic contacts with the same postsynaptic neuron. To avoid functional redundancy of these parallel synapses, it is crucial that each synapse exhibits distinct computational properties. Here we model the current to the soma contributed by each synapse as a sigmoidal…
Junyao Ling
This paper introduces the basic concepts and main characteristics of parallel self-organizing networks and analyzes and predicts parallel self-organizing networks through neural networks and their hybrid models. First, we train and describe the law and development trend of the parallel self-organizing network through…
Milan Curcic
This paper describes neural-fortran, a parallel Fortran framework for neural networks and deep learning. It features a simple interface to construct feed-forward neural networks of arbitrary structure and size, several activation functions, and stochastic gradient descent as the default optimization algorithm.…
Jianfang Cao, Hongyan Cui, Hao Shi, Lijuan Jiao + 1 more
A back-propagation (BP) neural network can solve complicated random nonlinear mapping problems; therefore, it can be applied to a wide range of problems. However, as the sample size increases, the time required to train BP neural networks becomes lengthy. Moreover, the classification accuracy decreases as well. To…
Elena Agliari, Andrea Alessandrelli, Adriano Barra, Federico Ricci‐Tersenghi
'Federico Ricci‐Tersenghi'] Abstract: A modern challenge of Artificial Intelligence is learning multiple patterns at once (i.e. parallel learning). While this can not be accomplished by standard Hebbian associative neural networks, in this paper we show how the Multitasking Hebbian Network (a variation on theme of the…
Salem Alqahtani, Murat Demirbaş
—Deep learning has permeated through many aspects of computing/processing systems in recent years. While distributed training architectures/frameworks are adopted for training large deep learning models quickly, there has not been a systematic study of the communication bottlenecks of these architectures and their…
Antônio H. Ribeiro, Luís A. Aguirre
Neural network models for dynamic systems can be trained either in parallel or in series-parallel configurations. Influenced by early arguments, several papers justify the choice of series-parallel rather than parallel configuration claiming it has a lower computational cost, better stability properties during training…
Matteo De Matola, Giorgio Arcara
Convolutional neural networks (CNNs) are a class of artificial neural networks (ANNs). Since the early 2010s, they have been widely adopted as models of primate vision and classifiers of neuroimaging data, becoming relevant for a wealth of neuroscientific fields. However, the majority of neuroscience researchers come…
Yuma Osako, Aineias Arango, Toshitake Asabuki
Animals flexibly combine learned behaviors into novel actions without practicing their combinations, yet the computational mechanisms that enable independently acquired computations to be expressed in parallel remain unclear. Here we show that feedback geometry during learning determines whether recurrent dynamics can…
Santiago Galella, Salva Ardid
Our brain can filter and integrate external information with internal representations to accomplish goal-directed behavior. The ability to switch between tasks effectively in response to context and external stimuli is a hallmark of cognitive control. Task switching occurs rapidly and efficiently, allowing us to…
Alexis M. Dubreuil
A functional role of the cerebral cortex is to form and hold representations of the sensory world for behavioral purposes. This is achieved by a sheet of neurons, organized in modules called cortical columns, that receives inputs in a peculiar manner, with only a few neurons driven by sensory inputs through thalamic…
Nathan Frey, Ryan Soklaski, Simon Axelrod, Siddharth Samsi + 3 more
Massive scale, both in terms of data availability and computation, enables significant breakthroughs in key application areas of deep learning such as natural language processing (NLP) and computer vision. There is emerging evidence that scale may be a key ingredient in scientific deep learning, but the importance of…
Zachary Humphreys, Xenophon Evangelopoulos, Stavros Gerolymatos, Edward O. Pyzer-Knapp + 1 more
Graph neural networks have recently met huge success in various inference tasks including materials property prediction amongst many others. Nevertheless, having an inherently locally-based representation capacity as they do, global representation of materials' structures can only only be achieved by expanding the…
Authors not listed
Electrospray ionization (ESI) mass spectrometry is an essential technique for chemical analysis in a range of fields. In ESI, analytes can produce multiple charge states, which must be correctly assigned for identification. Existing approaches to charge state assignment can suffer from limited accuracy and/or poor…
G. Kandemir, D. H. Duncan, D. van Moorselaar, J. Theeuwes
For almost half a century, target-distractor similarity has been known to induce different visual search modes. When a target is highly salient, it can pop out, suggesting parallel processing of all items irrespective of set size. By contrast, high similarity among items requires item-by-item comparison with an…
Authors not listed
As a prove of concept for experimental geochemistry, an advanced 3D numerical framework, here and after called Digital Twin (DT), of a diffusion experiment conducted at a synchrotron beamline, has been implemented using in-situ measurements data, physics-based modelling, a machine learning (ML) model, and parameter…
Hongyang Dong, Simon D.M. Jacques, Keith T. Butler, Olof Gutowski + 4 more
In this study, we introduce a method designed to eliminate parallax artefacts present in Xray powder diffraction computed tomography data acquired from large samples. These parallax artefacts manifest as artificial peak shifting, broadening and splitting, leading to inaccurate physicochemical information, such as…
Sanjar Adilov
Generative neural networks have shown promising results in de novo drug design. Recent studies suggest that one of the efficient ways to produce novel molecules matching target properties is to model SMILES sequences using deep learning in a way similar to language modeling in natural language processing. In this…
James Swift, Matthew Arran Turner, James Christopher Reynolds
A rapid headspace analysis method for the authenticity testing of whiskies of different brands and years was developed for a low cost, deployable atmospheric pressure ionisation mass spectrometer, which required minimal sample preparation. Principal component analysis was applied to the time-averaged mass spectra, the…
Aleksandr Fedorov, Anna Perechodjuk, David Linke
Artificial neural networks (ANNs) are powerful tools for solving a wide range of tasks in fundamental and applied science. However, training and building reliable ANN models requires a lot of data which so far hinders their wider application in kinetic modelling where typically only small (experimental) datasets are…