15 papers · ranked by Valyu relevance
Daniela Kalwarowskyj, Erich Schikuta
This paper describes the design and implementation of parallel neural networks (PNNs) with the novel programming language Golang. We follow in our approach the classical Single-Program Multiple-Data (SPMD) model where a PNN is composed of several sequential neural networks, which are trained with a proportional share…
Ludvig Ericson, Rendani Mbuvha
—Artificial Neural Networks (ANNs) have received increasing attention in recent years with applications that span a wide range of disciplines including vital domains such as medicine, network security and autonomous transportation. However, neural network architectures are becoming increasingly complex and with an…
Guang Ping He
We find experimentally that when artificial neural networks are connected in parallel and trained together, they display the following properties. (i) When the parallel-connected neural network (PNN) is optimized, each sub-network in the connection is not optimized. (ii) The contribution of an inferior sub-network to…
Milan Curcic
This paper describes neural-fortran, a parallel Fortran framework for neural networks and deep learning. It features a simple interface to construct feed-forward neural networks of arbitrary structure and size, several activation functions, and stochastic gradient descent as the default optimization algorithm.…
Elena Agliari, Andrea Alessandrelli, Adriano Barra, Federico Ricci‐Tersenghi
'Federico Ricci‐Tersenghi'] Abstract: A modern challenge of Artificial Intelligence is learning multiple patterns at once (i.e. parallel learning). While this can not be accomplished by standard Hebbian associative neural networks, in this paper we show how the Multitasking Hebbian Network (a variation on theme of the…
Salem Alqahtani, Murat Demirbaş
—Deep learning has permeated through many aspects of computing/processing systems in recent years. While distributed training architectures/frameworks are adopted for training large deep learning models quickly, there has not been a systematic study of the communication bottlenecks of these architectures and their…
Antônio H. Ribeiro, Luís A. Aguirre
Neural network models for dynamic systems can be trained either in parallel or in series-parallel configurations. Influenced by early arguments, several papers justify the choice of series-parallel rather than parallel configuration claiming it has a lower computational cost, better stability properties during training…
Nathan Frey, Ryan Soklaski, Simon Axelrod, Siddharth Samsi + 3 more
Massive scale, both in terms of data availability and computation, enables significant breakthroughs in key application areas of deep learning such as natural language processing (NLP) and computer vision. There is emerging evidence that scale may be a key ingredient in scientific deep learning, but the importance of…
Zachary Humphreys, Xenophon Evangelopoulos, Stavros Gerolymatos, Edward O. Pyzer-Knapp + 1 more
Graph neural networks have recently met huge success in various inference tasks including materials property prediction amongst many others. Nevertheless, having an inherently locally-based representation capacity as they do, global representation of materials' structures can only only be achieved by expanding the…
Authors not listed
Electrospray ionization (ESI) mass spectrometry is an essential technique for chemical analysis in a range of fields. In ESI, analytes can produce multiple charge states, which must be correctly assigned for identification. Existing approaches to charge state assignment can suffer from limited accuracy and/or poor…
Authors not listed
As a prove of concept for experimental geochemistry, an advanced 3D numerical framework, here and after called Digital Twin (DT), of a diffusion experiment conducted at a synchrotron beamline, has been implemented using in-situ measurements data, physics-based modelling, a machine learning (ML) model, and parameter…
Hongyang Dong, Simon D.M. Jacques, Keith T. Butler, Olof Gutowski + 4 more
In this study, we introduce a method designed to eliminate parallax artefacts present in Xray powder diffraction computed tomography data acquired from large samples. These parallax artefacts manifest as artificial peak shifting, broadening and splitting, leading to inaccurate physicochemical information, such as…
Sanjar Adilov
Generative neural networks have shown promising results in de novo drug design. Recent studies suggest that one of the efficient ways to produce novel molecules matching target properties is to model SMILES sequences using deep learning in a way similar to language modeling in natural language processing. In this…
James Swift, Matthew Arran Turner, James Christopher Reynolds
A rapid headspace analysis method for the authenticity testing of whiskies of different brands and years was developed for a low cost, deployable atmospheric pressure ionisation mass spectrometer, which required minimal sample preparation. Principal component analysis was applied to the time-averaged mass spectra, the…
Aleksandr Fedorov, Anna Perechodjuk, David Linke
Artificial neural networks (ANNs) are powerful tools for solving a wide range of tasks in fundamental and applied science. However, training and building reliable ANN models requires a lot of data which so far hinders their wider application in kinetic modelling where typically only small (experimental) datasets are…