23 papers · ranked by Valyu relevance
Sen Yang, Xiaobao Wang, Qijuan Yang, Enzeng Dong + 2 more
'Cosimo Distante'] The single batch normalization (BN) method is commonly used in the instance segmentation algorithms. The batch size is concerned with some drawbacks. A too small sample batch size leads to a sharp drop in accuracy, but a too large batch may result in the memory overflow of graphic processing units…
Khoat Than
In this work, we develop a theoretical framework that elucidates the role of normalization through the lens of capacity control. We prove that an unnormalized DNN can exhibit exponentially large Lipschitz constants with respect to either its parameters or inputs, implying excessive functional capacity and potential…
Zaina A. Zayyad, John H. R. Maunsell, Jason N. MacLean
When multiple stimuli appear together in the receptive field of a visual cortical neuron, the response is typically close to the average of that neuron’s response to each individual stimulus. The departure from a linear sum of each individual response is referred to as normalization. In mammals, normalization has been…
Flaviano Morone, Shivang Rawat, David J. Heeger, Stefano Martiniani
Stability is a fundamental requirement for both biological and engineered neural circuits, yet it is surprisingly difficult to guarantee in the presence of recurrent interactions. Standard linear dynamical models of recurrent networks are sensitive to the precise values of the synaptic weights, since stability requires…
A. Sina Booeshaghi, Ingileif B. Hallgrímsdóttir, Ángel Gálvez-Merchán, Lior Pachter
Single-cell genomics analysis requires normalization of feature counts that stabilizes variance, accounts for variable cell sequencing depth, and preserves monotonicity of within-cell feature abundances. We show that normalization via an (additive in the raw counts) proportional fitting step followed by the logarithm…
Asit Pal, Shivang Rawat, David J. Heeger, Stefano Martiniani
Title: Summary The primate brain exhibits a hierarchical, modular architecture with conserved microcircuits executing canonical computations across reciprocally connected cortical areas. Though feedback connections are ubiquitous, their functions remain largely unknown. To investigate the role of feedback, we present a…
H. Sebastian Seung
Normalization is a fundamental operation in image processing. Convolutional nets have evolved to include a large number of normalizations (29; 64; 65), and this architectural shift has proved essential for robust computer vision (27; 6; 48). Studies of biological vision, in contrast, have invoked just one or a few…
Deying Song, Douglas Ruff, Marlene Cohen, Chengcheng Huang
The size of a neuron’s receptive field increases along the visual hierarchy. Neurons in higher-order visual areas integrate information through a canonical computation called normalization, where neurons respond sublinearly to multiple stimuli in the receptive field. Neurons in the visual cortex exhibit highly…
Jiachen Zhu, Xinlei Chen, Kaiming He, Yann LeCun + 1 more
Normalization layers are ubiquitous in modern neural networks and have long been considered essential. This work demonstrates that Transformers without normalization can achieve the same or better performance using a remarkably simple technique. We introduce Dynamic Tanh (DyT), an element-wise operation DyT(x) =…
Aydin Demircioğlu
Objectives In radiomics, different feature normalization methods, such as z-Score or Min-Max, are currently utilized, but their specific impact on the model is unclear. We aimed to measure their effect on the predictive performance and the feature selection. Methods We employed fifteen publicly available radiomics…
Anath Rau Krishnan
The use of a multi-criteria decision-making (MCDM) technique mostly begins with normalizing the incommensurable data values in the decision matrix. Numerous normalization methods are available in the literature and applying different normalization methods to an MCDM technique is proven to deliver varying results. As…
Shadrack Barnabas, Timo Böhme, Stephen Boyer, Matthias Irmer + 4 more
The extraction of chemical information from documents is a demanding task in cheminformatics due to the variety of text and image-based representations of chemistry. The present work describes the extraction of chemical compounds with unique chemical structures from the open access CORE (COnnecting REpositories) and…
Amir Joudaki, Hadi Daneshmand, Francis Bach
In this paper, we explore the structure of the penultimate Gram matrix in deep neural networks, which contains the pairwise inner products of outputs corresponding to a batch of inputs. In several architectures it has been observed that this Gram matrix becomes degenerate with depth at initialization, which…
Deying Song, Douglas Ruff, Marlene Cohen, Chengcheng Huang
Neurons in higher-order visual areas integrate information through a canonical computation called normalization. The strength of normalization is highly heterogeneous across neurons, and this heterogeneity correlates with attention-mediated modulations in neural responses. However, the circuit mechanism underlying the…
Daniel Eftekhari, Vardan Papyan
The normal distribution plays a central role in information theory – it is at the same time the best-case signal and worst-case noise distribution, has the greatest representational capacity of any distribution, and offers an equivalence between uncorrelatedness and independence for joint distributions. Accounting for…
Kunlun Wang, Kaoutar Ait-Ahmad, Sam Kupp, Zachary Sims + 7 more
Multiplexed tissue imaging (MTI) technologies enable high-dimensional spatial analysis of tumor microenvironments but face challenges with technical variability in staining intensities. Existing normalization methods, including Z-score, ComBat, and MxNorm, often fail to account for the heterogeneous, right-skewed…
Róbert Rajkó
This short communication paper is briefly dealing with greater or lesser misused normalization in self-modeling/multivariate curve resolution (S/MCR) practice. The importance of the correct use of the ODE (ordinary differential equation) solvers and apt kinetic illustrations are elucidated. The new terms, external and…
Shadrack Barnabas, Timo Böhme, Stephen Boyer, Matthias Irmer + 5 more
The extraction of chemical information from documents is a demanding task in cheminformatics due to the variety of text and image-based representations of chemistry. The present work describes the extraction of chemical compounds with unique chemical structures from the open access CORE (COnnecting REpositories) and…
Behnaz Haji Molla Hoseyni, Sevda Imany, Ahmadreza Iranpour, Maryam Mehrabani + 4 more
Background Histology images are a cornerstone of pathology, which allow automated analysis for disease diagnosis. However, variations in staining and image acquisition processes significantly affect the performance of these algorithms. Histology image normalization is method to achieve uniformity in image color…
Authors not listed
Meteorological normalization is a key concept in studying anthropogenic effects on air pollutant concentrations and its temporal trends. While apparently successful in revealing anthropogenic effects and often used, there are downsides to the methods and limitations which should be taken into account when using it.…
Authors not listed
STO-mG type basis functions for 1s to 4f Hydrogen-like orbitals by “energy fit” are reported as simple functions of running parameter atomic number Z and quantum numbers to utilize the basis set from these functions in molecular electronic structure and energy calculations. We mimic the accurate solution of Slater-type…
Saige Rutherford, Pieter Barkema, Ivy F. Tso, Chandra Sripada + 3 more
In this work, we expand the normative model repository introduced in Rutherford et al. (2022a) to include normative models charting lifespan trajectories of structural surface area and brain functional connectivity, measured using two unique resting-state network atlases (Yeo-17 and Smith-10), and an updated online…
Modis, Theodore
Use is made of rigorous definitions for the terms normal, natural, and harmonic to reveal a number of unfamiliar aspects about them. The Gaussian distribution is not sufficient to determine who is normal, and fluctuations above or below a natural-growth curve may or may not be natural. A recipe for harmonically…