14 papers · ranked by Valyu relevance
Pooja Yadav, Sriniwas Pandey, Sraban Kumar Mohanty
Clustering is an unsupervised learning technique in which data or objects are grouped into sets based on some similarity measure. Most of the clustering algorithms assume that the main memory is infinite and can accommodate the set of patterns. In reality many applications give rise to a large set of patterns which…
Alexander Ulanov, Andrey Simanovsky, Manish Marwah
—Present day machine learning is computationally intensive and processes large amounts of data. It is implemented in a distributed fashion in order to address these scalability issues. The work is parallelized across a number of computing nodes. It is usually hard to estimate in advance how many nodes to use for a…
Frank Schoeneman, Jarosław Żola
—Non-linear spectral dimensionality reduction methods, such as Isomap, remain important technique for learning manifolds. However, due to computational complexity, exact manifold learning using Isomap is currently impossible from large-scale data. In this paper, we propose a distributed memory framework implementing…
Theja Tulabandhula, Deeksha Sinha, Saketh Reddy Karra
Scalable real-time assortment optimization has become essential in e-commerce operations due to the need for personalization and the availability of a large variety of items. While this can be done when there are simplistic assortment choices to be made, the optimization process becomes difficult when imposing…
Anuj Sharma, Syed Mohammed Arshad Zaidi
Graphs and their traversal is becoming significant as it is applicable to various areas of mathematics, science and technology. Various problems in fields as varied as biochemistry (genomics), electrical engineering (communication networks), computer science (algorithms and computation) can be modeled as Graph…
Michael Bar-Sinai
Storing and manipulating Big Data relies on various data structures, algorithms and technologies. Some of these are new, while others have existed for quite a while (the Bloom filter was presented in 1970) and are now making their way into mainstream software engineering. We present those algorithms and technologies…
Yongzhe Zhang, Ariful Azad, Zhenjiang Hu
This paper presents a new distributed-memory algorithm called FastSV for finding connected components in an undirected graph. Our algorithm simplifies the classic Shiloach-Vishkin algorithm and employs several novel and efficient hooking strategies for faster convergence. We map different steps of FastSV to linear…
Hsiang-Huang Wu, Chien‐Min Wang, Hsuan-Chi Kuo, Wei-Chun Chung + 1 more
'Jan-Ming Ho'] Abstract—Suffix Array (SA) is a cardinal data structure in many pattern matching applications, including data compression, plagiarism detection and sequence alignment. However, as the volumes of data increase abruptly, the construction of SA is not amenable to the current large-scale data processing…
M. Rostami, S. S. Kia
— Federated learning (FL) has gained considerable popularity for distributed machine learning due to its ability to preserve the privacy of participating agents by eliminating the need for data aggregation. Nevertheless, communication costs between agents and the central server in FL are substantial in large-scale…
Saurav Prakash, Amirhossein Reisizadeh, Ramtin Pedarsani, Salman Avestimehr
'Salman Avestimehr'] To combat the growing demands for efficient processing of large scale graph-structured datasets, many distributed graph computing systems have been developed recently. As these systems require many messages to be exchanged among computing machines at each step of the computation, communication…
Manuel Penschuck
Shuffling is the process of rearranging a sequence of elements into a random order such that any permutation occurs with equal probability. It is an important building block in a plethora of techniques used in virtually all scientific areas. Consequently considerable work has been devoted to the design and…
Jimmy Lin
of choice, but there exist classes of algorithms that aren't "nails", in the sense that they are not particularly amenable to the MapReduce programming model. To address this, researchers have proposed MapReduce extensions or alternative programming models in which these algorithms can be elegantly expressed. This…
Silu Huang, Ada Wai-Chee Fu
As computer clusters are found to be highly effective for handling massive datasets, the design of efficient parallel algorithms for such a computing model is of great interest. We consider (α, k)-minimal algorithms for such a purpose, where α is the number of rounds in the algorithm, and k is a bound on the deviation…
Foto Afrati, Shlomi Dolev, Ephraim Korach, Shantanu Sharma + 1 more
'Jeffrey D. Ullman'] A MapReduce algorithm can be described by a mapping schema, which assigns inputs to a set of reducers, such that for each required output there exists a reducer that receives all the inputs that participate in the computation of this output. Reducers have a capacity, which limits the sets of inputs…