15 papers · ranked by Valyu relevance
Haisong Gong, Zixi Liu, Qiang Liu, Shu Wu + 1 more
Prevailing methods for integrating graphs into Language Models (LMs) typically rely on a segregated architecture: external Graph Neural Networks (GNNs) encode structural topology, while LMs process textual semantics. We argue this approach is suboptimal for text-graphs: it creates a conceptually disjointed interaction…
Roman Bresson, Konstantinos Divriotis, Johannes F. Lutzeyer, Iakovos Evdaimon + 1 more
We introduce GraViti, a transformer-based graph-level variational autoencoder that maps entire graphs to compact latent vectors. This design produces a true graph-level latent space that supports smooth interpolation, property-guided search, and other downstream tasks beyond the constraints of node-level embeddings. On…
Jingbo Zhou, Jun Xia, Siyuan Li, Yunfan Liu + 10 more
Graph Transformer has demonstrated impressive capabilities in the field of graph representation learning. However, existing approaches face two critical challenges: (1) most models suffer from exponentially increasing computational complexity, making it difficult to scale to large graphs; (2) attention mechanisms based…
Yipeng Zhang, Zhongtian Sun, Pietro Liò, Kelin Xia
Positional encodings (PEs) are essential for Transformers. Yet designing effective PEs for non-Euclidean graphs remains challenging. Such encodings should ideally induce an Attention-Compatible Geometry for self-attention: not merely describing graph structure, but defining a geometry whose inner products reflect…
Johannes Meintrup
We present a succinct encoding of planar graphs that supports executing a breadth-first search directly on the encoding. The succinct encoding can be constructed in expected $O(n)$ time using $O(n)$ bits during construction; a compact variant can be constructed in deterministic $O(n)$ time using $O(n)$ bits. Once the…
Jimmy Dubuisson
Reference-based graph compression encodes each vertex's neighbor list as differences from a nearby encoded list. WebGraph's BVGraph fixes a single encoding pipeline and relies on a separately chosen vertex ordering -- typically URL-lexicographic or Layered Label Propagation (LLP). Their interaction is rarely measured.…
Antoine Siraudin, Christopher Morris
Graph diffusion models achieve state-of-the-art performance in graph generation but suffer from quadratic complexity in the number of nodes—and much of their capacity is wasted modeling the absence of edges in sparse graphs. Inspired by latent diffusion in other modalities, a natural idea is to compress graphs into a…
Dorota Celinska-Kopczynska, Eryk Kopczynski
Network theoreticians hypothesize that the structure of real-world networks has a geometric origin. Especially, hyperbolic geometry was proven insightful in representing and modeling of scale-free networks. Embedders are algorithms used to find a geometric representation of a network. In this study, we introduce a fast…
Javier Porras-Valenzuela, Zhiyang Wang, Alejandro Ribeiro
Transformers have achieved remarkable success across domains, motivating the rise of Graph Transformers (GTs) as attention-based architectures for graph-structured data. A key design choice in GTs is the use of Graph Neural Network (GNN)-based positional encodings to incorporate structural information. In this work, we…
Kenta Yanagiya, Junya Hara, Hiroshi Higashi, Yuichi Tanaka + 1 more
In this paper, we propose a compression framework for weighted graphs in which the graph topology is transmitted losslessly and edge weights are compressed lossily. A challenge in the lossy compression of edge weights is that the underlying relationships between edges are ambiguous. To address this issue, we first…
Hamed Poursiami, Shay Snyder, Guojing Cong, Thomas Potok + 1 more
—Graph classification is a fundamental task in domains ranging from molecular property prediction to materials design. While graph neural networks (GNNs) achieve strong performance by learning expressive representations via message passing, they incur high computational costs, limiting their scalability and deployment…
Haotian Xu, Yuning You, Tengfei Ma
Graphs provide a unified representation of semantic content and relational structure, making them a natural fit for domains such as molecular modeling, citation networks, and social graphs. Meanwhile, large language models (LLMs) have excelled at understanding natural language and integrating cross-modal signals…
Md Abrar Jahin, Craig A. Knoblock, Jay Pujara
Graph foundation models (GFMs) with global attention are increasingly used to represent mixed-integer linear programs (MILPs), aiming to capture structure beyond the locality of standard graph neural networks. We study their expressive power through graph isomorphism testing, asking which MILP instances they map to…
Qirui Ji, Bin Qin, Y. Jin, Yunze Zhao + 4 more
Graph contrastive learning (GCL) aims to learn discriminative semantic invariance by contrasting different views of the same graph that share critical topological patterns. However, existing GCL approaches with structural augmentations often struggle to identify task-relevant topological structures, let alone adapt to…
Yuxin Jiang, Wenqin Zhang, Lele Wang
Gradient coding is a distributed computing technique aiming to provide robustness against slow or non-responsive computing nodes, known as stragglers, while balancing the computational load for responsive computing nodes. Among existing gradient codes, a construction based on combinatorial designs, called BIBD gradient…