15 papers · ranked by Valyu relevance
Rohit Girdhar, Alaaeldin El-Nouby, Zhuang Liu, Mannat Singh + 3 more
A single image can bind together many experiences – an image of a beach can remind us of the sound of waves, the texture of the sand, a breeze, or even inspire a poem. This 'binding' property of images offers many sources of supervision to learn visual features, by aligning them with any of the sensory experiences…
Jiaming Han, Renrui Zhang, Wenqi Shao, Peng Gao + 13 more
'Kaipeng Zhang' 'Chris Liu' 'Wen Song' 'Z. J. Guo' 'Xudong Lü' 'Shuai Ren' 'Yafei Wen' 'Xiaoxin Chen' 'Xiangyu Yue' 'Hongsheng Li' 'Yu Qiao'] We present ImageBind-LLM, a multi-modality instruction tuning method of large language models (LLMs) via ImageBind. Existing works mainly focus on language and image instruction…
Andrew Hamara, Pablo Rivas
Embedding Space Authors: ['Andrew Hamara' 'Pablo Rivas'] Abstract. This study investigates ImageBind's ability to generate meaningful fused multimodal embeddings for online auto parts listings. We propose a simplistic embedding fusion workflow that aims to capture the overlapping information of image/text pairs…
Z. J. Guo, Renrui Zhang, Xiangyang Zhu, Yiwen Tang + 7 more
'Jiaming Han' 'Kexin Chen' 'Peng Gao' 'Xianzhi Li' 'Hongsheng Li' 'Pheng‐Ann Heng'] We introduce Point-Bind, a 3D multi-modality model aligning point clouds with 2D image, language, audio, and video. Guided by ImageBind, we construct a joint embedding space between 3D and multi-modalities, enabling many promising…
Klemens Flöge, Srisruthi Udayakumar, Johanna Sommer, Marie Piraud + 8 more
Recent advances in Artificial Intelligence have enabled multi-modal systems to model and translate diverse information spaces. Extending beyond text and vision, we introduce OneProt, a multi-modal Deep Learning model for proteins that integrates structural, sequence, text, and binding site data. Using the ImageBind…
Stéfan van der Walt, Johannes L. Schönberger, Juan Nunez-Iglesias, François Boulogne + 5 more
'François Boulogne' 'Joshua D. Warner' 'Neil Yager' 'Emmanuelle Gouillart' 'Tony Yu' '' 'Shawn Gomez'] scikit-image is an image processing library that implements algorithms and utilities for use in research, education and industry applications. It is released under the liberal Modified BSD open source license…
Bradley C. Lowekamp, David T. Chen, Luis Ibáñez, Daniel Blezek
SimpleITK is a new interface to the Insight Segmentation and Registration Toolkit (ITK) designed to facilitate rapid prototyping, education and scientific activities via high level programming languages. ITK is a templated C++ library of image processing algorithms and frameworks for biomedical and other applications…
Authors not listed
nDTomo is a Python-based software suite for the simulation, reconstruction and analysis of X-ray chemical imaging and computed tomography data. It provides a collection of Python function-based tools designed for accessibility and education as well as a graphical user interface (GUI). Prioritising transparency and ease…
Authors not listed
Battery research increasingly relies on advanced imaging, yet open access to such data remains rare, scattered across various sources, and difficult to find. The Battery Imaging Library (BIL) is the first open, curated collection of multi-modal and multi-length scale battery imaging datasets, accompanied by a…
Gordon Chalmers
Large numbers of docking jobs are used in a distributional sense to obtain computational molecular non-covalent and covalent binding information of ligands to protein cavities. A numerically calculated density of binding states is generated and used to identify binding modes, which further can be used to calculate…
Estibaliz Gómez-de-Mariscal, Carlos García-López-de-Haro, Laurène Donati, Michael Unser + 2 more
DeepImageJ is a user-friendly plugin that enables the generic use in FIJI/ImageJ of pre-trained deep learning (DL) models provided by their developers. The plugin acts as a software layer between TensorFlow and FIJI/ImageJ, runs on a standard CPU-based computer and can be used without any DL expertise. Beyond its…
Faqir Gul, Mohsin Shah, Mushtaq Ali, Lal Hussain + 5 more
'Adeel Ahmed Abbasi' 'Mohammad Shahbaz Khan' 'Badr S. Alkahtani' 'Toqeer Mahmood'] Multi-panel images play an essential role in medical diagnostics and represent approximately 50% of the medical literature. These images serve as important tools for physicians to align various medical data (e.g., X-rays, MRIs, CT scans)…
Philipp Kainz, Michael Mayrhofer-Reinhartshuber, Helmut Ahammer, Lennart Martens
Image and signal analysis applications are substantial in scientific research. Both open source and commercial packages provide a wide range of functions for image and signal analysis, which are sometimes supported very well by the communities in the corresponding fields. Commercial software packages have the major…
Simon Weber, Thomas Christophel, Kai Görgen, Joram Soch + 1 more
It has been suggested that visual images are memorized across brief periods of time by vividly imagining them as if they still were there. Such visual imagery has been proposed as a key mechanism underlying working memory. However, the ability to evoke visual imagery varies substantially across individuals, raising the…
Ruoyi Cao, Leon Y. Deouell
Working memory is a neurocognitive system for maintaining and manipulating information online for a short period after the source of information disappears. The information held in working memory has been shown to flexibly match current functional goals. Considering this, we revisited the question of whether…