17 papers · ranked by Valyu relevance
Anastasia Drozdova, Polina Guseva, Е. В. Трофимова, Anna Scherbakova + 1 more
'A. Ustyuzhanin'] Program code as a data source is gaining popularity in the data science community. Possible applications for models trained on such assets range from classification for data dimensionality reduction to automatic code generation. However, without annotation number of methods that could be applied is…
Muhammad Zubair Malik, Muhammad Nawaz, Nimrah Mustafa, Junaid Haroon Siddiqui
'Junaid Haroon Siddiqui'] Machine Learning (ML) has revamped every domain of life as it provides powerful tools to build complex systems that learn and improve from experience and data. Our key insight is that to solve a machine learning problem, data scientists do not invent a new algorithm each time, but evaluate a…
Ramona Leenings, Nils R. Winter, Kelvin Sarink, Jan Ernsting + 3 more
'Xiaoyi Jiang' 'Udo Dannlowski' 'Tim Hahn'] Despite the tremendous efforts to democratize machine learning, especially in applied-science, the application is still often hampered by the lack of coding skills. As we consider programmatic understanding key to building effective and efficient machine learning solutions…
Ruibo Shi, Lili Tao, Rohan Saphal, Fran Silavong + 1 more
We present CV4Code, a compact and effective computer vision method for sourcecode understanding. Our method leverages the contextual and the structural information available from the code snippet by treating each snippet as a two-dimensional image, which naturally encodes the context and retains the underlying…
Haiyin Zhang, Luís Cruz, Arie van Deursen
The popularity of machine learning has wildly expanded in recent years. Machine learning techniques have been heatedly studied in academia and applied in the industry to create business value. However, there is a lack of guidelines for code quality in machine learning applications. In particular, code smells have…
Miltiadis Allamanis, Earl T. Barr, Prémkumar Dévanbu, Charles Sutton
Research at the intersection of machine learning, programming languages, and software engineering has recently taken important steps in proposing learnable probabilistic models of source code that exploit code's abundance of patterns. In this article, we survey this work. We contrast programming languages against…
Syed Mehedi Hasan Nirob, Shamim Ehsan, Moqsadur Rahman, Summit Haque
—Large language models (LLMs) have made it remarkably easy to synthesize plausible source code from natural language prompts. While this accelerates software development and supports learning, it also raises new risks for academic integrity, authorship attribution, and responsible AI use. This paper investigates the…
Pohsun Feng, Ziqian Bi, Yizhu Wen, Benji Peng + 11 more
Language Models -- AutoML from Basics to State-of-the-Art Techniques Authors: ['Pohsun Feng' 'Ziqian Bi' 'Yizhu Wen' 'Benji Peng' 'Junyu Liu' 'Caitlyn Heqi Yin' 'Tianyang Wang' 'Keyu Chen' 'Sen Zhang' 'Ming Li' 'Jiawei Xu' 'Ming Liu' 'Xiaoyong Pan' 'Jinlang Wang' 'Qian Niu'] | 1 | Introduction to AutoML | | 13 | | ---…
Bart van Oort, Luís Cruz, Maurício Aniche, Arie van Deursen
—Artificial Intelligence (AI) and Machine Learning (ML) are pervasive in the current computer science landscape. Yet, there still exists a lack of software engineering experience and best practices in this field. One such best practice, static code analysis, can be used to find code smells, i.e., (potential) defects in…
Marc Oedingen, Raphael C. Engelhardt, Robin Denz, Maximilian Hammer + 1 more
In recent times, large language models (LLMs) have made significant strides in generating computer code, blurring the lines between code created by humans and code produced by artificial intelligence (AI). As these technologies evolve rapidly, it is crucial to explore how they influence code generation, especially…
Peter Hamfelt, Ricardo Britto, Lincoln S. Rocha, Camilo Almendra
Machine learning (ML) has rapidly grown in popularity, becoming vital to many industries. Currently, the research on code smells in ML applications lacks tools and studies that address the identi! cation and validity of ML-speci!c code smells. This work investigates suitable methods and tools to design and develop a…
Harsh Patel, Buvaneswari A. Ramanan, Manzoor Ahmed Khan, Thomas G. Williams + 2 more
'Thomas G. Williams' 'Brian Friedman' 'Lawrence Drabeck'] Abstract—This paper explores the possibilities of the current generation of Large Language Models for incorporating Machine Learning Operations (MLOps) functionalities into ML training code bases. We evaluate the performance of OpenAI (gpt-3.5 turbo) and…
Hyunjae Suh, Mahan Tafreshipour, Jiawei Li, Adithya Bhattiprolu + 1 more
How Far Are We? Authors: ['Hyunjae Suh' 'Mahan Tafreshipour' 'Jiawei Li' 'Adithya Bhattiprolu' 'Iftekhar Ahmed'] Abstract—Artificial Intelligence (AI) techniques, especially Large Language Models (LLMs), have started gaining popularity among researchers and software developers for generating source code. However, LLMs…
Polina Guseva, Anastasia Drozdova, Natalia Denisenko, Daria Sapozhnikova + 3 more
'Daria Sapozhnikova' 'Ivan Pyaternev' 'Anna Scherbakova' 'Andrey Ustuzhanin'] A range of applications for automatic machine learning need the generation process to be controllable. In this work, we propose a way to control the output via a sequence of simple actions, that are called semantic code classes. Finally, we…
Sebastian Raschka, Joshua T. Patterson, Corey Nolet
- 1 University of Wisconsin-Madison, Department of Statistics; sraschka@wisc.edu - 2 NVIDIA; joshuap@nvidia.com - 3 NVIDIA; cnolet@nvidia.com - 4 University of Maryland, Baltimore County, Dep. of Comp Sci & Electrical Engineering; coreyn1@umbc.edu - ***** Correspondence: sraschka@wisc.edu - † Current address: 1300…
Tonghe Zhuang, Zhicheng Lin
Computer programming (coding) is indispensable for researchers across disciplines, yet it remains challenging to learn and time-consuming to carry out. Generative AI, particularly large language models (LLMs), has the potential to transform coding into intuitive conversations, but best practices and effective workflows…
Niklas Kühl, Marc Goutier, Robin Hirt, Gerhard Satzger
The application of "machine learning" and "artificial intelligence" has become popular within the last decade. Both terms are frequently used in science and media, sometimes interchangeably, sometimes with different meanings. In this work, we aim to clarify the relationship between these terms and, in particular, to…