13 papers · ranked by Valyu relevance
Kanit Wongsuphasawat, Yang Liu, Jeffrey Heer
How do analysis goals and context affect exploratory data analysis (EDA)? To investigate this question, we conducted semi-structured interviews with 18 data analysts. We characterize common exploration goals: profiling (assessing data quality) and discovery (gaining new insights). Though the EDA literature primarily…
Ankur Agarwal, Shashi Prabha, Raghav Yadav
and Patterns Authors: ['Ankur Agarwal' 'Shashi Prabha' 'Raghav Yadav'] This paper explores the application of Exploratory Data Analytics (EDA) in the banking and finance domain, specifically focusing on analyzing credit card usage and customer churning. The report presents a comprehensive step-by-step analysis of…
Daniel Deutch, Amir Gilad, Tova Milo, Amit Mualem + 1 more
When exploring a new dataset, Data Scientists often apply analysis queries, look for insights in the resulting dataframe, and repeat to apply further queries. We propose in this paper a novel solution that assists data scientists in this laborious process. In a nutshell, our solution pinpoints the most interesting…
Sayan Putatunda, Dayananda Ubrangala, Kiran Rama, Ravi Prasad Kondapalli
This paper introduces SmartEDA, which is an R package for performing Exploratory data analysis (EDA). EDA is generally the first step that one needs to perform before developing any machine learning or statistical models. The goal of EDA is to help someone perform the initial investigation to know more about the data…
Jessica Hullman, Andrew Gelman
> Abstract. Research and development in computer science and statistics have produced increasingly sophisticated software interfaces for interactive and exploratory analysis, optimized for easy pattern finding and data exposure. But design philosophies that emphasize exploration over other phases of analysis risk…
Kartikay Goyle, Quin Xie, Vakul Goyle
—Current automated machine learning (ML) tools are model-centric, focusing on model selection and parameter optimization. However, the majority of the time in data analysis is devoted to data cleaning and wrangling, for which limited tools are available. Here we present DataAssist, an automated data preparation and…
Andreas Henelius, Emilia Oikarinen, Kai Puolamäki
The outcome of the explorative data analysis (EDA) phase is vital for successful data analysis. EDA is more effective when the user interacts with the system used to carry out the exploration. In the recently proposed paradigm of iterative data mining the user controls the exploration by inputting knowledge in the form…
Sanad Saha, Nischal Aryal, Leilani Battle, Arash Termehchy
Exploratory visual analysis (EVA) is an essential stage of the data science pipeline, where users often lack clear analysis goals at the start and iteratively refine them as they learn more about their data. Accurate models of users' exploration behavior are becoming increasingly vital to developing responsive and…
Dylan Wootton, Amy Rae Fox, Evan M. Peck, Arvind Satyanarayan
Computational Notebooks with a Mixed-Methods Formalism Authors: ['Dylan Wootton' 'Amy Rae Fox' 'Evan M. Peck' 'Arvind Satyanarayan'] Abstract—Interactive visualizations are powerful tools for Exploratory Data Analysis (EDA), but how do they affect the observations analysts make about their data? We conducted a…
Roger D. Peng, Stephanie C. Hicks
In 1977 John Tukey described how in exploratory data analysis, data analysts use tools, such as data visualizations, to separate their expectations from what they observe. In contrast to statistical theory, an underappreciated aspect of data analysis is that a data analyst must make decisions by comparing the observed…
Jimmy Moore, Pascal Goffin, Jason Wiese, Miriah Meyer
Personal informatics research helps people track personal data for the purposes of self-reflection and gaining selfknowledge. This field, however, has predominantly focused on the data collection and insight-generation elements of self-tracking, with less attention paid to flexible data analysis. As a result, this…
Sneha Gathani, Zhicheng Liu, Peter J. Haas, Çağatay Demiralp
What-if analysis (WIA), crucial for making data-driven decisions, enables users to understand how changes in variables impact outcomes and explore alternative scenarios. However, existing WIA research focuses on supporting the workflows of data scientists or analysts, largely overlooking significant non-technical…
Stephanie C. Hicks, Roger D. Peng
The data revolution has led to an increased interest in the practice of data analysis. For a given problem, there can be significant or subtle differences in how a data analyst constructs or creates a data analysis, including differences in the choice of methods, tooling, and workflow. In addition, data analysts can…