Data values in a dataset can be missing or anomalous due to mishandling or human error. Analysing data with missing values can create bias and affect the inferences. Several analysis methods, such as principle components analysis or singular value decomposition, require complete data. Many approaches impute numeric data and some do not consider dependency of attributes on other attributes, while some require human intervention and domain knowledge. We present a new algorithm for data imputation based on different data type values and their association constraints in data, which are not handled currently by any system. We show experimental results using different metrics comparing our algorithm with state of the art imputation techniques. Our algorithm not only imputes the missing values but also generates human readable explanations describing the significance of attributes used for every imputation.
Latest posts by Ryan Watkins (see all)
- Needed in Empirical Social Science: Numbers - June 23, 2024
- Investigating the Role of Explainability and AI Literacy in User Compliance - June 20, 2024
- Philosophical debate on use of AI in science - June 9, 2024