• Home
  • Search
  • Fairness set and forgotten: Mining fairness toolkit usage in open-source machine learning projects
  • https://doi.org/10.1016/j.infsof.2025.107957Copy DOI Icon

Fairness set and forgotten: Mining fairness toolkit usage in open-source machine learning projects

Show More
  • Abstract
  • Literature Map
  • References
  • Similar Papers
Abstract

The development of machine learning (ML) systems in high-stakes domains has amplified concerns about fairness, prompting the creation of fairness toolkits offering metrics and mitigation techniques. Open-source software (OSS) ecosystems, a critical driver of AI innovation, present a unique opportunity to study the practical adoption of these toolkits. This paper aims to empirically characterize the adoption of fairness toolkits in OSS ML projects by investigating for what purposes they are used and how their usage evolves over time. We conducted a mining study on GitHub repositories related to real-world ML projects that integrate fairness toolkits such as AIF360 and Fairlearn . Starting from 1,096 candidate repositories, we applied systematic filtering to identify a final dataset of 20 relevant ML projects (comprising 5,777 total commits). We analyzed toolkit usage by examining invoked APIs and commit histories to uncover patterns of adoption and evolution. Our findings reveal that fairness toolkits are predominantly used for diagnostic purposes, with analytic components integrated early in the project lifecycle and rarely modified thereafter. In contrast, mitigation techniques are infrequently adopted, tend to appear later, and exhibit short, unstable lifespans. Our results show that the adoption of fairness toolkits in OSS ML projects is limited and often restricted to initial diagnostic phases, with active mitigation practices remaining rare. These findings highlight the need for improved support to foster more sustained and effective integration of fairness practices within open-source development.

Similar Papers
  • Research Article
  • Citations109

Open source software ecosystems: A Systematic mapping

  • Jul 08, 2017
  • Information and Software Technology
  • Oscar Franco-Bedoya +3
  • Research Article

A Theoretical Framework for Enhancing Open-Source Software Security

  • Jun 30, 2022
  • Journal of Artificial Intelligence & Cloud Computing
  • Omkar Manohar Ghag
  • Research Article

A structure for innovation reproduction in the Eclipse OSS ecosystem

  • Jan 01, 2012
  • International Journal of Innovation and Sustainable Development
  • Kazunori Mizushima +1
  • PDF
  • Book Chapter
  • Citations14

The Life and Death of Software Ecosystems

  • Jan 01, 2019
  • Raula Gaikovina Kula +1
  • Research Article
  • Citations31

Licensing and Competition for Services in Open Source Software

  • Dec 01, 2013
  • Information Systems Research
  • Terrence August +2
  • PDF
  • Research Article
  • Citations80

Chemist versus Machine: Traditional Knowledge versus Machine Learning Techniques

  • Nov 09, 2020
  • Trends in Chemistry
  • Janine George +1
  • Research Article
  • Citations8

“We do not appreciate being experimented on”: Developer and researcher views on the ethics of experiments on open-source projects

  • Jun 07, 2023
  • Journal of Systems and Software
  • Dror G Feitelson
  • PDF
  • Research Article
  • Citations86

Engineering problems in machine learning systems

  • Apr 23, 2020
  • Machine Learning
  • Hiroshi Kuwajima +2
  • PDF
  • Research Article
  • Citations149

Technology readiness levels for machine learning systems

  • Oct 20, 2022
  • Nature Communications
  • Alexander Lavin +14
  • Conference Article
  • Citations28

QuESo - A Quality Model for Open Source Software Ecosystems

  • Jan 01, 2014
  • Oscar Franco-Bedoya +3
  • PDF
  • Conference Article
  • Citations2

A Systematic Review of Research on Open Source Software in Commercial Software Product Development

  • Apr 01, 2010
  • Electronic workshops in computing
  • Martin Höst +1
  • PDF
  • Research Article
  • Citations17

Challenges in AutoML and Declarative Studies Using Systematic Literature Review

  • Nov 15, 2023
  • Applied Data Science and Analysis
  • Eman Thabet Khalid +2
  • Research Article
  • Citations6

Open source: does transparency lead to security?

  • Sep 01, 2008
  • Computer Fraud & Security
  • Steve Mansfield-Devine
  • Conference Article
  • Citations30

The process of quality assurance under open source software development

  • Mar 01, 2011
  • Atieh Khanjani +1
  • PDF
  • Research Article
  • Citations2

IoT-based group size prediction and recommendation system using machine learning and deep learning techniques

  • Jan 20, 2021
  • SN Applied Sciences
  • Deepti Chopra +1
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.