The Values Encoded in Machine Learning Research

Abstract

Machine learning currently exerts an outsized influence on the world, increasingly affecting institutional practices and impacted communities. It is therefore critical that we question vague conceptions of the field as value-neutral or universally beneficial, and investigate what specific values the field is advancing. In this paper, we first introduce a method and annotation scheme for studying the values encoded in documents such as research papers. Applying the scheme, we analyze 100 highly cited machine learning papers published at premier machine learning conferences, ICML and NeurIPS. We annotate key features of papers which reveal their values: their justification for their choice of project, which attributes of their project they uplift, their consideration of potential negative consequences, and their institutional affiliations and funding sources. We find that few of the papers justify how their project connects to a societal need (15\%) and far fewer discuss negative potential (1\%). Through line-by-line content analysis, we identify 59 values that are uplifted in ML research, and, of these, we find that the papers most frequently justify and assess themselves based on Performance, Generalization, Quantitative evidence, Efficiency, Building on past work, and Novelty. We present extensive textual evidence and identify key themes in the definitions and operationalization of these values. Notably, we find systematic textual evidence that these top values are being defined and applied with assumptions and implications generally supporting the centralization of power.Finally, we find increasingly close ties between these highly cited papers and tech companies and elite universities.

The authors' own abstract, copied from arxiv.org.

How to cite it

Built from the details listed on this page. Check them against the paper before you submit.

Birhane, A., Kalluri, P., Card, D., Agnew, W., Dotan, R., & Bao, M. (2021). The Values Encoded in Machine Learning Research. Preprint, not yet peer-reviewed. https://arxiv.org/abs/2106.15590

Birhane, Abeba, et al. "The Values Encoded in Machine Learning Research." Preprint, not yet peer-reviewed, 2021, https://arxiv.org/abs/2106.15590.

@article{birhane2021the,
  title = {The Values Encoded in Machine Learning Research},
  author = {Abeba Birhane and Pratyusha Kalluri and Dallas Card and William Agnew and Ravit Dotan and Michelle Bao},
  journal = {Preprint, not yet peer-reviewed},
  year = {2021},
  url = {https://arxiv.org/abs/2106.15590},
}

What it is

Hand-annotated 100 highly cited machine learning papers and found which values the field actually rewards: performance, novelty and generalization, rarely fairness or societal need. Also traces the funding behind the work. Free on arXiv.

Topics