Linux Foundation Study Finds 25% of New Open-Source Pull Requests Are Low-Quality AI Slop
A new Linux Foundation report estimates that one-quarter of incoming code contributions to open-source projects consist of low-quality AI slop, raising concerns about contribution quality.
Key points
- The Linux Foundation published a study on generative AI's impact on open-source software development.
- Approximately 25% of new pull requests are classified as low-quality AI slop.
- The report focuses on the volume and nature of these automated contributions to codebases.
The Linux Foundation released a new study today regarding the impact of generative artificial intelligence on open-source software development. The report identifies a significant portion of new code contributions as low-quality AI slop, marking a notable shift in how code is submitted to public repositories.
According to the findings published by the Linux Foundation, approximately 25% of new pull requests to open-source software amount to this low-quality AI slop. This statistic serves as a primary takeaway from the research, which examines the broader effects of AI tools on the development workflow and the integrity of open-source contributions.
Context and Background on AI Contributions
The study specifically addresses the intersection of generative AI tools and open-source maintenance. The Linux Foundation, a steward of many critical open-source projects, conducted this research to understand how automated tools are changing the nature of developer submissions. The focus is not merely on the presence of AI, but on the quality of the output generated by these systems.
The term "AI slop" refers to the low-quality nature of these submissions. The Linux Foundation’s analysis suggests that a quarter of all new pull requests fall into this category. This finding provides a concrete metric for the scale of automated, low-effort contributions entering the ecosystem, according to the Phoronix report on the study.
Impact on Open-Source Development
This data point highlights a growing challenge for maintainers of open-source software. With a significant percentage of incoming requests being low-quality AI slop, the volume of substandard code appears to be rising. The Linux Foundation’s study underscores the need to evaluate these contributions carefully, as the nature of the code being submitted changes with the adoption of AI tools.
The report does not specify which projects are most affected, nor does it detail the specific types of errors found in the AI slop. However, the sheer volume—25% of new requests—indicates that generative AI is now a major factor in the daily operations of open-source communities. Maintainers must contend with this influx as part of their regular review processes.
What should you do?
Security and technology professionals should monitor their project intake for signs of low-quality automated code. Understanding the volume and nature of AI-generated submissions is crucial for maintaining code quality. Teams should review their contribution guidelines to address the influx of AI slop identified by the Linux Foundation.
Background: Generative AI
Generative AI examples include text completion, image synthesis and code generation. These systems predict the next likely token based on vast training datasets. Understanding the underlying mechanics helps you identify risks like data leakage and hallucination in your infrastructure.
Read the full guide: Generative AI Examples: Mechanisms, Risks and Control
What to do and how to stay safe: Linux Foundation
- Review recent pull requests for patterns indicative of low-quality AI slop, such as generic comments or nonsensical code structures.
- Update contribution guidelines to explicitly address the use of generative AI tools and the expected quality standards for submissions.
- Increase scrutiny on automated submissions to ensure they meet the project's technical and security requirements before merging.
- Monitor industry reports from organizations like the Linux Foundation for updated metrics on AI impact in open-source development.
Step-by-step guide: Prompt Injection Warning Signs: How to Spot AI Manipulation
General security guidance from the Threat Times newsroom. It is not confirmed advice from the organisations named in this story.
Frequently asked questions
What percentage of new pull requests are considered AI slop?
The Linux Foundation study estimates that approximately 25% of new open-source software pull requests amount to low-quality AI slop.
Who conducted the study on AI in open-source?
The Linux Foundation published the study regarding the impact of generative AI on open-source software development.
Does the study claim all AI code is bad?
No, the study specifically identifies that ~25% of new pull requests are low-quality AI slop, not that all AI-generated code is low quality.
