This repo contains the dataset and code for the paper "SWE-Lancer: Can Frontier LLMs Earn $1 Million from Real-World Freelance Software Engineering?"
active 2025-02-19 → 2026-02-11 (UTC)
Activity over time
Daily event counts in the loaded window
Line chart, 358 days from 2025-02-19 to 2026-02-11. Pushes: 22 total, peak 7 in a day. Pull requests: 41 total, peak 9 in a day. Issues: 36 total, peak 20 in a day. Comments: 42 total, peak 13 in a day. Stars: 520 total, peak 154 in a day.
- Pushes
- Pull requests
- Issues
- Comments
- Stars
Stars, PRs, issues and forks are under-captured in the later part of this window. GH Archive progressively stopped capturing non-push events during 2026 — −95% or worse by the end of the window. Every series here except Pushes fades for that reason, so a decline above reflects the archive, not this repository. Pushes stay reliable throughout, so read them, and the contributor counts derived from them, as the real signal. Data health has the measurements.
Top contributors
Pushes, PRs, issues, reviews and comments — stars and forks excluded, so this is contribution rather than popularity
| Contributor | Contributions | Pushes | PRs | Comments |
|---|---|---|---|---|
| samuelgm-openai | 77 | 19 | 30 | 2 |
| James4Ever0 | 19 | 0 | 0 | 18 |
| BoxiYu | 8 | 0 | 0 | 7 |
| r-openai | 5 | 2 | 3 | 0 |
| michele-openai | 5 | 1 | 2 | 1 |
| chongkong | 4 | 0 | 1 | 2 |
| jianzzz | 2 | 0 | 0 | 1 |
| arktrail | 2 | 0 | 0 | 1 |
| GthiN89 | 2 | 0 | 0 | 0 |
| fschieber88 | 2 | 0 | 2 | 0 |
| Lucky-w0y | 2 | 0 | 0 | 2 |
| RODRIGOARIVERA | 2 | 0 | 0 | 1 |
| KevinVillela | 2 | 0 | 0 | 2 |
| geeker-smallwhite | 1 | 0 | 0 | 1 |
| fayaz-dev | 1 | 0 | 0 | 1 |
| x5engine | 1 | 0 | 0 | 1 |
| DenebUniverse | 1 | 0 | 0 | 0 |
| LionNatsu | 1 | 0 | 1 | 0 |
| crazygo | 1 | 0 | 1 | 0 |
| ShaneTian | 1 | 0 | 0 | 1 |
Recent activity
Latest issues, pull requests and releases
- Pull request#91samuelgm-openai2025-07-18 01:57
- Pull request#91samuelgm-openai2025-07-18 01:57
- Pull request#38samuelgm-openai2025-07-18 01:57
- Pull request#54samuelgm-openai2025-07-18 01:57
- Pull request#67samuelgm-openai2025-07-18 01:57
- Pull request#91samuelgm-openai2025-07-18 01:56
- Pull request#91samuelgm-openai2025-07-18 01:56
- Issue#7samuelgm-openai2025-07-18 01:56Release SWE-Lancer Diamond dataset on Hugging Face
- Issue#1samuelgm-openai2025-07-18 01:56Server specs to run this at scale?
- Issue#7samuelgm-openai2025-07-18 01:56Release SWE-Lancer Diamond dataset on Hugging Face
- Issue#7samuelgm-openai2025-07-18 01:56Release SWE-Lancer Diamond dataset on Hugging Face
- Issue#62samuelgm-openai2025-07-18 01:56Could you explain `issue_introduction.patch`?
- Issue#13samuelgm-openai2025-07-18 01:56Earn = Revenue - Expenses ??
- Issue#14samuelgm-openai2025-07-18 01:56Validate git revert for #14958
- Issue#30samuelgm-openai2025-07-18 01:56Validate and add 196 new tasks to run
- Issue#35samuelgm-openai2025-07-18 01:56Task request for SWELancer-Benchmark
- Issue#43samuelgm-openai2025-07-18 01:55Docker network error when running `uv run python run_swelancer.py`
- Issue#52samuelgm-openai2025-07-18 01:55Fail to run user-tool in docker
- Issue#53samuelgm-openai2025-07-18 01:55Inconsistent Code Output Format Requirements in Prompts
- Issue#59samuelgm-openai2025-07-18 01:55Can anyone find the manager tasks?
- Issue#64samuelgm-openai2025-07-18 01:55Duplicate issues in the dataset on `main` branch
- Issue#65samuelgm-openai2025-07-18 01:55Jupyter kernel connection file contains wrong IP when using remote Docker
- Issue#79samuelgm-openai2025-07-18 01:55earned information
- Issue#81samuelgm-openai2025-07-18 01:55swe_manager task broken: `Command 'jupyter --runtime-dir' returned non-zero exit status XXX`
- Issue#87samuelgm-openai2025-07-18 01:55Question about retry logic design (RetryableSystemError)
Totals cover only the window loaded into ClickHouse and count events, not GitHub's lifetime totals — 520 stars here means stars gained during the window, not the repo's star count.