A tiny web crawler in Python
active 2024-06-12 → 2024-07-26 (UTC)
Complete coverage26,619 / 26,619 hourly files (100%) · 2 absent upstream2023-08-15 → 2026-08-28 (UTC)
Events
398
Pushes
80
Pull requests
47
Issues
38
Stars
22
Forks
4
Activity over time
Daily event counts in the loaded window
Line chart, 45 days from 2024-06-12 to 2024-07-26. Pushes: 80 total, peak 26 in a day. Pull requests: 47 total, peak 12 in a day. Issues: 38 total, peak 12 in a day. Comments: 118 total, peak 42 in a day. Stars: 22 total, peak 13 in a day.
- Pushes
- Pull requests
- Issues
- Comments
- Stars
Top contributors
Pushes, PRs, issues, reviews and comments — stars and forks excluded, so this is contribution rather than popularity
| Contributor | Contributions | Pushes | PRs | Comments |
|---|---|---|---|---|
| indrajithi | 204 | 66 | 29 | 53 |
| Mews | 107 | 0 | 17 | 60 |
| github-actions[bot] | 14 | 14 | 0 | 0 |
| devavinothm | 4 | 0 | 1 | 2 |
| C0DE-SLAYER | 2 | 0 | 0 | 2 |
| lodenrogue | 1 | 0 | 0 | 1 |
Recent activity
Latest issues, pull requests and releases
- Releaseindrajithi2024-07-11 08:34
- Issue#39indrajithi2024-07-03 13:59Implement a retry mechanism for transient errors
- Pull request#49indrajithi2024-07-03 13:59
- Pull request#49Mews2024-06-29 19:53
- Releaseindrajithi2024-06-22 07:53
- Releaseindrajithi2024-06-22 06:14
- Releaseindrajithi2024-06-22 06:06v0.4.0-beta
- Issue#46indrajithi2024-06-21 11:01Use one or more `Options` classes
- Pull request#48indrajithi2024-06-21 11:01
- Pull request#48Mews2024-06-19 20:21
- Pull request#47indrajithi2024-06-19 18:04
- Issue#42indrajithi2024-06-19 18:02Respect robots.txt when crawling when set as True
- Pull request#45indrajithi2024-06-19 18:02
- Pull request#47Mews2024-06-19 17:26
- Issue comment#46indrajithi2024-06-19 11:35Use one or more `Options` classes
- Issue#46Mews2024-06-19 11:18Use one or more `Options` classes
- Pull request#45Mews2024-06-19 11:16
- Issue#26indrajithi2024-06-18 17:17Make `Spider` importable from main module
- Pull request#44indrajithi2024-06-18 17:17
- Pull request#44Mews2024-06-18 17:12
- Pull request#43indrajithi2024-06-18 16:54
- Issue#38indrajithi2024-06-18 16:54Implement logging
- Issue comment#43Mews2024-06-18 16:25Feature: Logging
- Issue comment#43indrajithi2024-06-18 15:28Feature: Logging
- Pull request#43Mews2024-06-18 15:18
Totals cover only the window loaded into ClickHouse and count events, not GitHub's lifetime totals — 22 stars here means stars gained during the window, not the repo's star count.