Skip to content
GitHub Explorer

neptun-software/data-scraper

View on GitHub ↗Related repositories →

active 2024-06-30 → 2024-07-03 (UTC)

Complete coverage26,709 / 26,709 hourly files (100%) · 2 absent upstream2023-08-15 → 2026-08-31 (UTC)
Events
55
Pushes
29
Pull requests
0
Issues
18
Stars
1
Forks
0

Activity over time

Daily event counts in the loaded window

Line chart, 4 days from 2024-06-30 to 2024-07-03. Pushes: 29 total, peak 18 in a day. Pull requests: 0 total, peak 0 in a day. Issues: 18 total, peak 9 in a day. Comments: 7 total, peak 4 in a day. Stars: 1 total, peak 1 in a day.

  • Pushes
  • Pull requests
  • Issues
  • Comments
  • Stars

Top contributors

Pushes, PRs, issues, reviews and comments — stars and forks excluded, so this is contribution rather than popularity

ContributorContributionsPushesPRsComments
jonasfroeller391407
stevan06v151500

Recent activity

Latest issues, pull requests and releases

  • Issue#18jonasfroeller2024-07-02 17:44
    Scrape the first 10 pages.
  • Issue#20jonasfroeller2024-07-02 16:11
    Create list of technologies to scrape.
  • Issue#19jonasfroeller2024-07-02 16:06
    Scrape further information.
  • Issue#18jonasfroeller2024-07-02 16:05
    Scrape the first 10 pages.
  • Issue#17jonasfroeller2024-07-01 22:19
    Scrape docker info from the docker docs.
  • Issue#16jonasfroeller2024-07-01 22:13
    Use docker API?
  • Issue#14jonasfroeller2024-07-01 19:10
    Fix missing data.
  • Issue comment#14jonasfroeller2024-07-01 18:45
    Fix missing data.
  • Issue#13jonasfroeller2024-07-01 18:31
    Fetch all repositories instead of only fetching the first occurrence.
  • Issue comment#16jonasfroeller2024-07-01 17:31
    Use docker API?
  • Issue comment#16jonasfroeller2024-07-01 17:25
    Use docker API?
  • Issue#16jonasfroeller2024-07-01 17:17
    Use docker API?
  • Issue#15jonasfroeller2024-06-30 16:56
    Scrape information from the docker blog and docs.
  • Issue#14jonasfroeller2024-06-30 16:34
    Fix missing data.
  • Issue#13jonasfroeller2024-06-30 16:33
    Fetch all repositories instead of only fetching the first occurrence.
  • Issue#11jonasfroeller2024-06-30 16:32
    Fix html content missing in dockerhub spider. (only cookie banner fetched)
  • Issue comment#11jonasfroeller2024-06-30 16:13
    Fix html content missing in dockerhub spider. (only cookie banner fetched)
  • Issue comment#11jonasfroeller2024-06-30 16:13
    Fix html content missing in dockerhub spider. (only cookie banner fetched)
  • Issue comment#11jonasfroeller2024-06-30 15:56
    Fix html content missing in dockerhub spider. (only cookie banner fetched)
  • Issue#12jonasfroeller2024-06-30 15:55
    Replace scrapy-splash plugin with scrapy-playwright plugin (use other browser).
  • Issue#12jonasfroeller2024-06-30 15:05
    Replace scrapy-splash plugin with scrapy-playwright plugin (use other browser).
  • Issue comment#11jonasfroeller2024-06-30 15:02
    Fix html content missing in dockerhub spider. (only cookie banner fetched)
  • Issue#11jonasfroeller2024-06-30 13:02
    Fix html content missing in dockerhub spider. (only cookie banner fetched)
  • Issue#10jonasfroeller2024-06-30 12:50
    Add scrapy-splash plugin.
  • Issue#10jonasfroeller2024-06-30 12:20
    Add scrapy-splash plugin.

Totals cover only the window loaded into ClickHouse and count events, not GitHub's lifetime totals — 1 stars here means stars gained during the window, not the repo's star count.