Skip to content

openclimatefix/forecast-data-prep

View on GitHub ↗Related repositories →

Handles the processing of Numerical Weather Prediction (NWP), satellite, and PV data into the correct format for machine learning tasks. It also handles efficient data transfer to Google Cloud Storage and disk preparation for use in cloud environments.

active 2024-09-172025-09-30 (UTC)

Complete coverage26,514 / 26,514 hourly files (100%) · 2 absent upstream2023-08-152026-08-23 (UTC)
Events
86
Pushes
35
Pull requests
9
Issues
8
Stars
1
Forks
1

Activity over time

Daily event counts in the loaded window

Line chart, 379 days from 2024-09-17 to 2025-09-30. Pushes: 35 total, peak 17 in a day. Pull requests: 9 total, peak 4 in a day. Issues: 8 total, peak 3 in a day. Comments: 18 total, peak 6 in a day. Stars: 1 total, peak 1 in a day.

  • Pushes
  • Pull requests
  • Issues
  • Comments
  • Stars

Stars, PRs, issues and forks are under-captured in the later part of this window. GH Archive progressively stopped capturing non-push events during 2026 — −95% or worse by the end of the window. Every series here except Pushes fades for that reason, so a decline above reflects the archive, not this repository. Pushes stay reliable throughout, so read them, and the contributor counts derived from them, as the real signal. Data health has the measurements.

Top contributors

Pushes, PRs, issues, reviews and comments — stars and forks excluded, so this is contribution rather than popularity

ContributorContributionsPushesPRsComments
zakwatts6131714
allcontributors[bot]7412
felix-e-h-p2002
Sukh-P1000
captainhaddock181010

Recent activity

Latest issues, pull requests and releases

  • Issue#13zakwatts2025-05-13 15:44
    Sat data on GCP disk with duplicate timestamps
  • Issue comment#13zakwatts2025-05-13 15:43
    Sat data on GCP disk with duplicate timestamps
  • Issue comment#13zakwatts2025-05-08 09:20
    Sat data on GCP disk with duplicate timestamps
  • Issue comment#13zakwatts2025-05-08 09:18
    Sat data on GCP disk with duplicate timestamps
  • Issue#12zakwatts2025-05-08 09:07
    Update readme on mounted disks
  • Issue comment#4zakwatts2025-03-18 10:51
    Process Met Office extended NWP data
  • Issue#12zakwatts2025-03-11 11:42
    Update readme on mounted disks
  • Issue#7zakwatts2025-03-11 11:39
    Review 2024 sat data produced with new pipeline
  • Pull request#9zakwatts2025-02-25 11:09
  • Pull request#9zakwatts2025-02-25 11:08
  • Pull request#8zakwatts2025-02-07 17:49
  • Pull request#8zakwatts2025-02-07 17:49
  • Issue comment#7zakwatts2025-01-21 14:29
    Review 2024 sat data produced with new pipeline
  • Issue comment#7zakwatts2025-01-21 13:51
    Review 2024 sat data produced with new pipeline
  • Issue#7zakwatts2025-01-15 11:44
    Review 2024 sat data produced with new pipeline
  • Issue comment#4felix-e-h-p2025-01-06 10:13
    Process Met Office extended NWP data
  • Issue comment#4felix-e-h-p2025-01-06 10:09
    Process Met Office extended NWP data
  • Issue comment#4zakwatts2025-01-03 15:06
    Process Met Office extended NWP data
  • Issue comment#4zakwatts2025-01-03 15:03
    Process Met Office extended NWP data
  • Issue comment#4zakwatts2025-01-03 14:54
    Process Met Office extended NWP data
  • Pull request#6zakwatts2025-01-02 16:04
  • Issue comment#5allcontributors[bot]2025-01-02 16:04
    docs: add captainhaddock18 as a contributor for doc
  • Issue comment#5zakwatts2025-01-02 16:04
    docs: add captainhaddock18 as a contributor for doc
  • Pull request#5zakwatts2025-01-02 16:04
  • Issue comment#3allcontributors[bot]2025-01-02 16:04
    Fix: Updated link on the issue badge

Totals cover only the window loaded into ClickHouse and count events, not GitHub's lifetime totals — 1 stars here means stars gained during the window, not the repo's star count.