This project uses Apache Airflow to extract weather data from the OpenWeather API, process it with PySpark, and load it into Azure SQL Database. Intermediate data is stored in Azure Blob Storage. The pipeline runs hourly, automating the ETL process for multiple cities, and showcases a cloud-based data engineering solution.
active 2024-10-06 → 2025-01-18 (UTC)
Activity over time
Daily event counts in the loaded window
Line chart, 105 days from 2024-10-06 to 2025-01-18. Pushes: 16 total, peak 12 in a day. Pull requests: 0 total, peak 0 in a day. Issues: 0 total, peak 0 in a day. Comments: 0 total, peak 0 in a day. Stars: 1 total, peak 1 in a day.
- Pushes
- Pull requests
- Issues
- Comments
- Stars
Top contributors
Pushes, PRs, issues, reviews and comments — stars and forks excluded, so this is contribution rather than popularity
| Contributor | Contributions | Pushes | PRs | Comments |
|---|---|---|---|---|
| erreduarte | 16 | 16 | 0 | 0 |
Recent activity
Latest issues, pull requests and releases
No issue or PR events — this repo's activity is pushes only.
Totals cover only the window loaded into ClickHouse and count events, not GitHub's lifetime totals — 1 stars here means stars gained during the window, not the repo's star count.