Repository for all related to batch processing of historic data
active 2024-01-17 → 2024-09-27 (UTC)
Complete coverage26,477 / 26,477 hourly files (100%) · 2 absent upstream2023-08-15 → 2026-08-22 (UTC)
Events
173
Pushes
72
Pull requests
4
Issues
32
Stars
0
Forks
2
Activity over time
Daily event counts in the loaded window
Line chart, 255 days from 2024-01-17 to 2024-09-27. Pushes: 72 total, peak 13 in a day. Pull requests: 4 total, peak 4 in a day. Issues: 32 total, peak 11 in a day. Comments: 17 total, peak 7 in a day. Stars: 0 total, peak 0 in a day.
- Pushes
- Pull requests
- Issues
- Comments
- Stars
Top contributors
Pushes, PRs, issues, reviews and comments — stars and forks excluded, so this is contribution rather than popularity
| Contributor | Contributions | Pushes | PRs | Comments |
|---|---|---|---|---|
| edipizarro | 61 | 28 | 2 | 10 |
| kaymedinam | 25 | 23 | 2 | 0 |
| dirodriguezm | 15 | 0 | 0 | 4 |
| ignacioreyes | 15 | 15 | 0 | 0 |
| ClaudioMansillaB | 6 | 6 | 0 | 0 |
| AlxEnashi | 2 | 0 | 0 | 2 |
| ale-munozarancibia | 1 | 0 | 0 | 1 |
Recent activity
Latest issues, pull requests and releases
- Pull request#35edipizarro2024-08-13 15:32
- Pull request#36kaymedinam2024-08-13 15:20
- Pull request#36kaymedinam2024-08-13 15:19
- Pull request#35edipizarro2024-08-13 14:05
- Issue#34edipizarro2024-08-12 19:58Reprocesar datos hasta 2024
- Issue#33edipizarro2024-08-12 19:56Guardar parquets ZTF iniciales sin estampillas en S3
- Issue#32edipizarro2024-08-12 19:51Finalizar validación de datos
- Issue#31edipizarro2024-08-12 19:47Lograr correr código en modo cluster
- Issue#30edipizarro2024-04-01 13:17Crear gran script de pipeline desde avros en S3
- Issue#29edipizarro2024-03-22 19:36Usar DBParquetReader para encontrar el aid para cada oid
- Issue#28edipizarro2024-03-22 19:31Clase para Sorting Hat Step -> Crea parquet a guardar con schema SortingHat
- Issue comment#12edipizarro2024-03-14 13:40Descargar alertas desde archive ZTF a S3 en parquet
- Issue comment#17edipizarro2024-03-12 18:08Correr pipeline en EMR
- Issue#17edipizarro2024-03-12 18:08Correr pipeline en EMR
- Issue#27edipizarro2024-03-12 18:06Reprocesar datos históricos de Pipeline
- Issue comment#13edipizarro2024-03-12 17:20Procesamiento de parquets en Spark
- Issue#13edipizarro2024-03-12 17:20Procesamiento de parquets en Spark
- Issue comment#16edipizarro2024-03-12 17:17Crear pipeline que corra en spark
- Issue#16edipizarro2024-03-12 17:17Crear pipeline que corra en spark
- Issue comment#25edipizarro2024-03-12 17:16Remake Steps de la pipeline para batch processing
- Issue comment#24edipizarro2024-03-12 15:49Actualizar servicio busqueda de estampilla
- Issue#24edipizarro2024-03-12 15:49Actualizar servicio busqueda de estampilla
- Issue comment#19edipizarro2024-03-12 15:46Crear tabla de mapeo candid, oid a parquet o avro
- Issue#26edipizarro2024-03-12 15:38Realizar prueba de procesamiento
- Issue#25edipizarro2024-03-12 15:35Remake Steps de la pipeline para batch processing
Totals cover only the window loaded into ClickHouse and count events, not GitHub's lifetime totals — 0 stars here means stars gained during the window, not the repo's star count.