Generic IOT Streaming Data Parser with BigQuery Sink
active 2024-03-16 → 2024-04-02 (UTC)
Partial coverage20,527 / 26,283 hourly files (78%) · 2 absent upstream · 5,753 failed, retryable2023-08-15 → 2026-08-14 (UTC)— sampled evenly across the window, so rankings and trends hold; absolute counts scale up.
Events
22
Pushes
9
Pull requests
0
Issues
10
Stars
1
Forks
0
Activity over time
Daily event counts in the loaded window
Line chart, 18 days from 2024-03-16 to 2024-04-02. Pushes: 9 total, peak 5 in a day. Pull requests: 0 total, peak 0 in a day. Issues: 10 total, peak 10 in a day. Comments: 0 total, peak 0 in a day. Stars: 1 total, peak 1 in a day.
- Pushes
- Pull requests
- Issues
- Comments
- Stars
Top contributors
Pushes, PRs, issues, reviews and comments — stars and forks excluded, so this is contribution rather than popularity
| Contributor | Contributions | Pushes | PRs | Comments |
|---|---|---|---|---|
| rtarway | 19 | 9 | 0 | 0 |
Recent activity
Latest issues, pull requests and releases
- Issue#10rtarway2024-03-23 23:18provide capability to merge 2 pipelines and apply composite alerting and monitorring e.g. temp>>200 and humidity<<30
- Issue#9rtarway2024-03-23 23:14Use a filter to start different pipeline depending on device type, measurement type etc
- Issue#8rtarway2024-03-23 23:12check why this errors out to convert from rows to schema
- Issue#7rtarway2024-03-23 23:07Ensure widowing is done based on event time at Source
- Issue#6rtarway2024-03-23 23:06allowed latness and triggering needs to be configured in master data for devices based on what is being measured and important of events
- Issue#5rtarway2024-03-23 23:02: this schema should also be made configurable in device master data
- Issue#4rtarway2024-03-23 23:02instead of hard coding the attributes to group by , use the configuration read from device master data
- Issue#3rtarway2024-03-23 23:02After we have enriched the data with master device data, check if alert conidiotns are met
- Issue#2rtarway2024-03-23 23:02can we read schema from a device master data instead of reading from class file
- Issue#1rtarway2024-03-23 23:02add side input to read data from device master data
Totals cover only the window loaded into ClickHouse and count events, not GitHub's lifetime totals — 1 stars here means stars gained during the window, not the repo's star count.