Help families in GazaDonate to the IRC to provide humanitarian aid and resettlement resources to families in Gaza
JT's Space
Articles
About
Journal
RaW
GitHub
Articles
About
Journal
RaW
GitHub

Tuesday October 7, 2025

JT Houk
Published October 7, 2025
performanceinfrastructure

Projects

The PR for the cash movement CDC stream is still under review. I followed up with the Insights team to see if they have any questions or need changes before we can merge it.

Investigations

Stephen pointed me to the "Offline mode" Usage-Based Events (UBEs) in BigQuery, so I located them, wrote queries to collect the relevant data, and started analyzing the results. The UBEs for the Register Sync event are only emitted for the register service, so I will need a different strategy to collect data from the iPad app.

I dug into Datadog and started examining endpoint call volumes, then cross-referenced those numbers with an export of AWS Cost Explorer data by service. I now have a solid estimate for the total cost of offline mode on the register service side, though I still need to do more digging for the iPad data.

While investigating, I noticed a huge spike in OpenSearch costs over a few days this year that accounts for over 30% of the total costs. I will need to look into what caused the spike and whether there are optimizations we can make.