Fixed
Details
Assignee
fookerfookerReporter
Jeff GehlbachJeff GehlbachComponents
Sprint
NoneAffects versions
Priority
Critical
Details
Details
Assignee
fooker
fookerReporter
Jeff Gehlbach
Jeff GehlbachComponents
Sprint
None
Affects versions
Priority
PagerDuty
PagerDuty
PagerDuty
Created May 19, 2020 at 9:26 PM
Updated March 11, 2021 at 3:20 AM
Resolved June 4, 2020 at 8:11 PM
Importantly, the system where we're seeing this problem is collecting on a 15-minute interval rather than the default 5-minute one. It's also worth mentioning that we had to do some custom scripting to convert the RRD repository to store-by-foreign-source.
After swinging this system's persisting to Newts, tripling the default heartbeat setting for Newts fetches, and running the RRD-to-Newts converter, we expected to see resource graphs of historical time-series data gradually fill in as the converter ran, eventually meeting up with the ongoing collection. In reality, the historical data never became visible in resource graphs, despite the data from ongoing collection being visible there.
The customer took the initiative to start doing some queries directly against the Cassandra cluster, and found that historical samples were being inserted on 60-minute boundaries rather than 15-minute ones.