Percentage Model Enhancements (March 2024)

We’re improving the ranges of our monitors that calculate percentages. All nullness, uniqueness, and percent zero/negative monitors will see these improvements roll out over the coming weeks. The expected ranges of these monitors may change.

Handling 0% and 100%

Previously, monitors with high volatility would sometimes not alert when a metric went to 0% or 100% because they were within the expected range, even if those values had never been observed in the past. Many cases should alert at these extreme values - imagine a NULLNESS check on a column going from 97% (some data) to 100% (no data). Ranges will no longer include 0% or 100% unless they were observed during training or marked as normal at some point in the monitor’s history.

Smaller Ranges

Ranges will now tend to be smaller so you get alerts on changes that are relatively large - such as a jump from 1% to 2% - even if they’re not large on an absolute scale. The ranges will also shrink as more new values are observed and model confidence increases.