Skip to content

Claumon

v0.12.0 Breaking

This release includes 1 breaking change for platform teams planning a safe upgrade.

✓ No known CVEs patched
Read the diff → Tool health → What is this tool? →

✓ No known CVEs patched in this version

Topics

anthropic claude claude-code claude-usage cli web
+5 more
developer-tools go monitoring sse token-usage

Summary

AI summary

Removed confidence badges that misreported forecast reliability.

Full changelog

Forecast model → v1.2

  • The projection interval was over-spread - the complement of the v0.11.1
    fix, not a reversal.
    That release corrected an under-spread interval by
    widening the rate-uncertainty term. This one corrects a different
    component, the path-noise term: its §5 calibration fit the variance with
    an unweighted regression of squared errors, which is heteroskedastic, so the
    few long-horizon points dominated the fit and inflated it (and the
    over-subtraction silently pinned the rate prior). On real data the over-spread
    was path-dominated, so the two fixes touch orthogonal terms of the same
    interval. v1.2 weights that regression by 1/Δt², calibrating the spread and
    reviving the prior; net, out-of-sample coverage converges toward its 80%
    target. The v1.1 spec is preserved under
    internal/forecast/archive/v1.1/; the
    math is documented in
    internal/forecast/CHANGELOG.md.

  • Removed the Low/Medium/High confidence badge. It scored how much recent
    data the forecast had, not how reliable the forecast actually was, so it
    could read "High" next to a wide interval and was uncorrelated with real
    accuracy. The 80% CI already conveys the uncertainty.

New: claumon bench

  • An out-of-sample benchmark for the forecast model: leave-one-session-out and
    temporal-holdout protocols, CRPS/pinball proper scoring with coverage, MAE,
    and bias breakdowns, segmented by engagement and horizon. Datasets are
    reproducible: frozen fixtures exported from any device's store
    (claumon bench export --db ...) and seeded synthetic regimes. A development
    and validation tool; it does not affect the dashboard.

Breaking Changes

  • Removed the Low/Medium/High confidence badge from forecast outputs

Weekly OSS security release digest.

The CVE patches and breaking changes that affected production tools this week. One email, every Sunday.

No spam, unsubscribe anytime.

Share this release

Track Claumon

Get notified when new releases ship.

Sign up free

About Claumon

All releases →

Related context

Earlier breaking changes

  • v0.14.0 Forecast model v2.1 removes CI inversion cap; interval now raw p10/p90 uncapped.

Beta — feedback welcome: [email protected]