Skip to content

GoldenMatch

v3.8.0 Feature

This release adds 2 notable features for engineering teams evaluating rollout.

Published 5d Data Pipelines & ETL
✓ No known CVEs patched
Read the diff → Tool health → What is this tool? →

✓ No known CVEs patched in this version

Topics

data-cleaning data-engineering data-matching data-quality deduplication entity-resolution
+14 more
fellegi-sunter fuzzy-matching knowledge-graph llm master-data-management mcp-server polars pprl python record-linkage rust splink typescript zero-config

Summary

AI summary

Adds an opt‑in FS columnar cluster path and kernelized radial/audio_fp scorers.

Full changelog

Added

  • Opt-in FS columnar cluster path (GOLDENMATCH_FS_COLUMNAR_CLUSTER, default OFF)
    — #1811.
    On the eligible single-Fellegi-Sunter-matchkey in-memory bucket dedupe
    path, the Arrow pair stream (score_buckets_arrow) is threaded straight to the
    shipped, parity-gated columnar cluster path (build_clusters_columnar over
    _columnar_pairs_df) instead of extending the driver-resident all_pairs Python
    list[tuple]. At 14M on tight-blocking/dup-dense data that list runs to hundreds
    of millions of tuples held on the driver through scoring → clustering — the
    late-stage OOM of #1811. This removes the scoring-phase accumulator; the in-memory
    analogue of the out-of-core GOLDENMATCH_FS_OOC_ARROW_CLUSTER. Default-OFF is inert
    (byte-unchanged); eligibility mirrors the weighted columnar lane's downstream-safety
    (single matchkey, no across-files / semantic-blocking / llm / boost) plus the FS
    bucket route.
  • Kernelized radial + audio_fp scorers (17/19 kernel-backed) — #2008. The
    radial and audio-fingerprint scorers are now backed by the native score-core
    kernel (radial + audio_fp in score.rs), moving the scorer_kernels coverage
    to 17 of 19; cross-surface parity locked (test_native_perceptual_scorer_parity).
    Host code degrades gracefully to the pure-Python reference when the published
    goldenmatch-native wheel predates these symbols.

Changed

  • Dependency bumps: setuptools 81.0.0 → 83.0.0 (#2001), pyasn1 0.6.3 → 0.6.4 (#2000).

Weekly OSS security release digest.

The CVE patches and breaking changes that affected production tools this week. One email, every Sunday.

No spam, unsubscribe anytime.

Share this release

Track GoldenMatch

Get notified when new releases ship.

Sign up free

About GoldenMatch

All releases →

Related context

Related tools

Earlier breaking changes

  • v3.1.0 `GOLDENMATCH_FRAME=polars` now requires the `[polars]` extra; raises error without it.
  • vgoldencheck-v3.0.0 `inferred_type` emits neutral dtype vocabulary (str/int/uint/float/date/datetime/bool/other) instead of raw Polars dtypes.
  • vgoldencheck-v3.0.0 'inferred_type' now emits a neutral dtype vocabulary instead of raw Polars dtype strings.
  • vgoldencheck-v3.0.0 `scan_file`, `scan_dataframe`, and CLI `check` now run without Polars, using Arrow-native pyarrow.Table.
  • v3.0.0 Result frames now return pyarrow.Table instead of Polars DataFrame.

Beta — feedback welcome: [email protected]