Release history
opik releases
Debug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive tracing, automated evaluations, and production-ready dashboards.
All releases
152 shown
- Expose MIGRATION_EXCLUDED_WORKSPACE_IDS size as a metric
- Add environment support in the SDK
- Initial commit for trace and spans envs
Full changelog
What's Changed
- [OPIK-6411] [BE] feat: expose MIGRATION_EXCLUDED_WORKSPACE_IDS size as a metric by @thiagohora in https://github.com/comet-ml/opik/pull/6647
- fix(sdk): add None input validation to heuristic metrics by @zhoufengen in https://github.com/comet-ml/opik/pull/6543
- [OPIK-6268] [SDK] feat: add environment support by @petrotiurin in https://github.com/comet-ml/opik/pull/6622
- [OPIK-6266][FE]: initial commit for the trace and spans envs; by @aadereiko in https://github.com/comet-ml/opik/pull/6630
Full Changelog: https://github.com/comet-ml/opik/compare/2.0.28...2.0.29
- Removed TOGGLE_ALERTS_ENABLED feature flag
Full changelog
What's Changed
- [NA] [BE][FE] chore: sync provider model definitions by @CometActions in https://github.com/comet-ml/opik/pull/6651
- [NA] [BE] Update model prices file by @CometActions in https://github.com/comet-ml/opik/pull/6650
- build(deps): bump software.amazon.jdbc:aws-advanced-jdbc-wrapper from 3.3.0 to 4.0.0 in /apps/opik-backend by @dependabot[bot] in https://github.com/comet-ml/opik/pull/6652
- [OPIK-6145] [FE] feat: lazy load attachments in traces and spans tables by @andriidudar in https://github.com/comet-ml/opik/pull/6645
- [OPIK-6448] [FE] refactor: remove TOGGLE_ALERTS_ENABLED feature flag by @andriidudar in https://github.com/comet-ml/opik/pull/6655
- [OPIK-6375][BE] LlmProviderAnthropic.validateRequest rejects valid Playground/SDK requests with null maxCompletionTokens by @yaricom in https://github.com/comet-ml/opik/pull/6646
Full Changelog: https://github.com/comet-ml/opik/compare/2.0.27...2.0.28
- Respect search rate limits in `search_traces` and `search_spans` (PY-SDK)
- Auto-create environments from trace ingestion (BE)
- Add LLM tools for full trace context in eval suite assertions (BE)
Full changelog
What's Changed
- [OPIK-6391] [FE] fix: send thread_model_id when adding thread comments by @andriidudar in https://github.com/comet-ml/opik/pull/6639
- fix(sdk): surface evaluation task failures by @mindbomber in https://github.com/comet-ml/opik/pull/6624
- [OPIK-6339] [PY-SDK] feat: respect search rate limits in search_traces and search_spans by @alexkuzmik in https://github.com/comet-ml/opik/pull/6629
- [OPIK-6368] [BE] feat: auto-create environments from trace ingestion by @BorisTkachenko in https://github.com/comet-ml/opik/pull/6638
- [OPIK-5745] [BE] feat: add LLM tools for full trace context in eval suite assertions by @itamargolan in https://github.com/comet-ml/opik/pull/6511
- [OPIK-6409] [BE] feat: add V1 workspace allowlist by @thiagohora in https://github.com/comet-ml/opik/pull/6631
- [NA] [PY-SDK] fix: run worker_threads=1 in the caller thread by @alexkuzmik in https://github.com/comet-ml/opik/pull/6641
- [NA] [SDK] [DOCS] Update automatically OpenAPI spec and Fern code by @CometActions in https://github.com/comet-ml/opik/pull/6642
- [OPIK-6443] [PY-SDK] fix: prevent silent data loss in client.end() due to drain/attachment re-enqueue race by @ldaugusto in https://github.com/comet-ml/opik/pull/6643
- [OPIK-6444] [PY-SDK] fix: improve streamer reliability by @alexkuzmik in https://github.com/comet-ml/opik/pull/6648
New Contributors
- @mindbomber made their first contribution in https://github.com/comet-ml/opik/pull/6624
Full Changelog: https://github.com/comet-ml/opik/compare/2.0.26...2.0.27
- Added workspaces metadata table with version, first‑trace, and migration state columns
Full changelog
What's Changed
- [NA] [SDK] [DOCS] Update automatically OpenAPI spec and Fern code by @CometActions in https://github.com/comet-ml/opik/pull/6634
- [NA] [BE] Update model prices file by @CometActions in https://github.com/comet-ml/opik/pull/6636
- [NA] [BE][FE] chore: sync provider model definitions by @CometActions in https://github.com/comet-ml/opik/pull/6637
- [OPIK-4933] [BE] feat: add workspaces metadata table for version, first-trace, migration state by @thiagohora in https://github.com/comet-ml/opik/pull/6615
Full Changelog: https://github.com/comet-ml/opik/compare/2.0.25...2.0.26
- Unify top bars across side panels
- Display recent activity on project home page
Full changelog
What's Changed
- [OPIK-6309] [FE] feat: unify top bars across side panels by @andriidudar in https://github.com/comet-ml/opik/pull/6627
- [OPIK-6177] [BE] fix: dedupe by stable dataset_item_id in experiment comparison by @JetoPistola in https://github.com/comet-ml/opik/pull/6507
- [NA] [GHA] chore: upsert PR linter comment instead of spamming by @petrotiurin in https://github.com/comet-ml/opik/pull/6632
- [OPIK-5694] [BE] fix: eliminate FORMAT Values fast-path noise in batch inserts by @ldaugusto in https://github.com/comet-ml/opik/pull/6572
- [OPIK-6370] [BE] fix: tolerate plain-string UUIDs in Redis stream deserialization by @thiagohora in https://github.com/comet-ml/opik/pull/6610
- [OPIK-6260] [BE] [FE] feat: display recent activity on project home page by @miguelgrc in https://github.com/comet-ml/opik/pull/6595
- [NA] [SDK] [DOCS] Update automatically OpenAPI spec and Fern code by @CometActions in https://github.com/comet-ml/opik/pull/6633
- [OPIK-6265] [BE] feat: add environment field to spans, traces, and threads by @BorisTkachenko in https://github.com/comet-ml/opik/pull/6608
Full Changelog: https://github.com/comet-ml/opik/compare/2.0.24...2.0.25
Default environment colors were updated.
Full changelog
What's Changed
- [NA] [BE][FE] chore: sync provider model definitions by @CometActions in https://github.com/comet-ml/opik/pull/6625
- [OPIK-6308] [BE] feat: tune shared Jersey HTTP client with pooling and timeouts by @andrescrz in https://github.com/comet-ml/opik/pull/6623
- [OPIK-6404] [BE] chore: update default environment colors by @BorisTkachenko in https://github.com/comet-ml/opik/pull/6626
Full Changelog: https://github.com/comet-ml/opik/compare/2.0.23...2.0.24
- Added skeleton loaders to Prompt and Agent Playgrounds
- Redesigned Run experiment flow in Prompt Playground
Full changelog
What's Changed
- [OPIK-6334] [FE] feat: add skeleton loaders to Prompt and Agent Playgrounds by @andriidudar in https://github.com/comet-ml/opik/pull/6618
- [OPIK-6372] [SDK] fix: merge duplicate Create messages in local emulator by @alexkuzmik in https://github.com/comet-ml/opik/pull/6613
- [OPIK-6334] [FE] fix: render page-surface assistant loader and error state full-bleed by @andriidudar in https://github.com/comet-ml/opik/pull/6620
- [OPIK-6348] [BE] fix: rename BI event key 'environment' to 'config_environment' by @petrotiurin in https://github.com/comet-ml/opik/pull/6612
- [OPIK-6346] Silent-skip playground logging when permissions are missing by @LifeXplorer in https://github.com/comet-ml/opik/pull/6574
- [OPIK-6307] [FE] feat: redesign Run experiment flow in Prompt Playground by @awkoy in https://github.com/comet-ml/opik/pull/6571
Full Changelog: https://github.com/comet-ml/opik/compare/2.0.22...2.0.23
- litellm CVE-2026-42208 — exclude versions 1.81.* through 1.83.6
- Per-model Anthropic capability map (Opus 4.7 sampling params + xhigh effort)
- Force_regen toggle for provider model sync
- Seed default environments for workspaces
Full changelog
What's Changed
- [OPIK-6244] [BE][FE] feat: per-model Anthropic capability map (Opus 4.7 sampling params + xhigh effort) by @AndreiCautisanu in https://github.com/comet-ml/opik/pull/6523
- [OPIK-6360] [INFRA] feat: add force_regen toggle to provider model sync by @AndreiCautisanu in https://github.com/comet-ml/opik/pull/6589
- [NA] [BE][FE] chore: sync provider model definitions by @CometActions in https://github.com/comet-ml/opik/pull/6597
- [NA] [SDK] [DOCS] Update automatically OpenAPI spec and Fern code by @CometActions in https://github.com/comet-ml/opik/pull/6598
- [OPIK-6263] [BE] feat: seed default environments for workspaces by @BorisTkachenko in https://github.com/comet-ml/opik/pull/6593
- [OPIK-6296] [DOCS] feat: auto-refresh PR description on git push to prevent drift by @JetoPistola in https://github.com/comet-ml/opik/pull/6546
- [OPIK-6365] [SDK] chore: mitigate litellm CVE-2026-42208 (exclude 1.81.*-1.83.6) by @andrescrz in https://github.com/comet-ml/opik/pull/6602
- [OPIK-6269] [FE] feat: improve agent configuration diff view by @andriidudar in https://github.com/comet-ml/opik/pull/6594
- [OPIK-6334] [FE] feat: add skeleton loaders on main list pages by @andriidudar in https://github.com/comet-ml/opik/pull/6604
- [OPIK-6057] [BE] fix: skip online-scoring feedback rows when judge returns null by @ldaugusto in https://github.com/comet-ml/opik/pull/6577
- [NA] [DOCS] Add changelog for 2026-05-05 by @juanferrub in https://github.com/comet-ml/opik/pull/6611
- [OPIK-6365] [BE] fix: python sandbox packages to match litellm 1.83.7 pin by @andrescrz in https://github.com/comet-ml/opik/pull/6609
- [NA] [SDK] chore: remove redundant litellm version exclusions by @petrotiurin in https://github.com/comet-ml/opik/pull/6607
- [OPIK-6269] [FE] feat: align diff dialog and version list with Figma by @andriidudar in https://github.com/comet-ml/opik/pull/6605
- [NA] [BE] Update model prices file by @CometActions in https://github.com/comet-ml/opik/pull/6616
- [NA] [BE][FE] chore: sync provider model definitions by @CometActions in https://github.com/comet-ml/opik/pull/6617
Full Changelog: https://github.com/comet-ml/opik/compare/2.0.21...2.0.22
- Add environments CRUD API for backend configuration management
Full changelog
What's Changed
- [OPIK-6274][P SDK] Enable OTEL integration test by @yaricom in https://github.com/comet-ml/opik/pull/6562
- [OPIK-6264] [BE] feat: add environments CRUD API by @BorisTkachenko in https://github.com/comet-ml/opik/pull/6563
- [OPIK-6333] [FE] Confirm before leaving agent playground while a run is in progress by @awkoy in https://github.com/comet-ml/opik/pull/6566
- [OPIK-6311] [BE] perf: push Top-N filter into dataset_items_aggr_resolved CTE by @thiagohora in https://github.com/comet-ml/opik/pull/6559
- [OPIK-6305] [BE] fix: fix user attribution and demo filtering for agent config BI events by @petrotiurin in https://github.com/comet-ml/opik/pull/6550
- [OPIK-5694] [BE] fix: stop emitting NULL into non-nullable last_updated_at on batch insert by @ldaugusto in https://github.com/comet-ml/opik/pull/6569
- [NA] [SDK] [DOCS] Update automatically OpenAPI spec and Fern code by @CometActions in https://github.com/comet-ml/opik/pull/6565
- [OPIK-6337] [DOCS] Update permissions table to match Apr 24 revamp by @LifeXplorer in https://github.com/comet-ml/opik/pull/6575
- [NA] [BE] Update model prices file by @CometActions in https://github.com/comet-ml/opik/pull/6579
- [NA] [BE][FE] chore: sync provider model definitions by @CometActions in https://github.com/comet-ml/opik/pull/6580
- [issue-6421] [FE] fix: truncate v1 SME threads list and surface items load errors by @andriidudar in https://github.com/comet-ml/opik/pull/6570
- build(deps): bump dev.langchain4j:langchain4j-bom from 1.13.0 to 1.14.0 in /apps/opik-backend by @dependabot[bot] in https://github.com/comet-ml/opik/pull/6581
- build(deps): bump org.jdbi:jdbi3-stringtemplate4 from 3.52.0 to 3.53.0 in /apps/opik-backend by @dependabot[bot] in https://github.com/comet-ml/opik/pull/6582
- build(deps): bump software.amazon.awssdk:bom from 2.42.4 to 2.44.0 in /apps/opik-backend by @dependabot[bot] in https://github.com/comet-ml/opik/pull/6583
- [OPIK-6360] [INFRA] fix: emit labels for every dropdown entry in regenerated YAML and fix path in job by @AndreiCautisanu in https://github.com/comet-ml/opik/pull/6588
- [OPIK-6311] [BE] perf: extend push-top-limit to filtered queries via slim DI ID CTE by @thiagohora in https://github.com/comet-ml/opik/pull/6567
- [OPIK-6308] [BE] fix: make online evaluation score path non-blocking end-to-end by @andrescrz in https://github.com/comet-ml/opik/pull/6584
- [NA] [SDK] [DOCS] Update automatically OpenAPI spec and Fern code by @CometActions in https://github.com/comet-ml/opik/pull/6586
- [OPIK-6248] [FE] feat: trace details main content area – tabs, message container, LLM messages, feedback scores, error callout by @awkoy in https://github.com/comet-ml/opik/pull/6568
- [NA] [BE][FE] chore: sync provider model definitions by @CometActions in https://github.com/comet-ml/opik/pull/6590
Full Changelog: https://github.com/comet-ml/opik/compare/2.0.20...2.0.21
- Auto‑generate blueprint descriptions from config changes (backend)
- Route suite assertions to assertion-results endpoint (SDK)
Full changelog
What's Changed
- [OPIK-6226] [FE] fix: agent configuration show more button issues by @andriidudar in https://github.com/comet-ml/opik/pull/6553
- [OPIK-6310] [BE] feat: auto-generate blueprint descriptions from config changes by @petrotiurin in https://github.com/comet-ml/opik/pull/6554
- [OPIK-6055] [SDK] feat: route suite assertions to assertion-results endpoint by @JetoPistola in https://github.com/comet-ml/opik/pull/6531
- [issue-6421] [FE] fix: truncate threads list and surface items load errors by @ollieagent[bot] in https://github.com/comet-ml/opik/pull/6425
- [OPIK-6088] [INFRA] fix: pre-commit hook stages phantom deletions in worktrees by @JetoPistola in https://github.com/comet-ml/opik/pull/6387
Full Changelog: https://github.com/comet-ml/opik/compare/2.0.19...2.0.20
- Python and TypeScript SDKs expose helpers for handling distributed trace headers in OpenTelemetry
- MetricsSummary cards and charts made responsive
- Experiment project migration job for V1 to V2 auto-inference
Full changelog
What's Changed
- [OPIK-6216] [SDK] perf: split judge prompts into system + user messages by @alexkuzmik in https://github.com/comet-ml/opik/pull/6509
- [OPIK-5246] [DOCS] Update Roles & Permissions table by @anastasiapyzhik in https://github.com/comet-ml/opik/pull/5851
- [NA] [DOCS] docs: remove beta notice from REST API overview by @gidim in https://github.com/comet-ml/opik/pull/6341
- [OPIK-6295] [DOCS] refactor: rename create-initiative-ticket to create-initiative-epic by @JetoPistola in https://github.com/comet-ml/opik/pull/6535
- [OPIK-6297] [CI] fix: stabilize traces page Name column E2E test by @natagh23 in https://github.com/comet-ml/opik/pull/6540
- [OPIK-5640] [FE] feat: make MetricsSummary cards and chart responsive by @andriidudar in https://github.com/comet-ml/opik/pull/6539
- [OPIK-6302] [SDK] fix: render hallucination few-shot examples correctly by @petrotiurin in https://github.com/comet-ml/opik/pull/6537
- [OPIK-6262] [FE] Gate trace, span, and thread tagging on
trace_span_thread_logby @anastasiapyzhik in https://github.com/comet-ml/opik/pull/6524 - [OPIK-6169][SDK] Python and TypeScript SDKs expose a helpers for handling distributed trace headers in OpenTelemetry by @yaricom in https://github.com/comet-ml/opik/pull/6481
- [OPIK-6291] [DOCS] feat: surface PR-level review bodies in /address-github-pr-comments by @JetoPistola in https://github.com/comet-ml/opik/pull/6536
- [OPIK-6084] [FE] feat: unify select-all pattern in menus by @andriidudar in https://github.com/comet-ml/opik/pull/6547
- [OPIK-6184] [BE] feat: experiment project migration job (V1 -> V2 auto-inference) by @andrescrz in https://github.com/comet-ml/opik/pull/6530
- [OPIK-5637] [FE] fix: match agent sandbox empty state avatar to active project by @andriidudar in https://github.com/comet-ml/opik/pull/6548
- [OPIK-6306] [FE] Load assistant shell from manifestBase by @awkoy in https://github.com/comet-ml/opik/pull/6549
- docs: fix grammar, typos, and cleanup across docs and TS SDK by @zhoufengen in https://github.com/comet-ml/opik/pull/6544
- [OPIK-6207] [FE] Update optimization runs empty state and page title by @miguelgrc in https://github.com/comet-ml/opik/pull/6485
- [OPIK-6069] [FE] Animate refresh buttons (shared RefreshButton) by @awkoy in https://github.com/comet-ml/opik/pull/6529
- [OPIK-6245] [FE] feat: show Ollie version in AppDebugInfo by @JetoPistola in https://github.com/comet-ml/opik/pull/6551
- [OPIK-6314] [DOCS] docs: branch worktrees off origin/main automatically by @JetoPistola in https://github.com/comet-ml/opik/pull/6556
- [OPIK-6054] [SDK] feat: route suite assertion results through PUT /v1/private/assertion-results by @JetoPistola in https://github.com/comet-ml/opik/pull/6532
- [OPIK-6248] [FE] feat: trace details main content area – skeleton loader + tag colors by @awkoy in https://github.com/comet-ml/opik/pull/6552
- [OPIK-6173] [BE] Fix experiments with ZERO_UUID aggregate project_id not appearing in experiment list by @miguelgrc in https://github.com/comet-ml/opik/pull/6508
- [NA] [BE] Update model prices file by @CometActions in https://github.com/comet-ml/opik/pull/6557
New Contributors
- @natagh23 made their first contribution in https://github.com/comet-ml/opik/pull/6540
- @zhoufengen made their first contribution in https://github.com/comet-ml/opik/pull/6544
Full Changelog: https://github.com/comet-ml/opik/compare/2.0.18...2.0.19
- Trace/thread ID visibility and View trace panel in annotation queue SME flow
- P8-P9 workspace permissions
- output_json/input_json support in rule editor filter UI
Full changelog
What's Changed
- [NA] [SDK] test: stabilize e2e verifiers + rate-limit unit test, drop unit-test coverage by @alexkuzmik in https://github.com/comet-ml/opik/pull/6516
- [NA] Update end2end_suites_typescript.yml by @AndreiCautisanu in https://github.com/comet-ml/opik/pull/6522
- [OPIK-6201] [FE] fix: navigation sidebar styling pass by @andriidudar in https://github.com/comet-ml/opik/pull/6495
- [NA] [SDK] [DOCS] Update automatically OpenAPI spec and Fern code by @CometActions in https://github.com/comet-ml/opik/pull/6519
- [OPIK-6058] [FE] Add output_json/input_json support to rule editor filter UI by @miguelgrc in https://github.com/comet-ml/opik/pull/6460
- [OPIK-6201] [FE] fix: 4px gap between collapsed sidebar menu items by @andriidudar in https://github.com/comet-ml/opik/pull/6525
- [OPIK-6228] [SDK] docs: clarify create_blueprint and update_blueprint docstrings by @petrotiurin in https://github.com/comet-ml/opik/pull/6526
- [OPIK-6252] [DOCS] Fix SAML SP Entity ID / ACS URL guidance by @LifeXplorer in https://github.com/comet-ml/opik/pull/6521
- [OPIK-5792] [FE] fix: Playground UI regressions by @awkoy in https://github.com/comet-ml/opik/pull/6527
- [OPIK-5746] [FE] feat: show trace/thread ID and "View trace" panel in annotation queue SME flow for Opik 2.0 by @fschlz in https://github.com/comet-ml/opik/pull/6336
- [NA] [BE][FE] chore: sync provider model definitions by @CometActions in https://github.com/comet-ml/opik/pull/6534
- [OPIK-6251] [DOCS] Add missing P0-P3 permissions to docs table by @anastasiapyzhik in https://github.com/comet-ml/opik/pull/6515
- [OPIK-6272] [BE] feat: add P8-P9 workspace permissions and annotate endpoints by @LifeXplorer in https://github.com/comet-ml/opik/pull/6528
Full Changelog: https://github.com/comet-ml/opik/compare/2.0.17...2.0.18
- Workspace permission levels (P4-P6)
- Assertion-results batch endpoints
- Tag autocomplete in filter UIs and agent runner improvements
Full changelog
What's Changed
- [OPIK-6164] [FE] fix: unify experiment items ID column label to "Item ID" by @awkoy in https://github.com/comet-ml/opik/pull/6502
- [OPIK-6217] [SDK] perf: e2e test isolation + introduce pytest-xdist for parallel execution by @alexkuzmik in https://github.com/comet-ml/opik/pull/6499
- [OPIK-6239] [BE] feat: add P4-P6 workspace permissions and annotate endpoints by @LifeXplorer in https://github.com/comet-ml/opik/pull/6506
- [NA] [BE][FE] chore: sync provider model definitions by @CometActions in https://github.com/comet-ml/opik/pull/6512
- [OPIK-4723] View optimization runs permission by @anastasiapyzhik in https://github.com/comet-ml/opik/pull/6503
- [OPIK-6072] [FE] feat: add connection steps to agent runner empty state by @petrotiurin in https://github.com/comet-ml/opik/pull/6501
- [NA] [BE] refactor: replace opik-telemetry-extension with OTel YAML view config by @thiagohora in https://github.com/comet-ml/opik/pull/6510
- [OPIK-6040] [FE/BE] Deployment-level default rows-per-page for Experiments tables by @awkoy in https://github.com/comet-ml/opik/pull/6463
- [OPIK-6210] [DOCS] feat: set up Sentry MCP by @alexkuzmik in https://github.com/comet-ml/opik/pull/6505
- [OPIK-6048] [BE] feat: add dedicated assertion-results batch endpoints by @JetoPistola in https://github.com/comet-ml/opik/pull/6391
- [OPIK-5912] [FE] feat: add tag autocomplete to filter UIs by @andriidudar in https://github.com/comet-ml/opik/pull/6517
- [OPIK-6257] [FE] Gate create experiment buttons on permission by @anastasiapyzhik in https://github.com/comet-ml/opik/pull/6518
Full Changelog: https://github.com/comet-ml/opik/compare/2.0.16...2.0.17
- Permission COMMENT_WRITE removed in favor of TRACE_SPAN_THREAD_ANNOTATE
- Azure OpenAI REST API support via Custom LLM provider
- LLM model list fetched from backend registry with CDN-driven labels
Full changelog
What's Changed
- build(deps): bump opentelmetry.version from 2.26.0 to 2.27.0 in /apps/opik-backend by @dependabot[bot] in https://github.com/comet-ml/opik/pull/6494
- [OPIK-4551] [BE] [FE] [DOCS] feat: support Azure OpenAI REST API via Custom LLM provider by @thiagohora in https://github.com/comet-ml/opik/pull/6474
- [OPIK-6225] [BE] Permissions: drop COMMENT_WRITE in favor of TRACE_SPAN_THREAD_ANNOTATE by @LifeXplorer in https://github.com/comet-ml/opik/pull/6496
- [OPIK-5021] [BE][FE] feat: fetch LLM model list from backend registry with CDN-driven labels by @AndreiCautisanu in https://github.com/comet-ml/opik/pull/6410
- [OPIK-6195] Permissions P3 fixes by @anastasiapyzhik in https://github.com/comet-ml/opik/pull/6475
- [OPIK-5968] [FE] fix: disable Run button and show tooltip when required sandbox inputs are empty by @petrotiurin in https://github.com/comet-ml/opik/pull/6484
- [OPIK-6227] [TESTS] chore: refresh playground models_config tested models by @AndreiCautisanu in https://github.com/comet-ml/opik/pull/6498
- [OPIK-6074] [FE] Add Ollie button in mobile header instead of collapsed sidebar by @miguelgrc in https://github.com/comet-ml/opik/pull/6486
- [NA] [TESTS] stop testing opus 4.7 in online scoring by @AndreiCautisanu in https://github.com/comet-ml/opik/pull/6500
- [OPIK-5964] [FE] fix: highlight added/removed prompts in agent config diff by @BorisTkachenko in https://github.com/comet-ml/opik/pull/6497
Full Changelog: https://github.com/comet-ml/opik/compare/2.0.15...2.0.16
Minor fixes and improvements.
Full changelog
What's Changed
- [issue-6025] [P-SDK] fix: mapping callables not reading task output by @kriogenia in https://github.com/comet-ml/opik/pull/6026
- Update documentation_deploy.yml by @jverre in https://github.com/comet-ml/opik/pull/6479
- [OPIK-4722] Optimization studio use permission by @anastasiapyzhik in https://github.com/comet-ml/opik/pull/6478
- [OPIK-6153] [OPIK-6151] [FE] perf: landing-route fast path for PermissionsGuard and WorkspacePreloader by @andriidudar in https://github.com/comet-ml/opik/pull/6477
- [OPIK-6211] [BE] fix: item assertions fetched from wrong test suite version by @itamargolan in https://github.com/comet-ml/opik/pull/6480
- [OPIK-5882] [PSDK] perf: optimize and stabilize Python tests by @alexkuzmik in https://github.com/comet-ml/opik/pull/6423
- [NA] [DOCS] expand privacy guidance in create-pr skill by @thiagohora in https://github.com/comet-ml/opik/pull/6482
- [OPIK-6214] [FE] fix: clear stale experiment results on version/dataset switch by @itamargolan in https://github.com/comet-ml/opik/pull/6483
- [OPIK-6209] [CI] perf: reduce SDK E2E matrix to min+max on BE-only PRs by @JetoPistola in https://github.com/comet-ml/opik/pull/6476
- [NA] [BE][FE] chore: sync provider model definitions by @CometActions in https://github.com/comet-ml/opik/pull/6491
- [NA] [BE] Update model prices file by @CometActions in https://github.com/comet-ml/opik/pull/6490
- build(deps): bump commons-io:commons-io from 2.21.0 to 2.22.0 in /apps/opik-backend by @dependabot[bot] in https://github.com/comet-ml/opik/pull/6493
- build(deps): bump com.mysql:mysql-connector-j from 9.6.0 to 9.7.0 in /apps/opik-backend by @dependabot[bot] in https://github.com/comet-ml/opik/pull/6492
Full Changelog: https://github.com/comet-ml/opik/compare/2.0.14...2.0.15
- Distributed headers support for OTEL
- Required field for entrypoint parameters
- Playground experiment UX improvements
Full changelog
What's Changed
- [OPIK-6168][BE] Add support for distributed headers to OPIK OTEL endpoint by @yaricom in https://github.com/comet-ml/opik/pull/6461
- [OPIK-6102] [BE] [FE] [SDK] feat: add required field to entrypoint parameters by @petrotiurin in https://github.com/comet-ml/opik/pull/6443
- [OPIK-5856] [FE] refactor: centralize /v1 docs prefix + fix 8 broken docs URLs by @JetoPistola in https://github.com/comet-ml/opik/pull/6456
- [NA] [SDK] [DOCS] Update automatically OpenAPI spec and Fern code by @CometActions in https://github.com/comet-ml/opik/pull/6464
- [OPIK-5793] [FE][BE] feat: playground experiment UX improvements for test suites by @itamargolan in https://github.com/comet-ml/opik/pull/6361
- [NA] [SDK] [DOCS] Update automatically OpenAPI spec and Fern code by @CometActions in https://github.com/comet-ml/opik/pull/6467
- [NA] [BE] Update model prices file by @CometActions in https://github.com/comet-ml/opik/pull/6469
- [NA] [BE][FE] chore: sync provider model definitions by @CometActions in https://github.com/comet-ml/opik/pull/6470
- [OPIK-6202] [FE] [DOCS] fix: explainer docs anchors and wrapper re-exports by @JetoPistola in https://github.com/comet-ml/opik/pull/6472
- [OPIK-6194] [BE+FE] fix: remove trace_tag workspace permission by @LifeXplorer in https://github.com/comet-ml/opik/pull/6468
- [OPIK-6206] [FE] fix: thread sidebar scrolling by @andriidudar in https://github.com/comet-ml/opik/pull/6473
- [OPIK-5985] [FE] fix: resolve endless loading state on Agent Configuration page by @BorisTkachenko in https://github.com/comet-ml/opik/pull/6389
Full Changelog: https://github.com/comet-ml/opik/compare/2.0.13...2.0.14
Minor fixes and improvements.
Full changelog
What's Changed
- [OPIK-6099] [SDK] fix: infer provider from LitellmModel prefix in OpikTracingProcessor by @alexkuzmik in https://github.com/comet-ml/opik/pull/6432
- [NA] [BE][FE] chore: sync provider model definitions by @CometActions in https://github.com/comet-ml/opik/pull/6450
- [NA] [BE] Update model prices file by @CometActions in https://github.com/comet-ml/opik/pull/6449
- [OPIK-6174]: Fix members search by @anastasiapyzhik in https://github.com/comet-ml/opik/pull/6453
- [NA] [DOCS] update docs announcement banner by @cbordz in https://github.com/comet-ml/opik/pull/6447
- [NA] [SDK] chore: better exception for evaluate_experiment with no te… by @kriogenia in https://github.com/comet-ml/opik/pull/5855
- [OPIK-6150] [FE] perf: don't block app render on workspace version verify by @andriidudar in https://github.com/comet-ml/opik/pull/6452
- [OPIK-6159] [FE] fix: UX polish for assertions UI across suite dialogs by @itamargolan in https://github.com/comet-ml/opik/pull/6445
- [OPIK-6143] Add missing permission guards by @anastasiapyzhik in https://github.com/comet-ml/opik/pull/6442
- [NA] [BE] Fix silently-dropped demo experiment items in prod by @jverre in https://github.com/comet-ml/opik/pull/6454
- [NA] [BE] Exclude demo eval suite from opik_eval_suite_created / _run BI events by @jverre in https://github.com/comet-ml/opik/pull/6457
- [OPIK-6065] [FE] fix: trace and thread details UI/UX polish by @miguelgrc in https://github.com/comet-ml/opik/pull/6393
- [OPIK-6037] [FE] fix: vertically center empty state on Datasets and Test Suites by @awkoy in https://github.com/comet-ml/opik/pull/6458
- [NA]: Update titles and slugs for prompt and agent playgrounds by @LeoRoccoBreedt in https://github.com/comet-ml/opik/pull/6462
- [OPIK-6150] [FE] fix: preserve deep-link URL on workspace version mismatch by @andriidudar in https://github.com/comet-ml/opik/pull/6459
- [OPIK-6192][FE]: onboarding updates; by @aadereiko in https://github.com/comet-ml/opik/pull/6455
New Contributors
- @kriogenia made their first contribution in https://github.com/comet-ml/opik/pull/5855
Full Changelog: https://github.com/comet-ml/opik/compare/2.0.12...2.0.13
- New Opik experience toggle for v1 users
- Skills integration in quickstart guide
- P3 workspace permission annotations
Full changelog
What's Changed
- [OPIK-6146] [BE] fix: add 3 more demo dataset names to DemoData exclusion list by @andrescrz in https://github.com/comet-ml/opik/pull/6438
- [OPIK-6161] [FE] feat: add "New Opik experience" toggle for v1 users by @andriidudar in https://github.com/comet-ml/opik/pull/6436
- [OPIK-5200] [BE] feat: add P3 workspace permission annotations by @LifeXplorer in https://github.com/comet-ml/opik/pull/5785
- [NA]: Update naming in docs for agent playground by @LeoRoccoBreedt in https://github.com/comet-ml/opik/pull/6441
- [OPIK-6144][FE]: implemenet an additioanl step to an onboarding; by @aadereiko in https://github.com/comet-ml/opik/pull/6437
- [NA] [DOCS] Restore SDK tabs on v2 quickstart by @jverre in https://github.com/comet-ml/opik/pull/6444
- [OPIK-5623][FE]: add skills to quickstart guide & redesign onboarding; by @aadereiko in https://github.com/comet-ml/opik/pull/6439
Full Changelog: https://github.com/comet-ml/opik/compare/2.0.11...2.0.12
- Improved first load time via caching and v2 defaults
- Lazy page loading with parallelized plugin imports
Full changelog
What's Changed
- [OPIK-6053] [FE] fix: sidebar menu items use exact route matching for active state by @miguelgrc in https://github.com/comet-ml/opik/pull/6394
- [NA] [DOCS] Improve Opik Connect discoverability and video quality by @jverre in https://github.com/comet-ml/opik/pull/6431
- [NA] [DOCS] Lead observability getting-started with AI coding agent flow by @jverre in https://github.com/comet-ml/opik/pull/6433
- [OPIK-6066] [FE] perf: improve first load time (cache + v2 default + lazy pages) by @andriidudar in https://github.com/comet-ml/opik/pull/6429
- [OPIK-6064] [FE] fix: gate loader on placeholder-empty state for v2 list pages by @JetoPistola in https://github.com/comet-ml/opik/pull/6395
- [OPIK-6149] [FE] perf: parallelize plugin module imports by @andriidudar in https://github.com/comet-ml/opik/pull/6434
- [OPIK-6011] [FE] fix: treat config history 404 as empty state and poll until data arrives by @petrotiurin in https://github.com/comet-ml/opik/pull/6418
- [NA] [BE][FE] chore: sync provider model definitions by @CometActions in https://github.com/comet-ml/opik/pull/6427
- [OPIK-6101] [FE] fix: preserve workspace prefix in Ollie navigate with basepath collision by @awkoy in https://github.com/comet-ml/opik/pull/6435
- [OPIK-5659] [BE] fix: delete experiment aggregates when an experiment is deleted by @thiagohora in https://github.com/comet-ml/opik/pull/6428
- [OPIK-5659] [BE] fix: prevent concurrent experiment aggregation and reduce ClickHouse query overload by @thiagohora in https://github.com/comet-ml/opik/pull/6076
- [NA] [BE] Seed test suite, prompt, agent configs, and experiments in demo data by @jverre in https://github.com/comet-ml/opik/pull/6426
Full Changelog: https://github.com/comet-ml/opik/compare/2.0.10...2.0.11
Minor fixes and improvements.
Full changelog
What's Changed
- [OPIK-6067] [SDK] fix: surface backend error details on opik connect project retrieval by @alexkuzmik in https://github.com/comet-ml/opik/pull/6406
- [OPIK-6146] [BE] fix: add demo data exclusion to OptimizationDAO.hasVersion1Optimizations by @andrescrz in https://github.com/comet-ml/opik/pull/6419
- [OPIK-6146] [BE] fix: add demo data exclusion to all V1 entity checks by @andrescrz in https://github.com/comet-ml/opik/pull/6420
Full Changelog: https://github.com/comet-ml/opik/compare/2.0.9...2.0.10
- Agent sandbox URL changed from /agent-playground to /agent-runner
- getRawItems() method added to TestSuite SDK
- getTestSuiteExperiments added to TypeScript SDK
- Opik Connect added as dedicated side-nav item
Full changelog
What's Changed
- [OPIK-5851] [SDK] fix: show "Evaluating test suite" in suite-mode progress spinner by @awkoy in https://github.com/comet-ml/opik/pull/6407
- [NA] [DOCS] Update quickstart screenshot to showcase new UI by @jverre in https://github.com/comet-ml/opik/pull/6412
- [OPIK-5822] [SDK] feat: add getRawItems() to TestSuite by @awkoy in https://github.com/comet-ml/opik/pull/6408
- [OPIK-5819] [SDK] feat: add getTestSuiteExperiments to TS SDK by @awkoy in https://github.com/comet-ml/opik/pull/6409
- [OPIK-6098] [FE] fix: move setActiveProject out of ProjectPage render by @andriidudar in https://github.com/comet-ml/opik/pull/6404
- [NA] [FE] [DOCS] Rename Ollie to Opik Connect in user-facing copy by @jverre in https://github.com/comet-ml/opik/pull/6413
- Revert "[NA] [FE] [DOCS] Rename Ollie to Opik Connect in user-facing copy" by @jverre in https://github.com/comet-ml/opik/pull/6415
- [OPIK-6091] [BE] fix: resolve opik.* submodule imports in Python sandbox by @ldaugusto in https://github.com/comet-ml/opik/pull/6396
- [OPIK-5987][FE] Agent sandbox URL uses "/agent-runner" instead of "/agent-playground" by @yaricom in https://github.com/comet-ml/opik/pull/6416
- [OPIK-6141] [FE] feat: add Opik Connect as dedicated side-nav item by @andriidudar in https://github.com/comet-ml/opik/pull/6414
Full Changelog: https://github.com/comet-ml/opik/compare/2.0.8...2.0.9
- dep: Excludes compromised litellm versions 1.82.7 and 1.82.8
- Redirect users to traces after successful onboarding
Full changelog
What's Changed
- [OPIK-5497] [SDK] fix: normalize extracted URL to prevent false mismatch warning by @petrotiurin in https://github.com/comet-ml/opik/pull/6385
- fix: exclude compromised litellm 1.82.7 and 1.82.8 by @Wadenschwinger in https://github.com/comet-ml/opik/pull/5841
- [OPIK-6077] [DOCS] docs: update Mastra integration to new Observability API by @petrotiurin in https://github.com/comet-ml/opik/pull/6405
- [OPIK-6051] [SDK] fix: include project_root in runner checklist by @awkoy in https://github.com/comet-ml/opik/pull/6388
- [OPIK-5709][FE] Eval suite version history: long version notes are truncated with ellipsis and full text not shown on hover by @yaricom in https://github.com/comet-ml/opik/pull/6399
- [OPIK-6139][FE]: redirect to traces after successful onboarding. by @aadereiko in https://github.com/comet-ml/opik/pull/6411
New Contributors
- @Wadenschwinger made their first contribution in https://github.com/comet-ml/opik/pull/5841
Full Changelog: https://github.com/comet-ml/opik/compare/2.0.7...2.0.8
Minor fixes and improvements.
Full changelog
What's Changed
- [NA] [BE][FE] chore: sync provider model definitions by @CometActions in https://github.com/comet-ml/opik/pull/6402
- [OPIK-6026] [BE] fix: replace in-memory analytics dedup with Redis and cache anonymous ID by @andrescrz in https://github.com/comet-ml/opik/pull/6397
- [NA]: Update button labels in descriptive steps for UI interaction of Agent configuration tab by @LeoRoccoBreedt in https://github.com/comet-ml/opik/pull/6392
Full Changelog: https://github.com/comet-ml/opik/compare/2.0.6...2.0.7
- Onboarding step 2 redesigned with updated CTAs and demo banner
- Added ability to navigate to previous onboarding step
- Improved UX consistency in test suite add/edit item interface
Full changelog
What's Changed
- [OPIK-6027] [FE] feat: rework onboarding step 2 CTAs and demo banner by @andriidudar in https://github.com/comet-ml/opik/pull/6398
- [OPIK-6090] [FE] fix: improve test suite add/edit item UX consistency by @itamargolan in https://github.com/comet-ml/opik/pull/6400
- [OPIK-6097][FE]: add previous onboarding flow; by @aadereiko in https://github.com/comet-ml/opik/pull/6401
Full Changelog: https://github.com/comet-ml/opik/compare/2.0.5...2.0.6
## What's Changed * [OPIK-6042][FE]: agent config and thread views responsivennes are fixed;
Full changelog
What's Changed
- [OPIK-6042][FE]: agent config and thread views responsivennes are fixed; by @aadereiko in https://github.com/comet-ml/opik/pull/6376
Full Changelog: https://github.com/comet-ml/opik/compare/2.0.4...2.0.5
- project_name override parameter in evaluate functions is deprecated
- Per-variant Run/Stop buttons in Playground experiment mode
- Parallelized project trace exports with improved performance
Full changelog
What's Changed
- [OPIK-6036] [FE] fix: namespace v2 agent-onboarding key by user by @awkoy in https://github.com/comet-ml/opik/pull/6372
- [NA] [SDK] perf: remove unconditional page sleeps and parallelize project trace export by @dsblank in https://github.com/comet-ml/opik/pull/6359
- [OPIK-5973] [BE] perf: optimize thread list/count queries and push down thread_id filter by @thiagohora in https://github.com/comet-ml/opik/pull/6358
- [OPIK-6045] [BE] Fix silent trace loss in demo data creation by @ldaugusto in https://github.com/comet-ml/opik/pull/6386
- [OPIK-5364] [DOCS] fix: write diagrams to main repo root so worktree links resolve by @JetoPistola in https://github.com/comet-ml/opik/pull/6390
- [OPIK-6004] [SDK] feat: deprecate project_name override in evaluate functions by @alexkuzmik in https://github.com/comet-ml/opik/pull/6379
- [OPIK-6073] [FE] feat: add per-variant Run/Stop button in Playground experiment mode by @awkoy in https://github.com/comet-ml/opik/pull/6377
Full Changelog: https://github.com/comet-ml/opik/compare/2.0.3...2.0.4
- TestSuite import/export methods in Python SDK
- Workspace and API key CLI arguments for opik connect/endpoint
- Demo project onboarding flow
Full changelog
What's Changed
- [OPIK-5950] [FE] fix: surface no-agents-registered state in agent sandbox by @andriidudar in https://github.com/comet-ml/opik/pull/6351
- [OPIK-5965] [SDK] fix: resolve string annotations in extract_params to prevent spurious warnings by @petrotiurin in https://github.com/comet-ml/opik/pull/6352
- [OPIK-5420] [FE] feat: show skeleton cells for running experiments by @JetoPistola in https://github.com/comet-ml/opik/pull/6370
- [OPIK-6052] [FE] fix: unify sidebar collapse/expand behavior across pages by @miguelgrc in https://github.com/comet-ml/opik/pull/6360
- [OPIK-6043] [FE] fix: set logs page title to "Logs" (+OPIK-5462 project dashboards title) by @andriidudar in https://github.com/comet-ml/opik/pull/6371
- [OPIK-6082] [DOCS] docs: add assignee pod label step to /comet:create-jira-ticket by @JetoPistola in https://github.com/comet-ml/opik/pull/6374
- [NA] [BE] Set forceWorkspaceVersion disabled by default. OSS Opik V2. by @andrescrz in https://github.com/comet-ml/opik/pull/6380
- [OPIK-6078] [FE] fix: pass troubleshooting hash as second arg to buildDocsUrl by @JetoPistola in https://github.com/comet-ml/opik/pull/6381
- [OPIK-5921] [CI] ci: decouple guardrails tests into dedicated workflows by @JetoPistola in https://github.com/comet-ml/opik/pull/6283
- [OPIK-5316] [INFRA] feat: add opt-in worktree support to work-on-jira-ticket skill by @JetoPistola in https://github.com/comet-ml/opik/pull/5940
- [OPIK-5806] [Python SDK] feat: add TestSuite import/export methods by @alexkuzmik in https://github.com/comet-ml/opik/pull/6350
- [OPIK-5279] [SDK] fix: validate prompt sync before creating agent config blueprint by @petrotiurin in https://github.com/comet-ml/opik/pull/6378
- [OPIK-6027] [FE] feat: add demo project button in onboarding and demo project banner by @andriidudar in https://github.com/comet-ml/opik/pull/6346
- [OPIK-6086][FE]: use skills for 95% of users during v2 onboarding; by @aadereiko in https://github.com/comet-ml/opik/pull/6383
- [OPIK-5890] [BE][FE] feat: add optimization flow analytics events by @nLamprok in https://github.com/comet-ml/opik/pull/6356
- [OPIK-6049] [SDK][FE] feat: add --workspace and --api-key to opik connect/endpoint CLI by @itamargolan in https://github.com/comet-ml/opik/pull/6364
- [NA] [CI] fix: force V1 workspace version in post-merge E2E tests by @andrescrz in https://github.com/comet-ml/opik/pull/6384
Full Changelog: https://github.com/comet-ml/opik/compare/2.0.2...2.0.3
Minor fixes and improvements.
Full changelog
What's Changed
- [OPIK-6026] [BE] Onboarding analytics events by @nLamprok in https://github.com/comet-ml/opik/pull/6333
- [NA] [DOCS] Opik 2.0 docs refactor: v2 pages, versioning, and navigation by @jverre in https://github.com/comet-ml/opik/pull/6339
- [NA] [BE] Update model prices file by @CometActions in https://github.com/comet-ml/opik/pull/6342
- [NA] [BE][FE] chore: sync provider model definitions by @CometActions in https://github.com/comet-ml/opik/pull/6343
Full Changelog: https://github.com/comet-ml/opik/compare/1.11.13...1.11.14
- Experiment configuration linked to agent config versions
- Error reporting added for opik connect CLI
Full changelog
What's Changed
- [OPIK-6013] [FE] fix: CSV upload overlay stuck when server-side processing enabled by @itamargolan in https://github.com/comet-ml/opik/pull/6330
- [OPIK-6031] [FE] fix: resize auto-resize textarea when tab becomes visible by @JetoPistola in https://github.com/comet-ml/opik/pull/6334
- [OPIK-5757] [FE][SDK] Link experiment configuration to agent config versions by @miguelgrc in https://github.com/comet-ml/opik/pull/6302
- [NA] [SDK] feat: update Sentry DSN and add error reporting for opik connect CLI by @alexkuzmik in https://github.com/comet-ml/opik/pull/6335
Full Changelog: https://github.com/comet-ml/opik/compare/1.11.12...1.11.13
- Playground 'Test on' split into Dataset/Test Suite dropdown
- Add-to-dataset action improvements with SDK code highlighting
- Exposed resources on backend init containers for Helm
- run_tests removes project_name parameter
- ConfigMismatch exception now raised when prompt belongs to different project than config
- Lightweight _opik base package for fast metric imports
- Pairing status screen with V1/V2 routing
- Workspace sidebar menu order and navigation updates
- Opik Connect Pair Link SDK support
- Onboarding analytics events
Full changelog
What's Changed
- [OPIK-5229] [FE] feat: add onboarding analytics events by @nLamprok in https://github.com/comet-ml/opik/pull/6299
- Update ConnectAgentStep.tsx by @jverre in https://github.com/comet-ml/opik/pull/6309
- [OPIK-5922] [SDK] Opik Connect Pair Link by @collincunn in https://github.com/comet-ml/opik/pull/6304
Full Changelog: https://github.com/comet-ml/opik/compare/1.11.8...1.11.9
- Prompts removed and blueprints updated for v2
- Add 'View trace' button and trace details panel to trace-scoped annotation queues
- Rework agent configuration form expanded/collapsed state
- Auto syntax-check after file edits in SDK bridge handlers
Full changelog
What's Changed
- [NA] [TESTS] test: add thread ingestion load script for threads by @andrescrz in https://github.com/comet-ml/opik/pull/6291
- [OPIK-5743][FE]: view trace span improve; by @aadereiko in https://github.com/comet-ml/opik/pull/6172
- [OPIK-5907] [FE] fix: prevent home page blink on stats refetch by @andriidudar in https://github.com/comet-ml/opik/pull/6293
- [OPIK-5931] [FE] feat: rework agent configuration form expanded/collapsed state by @JetoPistola in https://github.com/comet-ml/opik/pull/6290
- [NA] [BE] fix: materialize missing skip indexes on traces by @thiagohora in https://github.com/comet-ml/opik/pull/6272
- [NA] [SDK] feat: auto syntax-check after file edits in bridge handlers by @Lothiraldan in https://github.com/comet-ml/opik/pull/6191
- [OPIK-5845] [BE] fix: fix dataset expansion for test suites and all LLM providers by @itamargolan in https://github.com/comet-ml/opik/pull/6277
- [OPIK-5772][FE]: remove prompts and update blueprints for v2; by @aadereiko in https://github.com/comet-ml/opik/pull/6237
- [OPIK-5746] [FE] feat: add "View trace" button and trace details panel to trace-scoped annotation queues by @fschlz in https://github.com/comet-ml/opik/pull/6145
- [NA] [SDK] [DOCS] Update automatically OpenAPI spec and Fern code by @CometActions in https://github.com/comet-ml/opik/pull/6300
- [OPIK-5817][OPIK-5820][OPIK-5824][OPIK-5825][OPIK-5826][TS SDK] TestSuite refactoring by @yaricom in https://github.com/comet-ml/opik/pull/6260
- [OPIK-5958] [FE] fix: rename step 3 from "Publish and deploy" to "Run your agent" by @petrotiurin in https://github.com/comet-ml/opik/pull/6301
- [OPIK-5852][TS SDK] Pass rate calculation should exclude items without assertions by @yaricom in https://github.com/comet-ml/opik/pull/6297
Full Changelog: https://github.com/comet-ml/opik/compare/1.11.7...1.11.8
- Rename assertions → globalAssertions and executionPolicy → globalExecutionPolicy in TS SDK
- Rename evaluation_suite → test_suite across entire codebase
- Replace suite.run() with new runTests() top-level function
- Agent configuration version UI revamp with improved edit flow
- Agent sandbox disconnect from UI
- Item-level assertion and execution policy update methods
- Renamed evaluation_suite to test_suite
- Agent spec integration in Python SDK
- Responsive agent configs
- Comet-only project home with embedded Ollie
## What's Changed * [OPIK-5869] [SDK] Bugs in Connect and Endpoint Flow
- Evaluation suites now supported in playground
- Prompt and ChatPrompt resilience to backend sync failures
- Attachment download/upload support in opik export/import
Full changelog
What's Changed
- [OPIK-5696][TS SDK] Align TS wizard to also save project_name to ~/.opik.config by @yaricom in https://github.com/comet-ml/opik/pull/6134
- [OPIK-5731] [FE] Add unsaved changes warning to agent configuration editor by @YarivHashaiComet in https://github.com/comet-ml/opik/pull/6151
- [OPIK-5184] [SDK] feat: Make Prompt and ChatPrompt resilient to backend sync failures by @petrotiurin in https://github.com/comet-ml/opik/pull/6125
- [OPIK-5732] [FE] Add input validation to agent sandbox to prevent empty submissions by @thiagohora in https://github.com/comet-ml/opik/pull/6140
- [OPIK-5656] [FE] fix: remove "Run an experiment" CTA from add-to-evaluation-suite toast by @YarivHashaiComet in https://github.com/comet-ml/opik/pull/6085
- [OPIK-5650] [BE/FE] feat: support evaluation suites in playground by @itamargolan in https://github.com/comet-ml/opik/pull/6092
- [OPIK-5455] [FE] feat: add Opik logo to v2 onboarding screens by @JetoPistola in https://github.com/comet-ml/opik/pull/6156
- [OPIK-5758] [FE] fix: persist eval suite experiment state across page refresh by @itamargolan in https://github.com/comet-ml/opik/pull/6158
- [OPIK-5596] [FE] Unify pairing codes between agent sandbox and Ollie sidebar by @miguelgrc in https://github.com/comet-ml/opik/pull/6143
- [OPIK-5755] [FE] Remove All time option from v2 logs table time selector by @thiagohora in https://github.com/comet-ml/opik/pull/6155
- [NA] [SDK] Add env to opik connect by @collincunn in https://github.com/comet-ml/opik/pull/6144
- [OPIK-5664] [SDK][DOCS] feat: add batching warning docs page and suppress config by @alexkuzmik in https://github.com/comet-ml/opik/pull/6149
- [OPIK-5733] Fix Online Scoring for traces completed via PATCH by @ldaugusto in https://github.com/comet-ml/opik/pull/6141
- [NA] [SDK] [DOCS] Update automatically OpenAPI spec and Fern code by @CometActions in https://github.com/comet-ml/opik/pull/6157
- [OPIK-5750] [SDK] feat: add error visibility to runner TUI for crashes and crash loops by @petrotiurin in https://github.com/comet-ml/opik/pull/6154
- [OPIK-5241] [BE] infra: auto-sync llm-models-default.yaml to CDN on model update by @obezpalko in https://github.com/comet-ml/opik/pull/6126
- [OPIK-5647] [BE] fix: handle empty Redis stream messages in BaseRedisSubscriber by @andrescrz in https://github.com/comet-ml/opik/pull/6161
- [NA] [SDK] fix: harden opik export against server-side 429 rate limiting by @dsblank in https://github.com/comet-ml/opik/pull/6087
- [NA] [DOCS] update docs announcement banner by @cbordz in https://github.com/comet-ml/opik/pull/6169
- [OPIK-4903] [SDK] feat: add attachment download/upload to opik export/import by @dsblank in https://github.com/comet-ml/opik/pull/6090
- [NA] [BE] Update model prices file by @CometActions in https://github.com/comet-ml/opik/pull/6174
- [OPIK-5754] [SDK] fix(runner): validate git repository before running SearchFiles by @petrotiurin in https://github.com/comet-ml/opik/pull/6163
- [OPIK-5665] [FE] fix: allow collapsing Ollie sidebar in error state by @awkoy in https://github.com/comet-ml/opik/pull/6159
- [OPIK-5766] [BE] feat: V2 workspace allowlist for gradual rollout by @andrescrz in https://github.com/comet-ml/opik/pull/6175
Full Changelog: https://github.com/comet-ml/opik/compare/1.11.1...1.11.2
- Exclude support for search spans stream endpoint
- Batching warnings now include actionable alternatives
Full changelog
What's Changed
- [OPIK-5665] [OPIK-5386] [FE] fix: Ollie sidebar error state, retry, and keepalive recovery by @awkoy in https://github.com/comet-ml/opik/pull/6135
- [OPIK-5639] [FE] Fix nav sidebar not collapsing on resize when Ollie is expanded by @thiagohora in https://github.com/comet-ml/opik/pull/6136
- [OPIK-5270] [BE][T SDK][P SDK] feat: add exclude support to search spans stream endpoint by @andrescrz in https://github.com/comet-ml/opik/pull/6133
- [NA] [SDK] [DOCS] Update automatically OpenAPI spec and Fern code by @CometActions in https://github.com/comet-ml/opik/pull/6138
- [OPIK-5664] [E2E] fix: replace span.end() with end_time at creation by @alexkuzmik in https://github.com/comet-ml/opik/pull/6139
- [OPIK-5664] [SDK] fix: improve batching warning with actionable alternatives by @alexkuzmik in https://github.com/comet-ml/opik/pull/6142
- [OPIK-5657] [FE] fix: replace eval suite link with plain text on experiment page by @YarivHashaiComet in https://github.com/comet-ml/opik/pull/6086
Full Changelog: https://github.com/comet-ml/opik/compare/1.11.0...1.11.1
- Model registry integrated with provider routing and remote refresh capability
- Global client management API with context-wise propagation and batching warning
- Agent configuration wired to sandbox runs via mask_id
Full changelog
What's Changed
- [OPIK-5682] [FE] Wire agent config to sandbox run via mask_id by @miguelgrc in https://github.com/comet-ml/opik/pull/6082
- [OPIK-5407] [FE] fix: rename Assertions to Custom assertions in eval suite items by @awkoy in https://github.com/comet-ml/opik/pull/6111
- [NA] [FE] fix: bypass manifest fetch in dev mode for hot reload by @awkoy in https://github.com/comet-ml/opik/pull/6110
- [issue-5397] [BE] Make ClickHouse health check timeout configurable by @dsblank in https://github.com/comet-ml/opik/pull/5414
- [OPIK-5707] [BE] Fix eval suite dataset storing empty data for non-object trace input by @LifeXplorer in https://github.com/comet-ml/opik/pull/6109
- [NA] [BE] [SDK] Opik Connect by @collincunn in https://github.com/comet-ml/opik/pull/6108
- [NA] [BE][FE] chore: sync provider model definitions by @CometActions in https://github.com/comet-ml/opik/pull/6118
- [NA] [BE] Update model prices file by @CometActions in https://github.com/comet-ml/opik/pull/6117
- [NA] [SDK] [DOCS] Update automatically OpenAPI spec and Fern code by @CometActions in https://github.com/comet-ml/opik/pull/6121
- [NA] [SDK] [DOCS] Update automatically OpenAPI spec and Fern code by @CometActions in https://github.com/comet-ml/opik/pull/6116
- [OPIK-5704] [BE][SDK] fix: dataset items not returned for datasets created without project_name by @thiagohora in https://github.com/comet-ml/opik/pull/6115
- [OPIK-5699] [P SDK] feat: inherit project_name from context for all Opik operations by @alexkuzmik in https://github.com/comet-ml/opik/pull/6106
- [OPIK-5629] [SDK] feat: warn on unresolvable entrypoint parameter types by @petrotiurin in https://github.com/comet-ml/opik/pull/6113
- [OPIK-5683] [P SDK] opik configure does NOT save project_name (Python) by @yaricom in https://github.com/comet-ml/opik/pull/6093
- [OPIK-5270] [BE] perf: skip feedback score CTEs in SpanDAO when excluded by @andrescrz in https://github.com/comet-ml/opik/pull/6124
- [OPIK-5716] [BE] feat: create new blueprint from mask changes delta by @BorisTkachenko in https://github.com/comet-ml/opik/pull/6122
- [OPIK-5020] [BE] feat: wire model registry into provider routing and add remote refresh by @AndreiCautisanu in https://github.com/comet-ml/opik/pull/5863
- [NA] [SDK] [DOCS] Update automatically OpenAPI spec and Fern code by @CometActions in https://github.com/comet-ml/opik/pull/6127
- [OPIK-5664] [SDK] feat: global client management API with context-wise propagation and batching warning by @alexkuzmik in https://github.com/comet-ml/opik/pull/6123
- [OPIK-5633] [FE] Remove clickable link from trace count in experiments table by @miguelgrc in https://github.com/comet-ml/opik/pull/6114
- [OPIK-5385]: create eval suites improvement; by @aadereiko in https://github.com/comet-ml/opik/pull/6054
- [OPIK-4972] [BE] feat: update demo data to only create Opik Demo Agent Observability project by @thiagohora in https://github.com/comet-ml/opik/pull/5861
- [OPIK-5689] [BE] fix: stop retrying rate-limited LLM calls and reduce log verbosity by @ldaugusto in https://github.com/comet-ml/opik/pull/6132
Full Changelog: https://github.com/comet-ml/opik/compare/1.10.60...1.11.0
- Evaluation suite tasks support returning just agent output
- Agent Sandbox with searchable configuration selector
- Custom podMetrics support in Helm HPA template
Full changelog
What's Changed
- [OPIK-5655] [Evaluation Suite] Evaluation suite task should support returning just the agent output by @yaricom in https://github.com/comet-ml/opik/pull/6073
- [OPIK-5270] [BE][T SDK][P SDK] feat: add exclude support to search traces stream endpoint by @andrescrz in https://github.com/comet-ml/opik/pull/6098
- [OPIK-5399] [FE] fix: pass search params from assistant sidebar navigate events to router by @awkoy in https://github.com/comet-ml/opik/pull/6099
- [NA] [SDK] [DOCS] Update automatically OpenAPI spec and Fern code by @CometActions in https://github.com/comet-ml/opik/pull/6102
- [NA] [BE] [SDK] Opik Connect by @collincunn in https://github.com/comet-ml/opik/pull/6074
- Revert "[NA] [BE] [SDK] Opik Connect" by @Nimrod007 in https://github.com/comet-ml/opik/pull/6103
- [NA] [DOCS] Add live reference deployment and ingestion best practices to scaling guide by @Nimrod007 in https://github.com/comet-ml/opik/pull/6100
- [DND-843][HELM]Add custom podMetrics support to HPA template by @liyaka in https://github.com/comet-ml/opik/pull/6094
- [OPIK-5372] [FE] Add searchable configuration selector in Agent Sandbox by @miguelgrc in https://github.com/comet-ml/opik/pull/6089
- [OPIK-5270] [E2E][T SDK] test: add exclude parameter tests for search traces by @andrescrz in https://github.com/comet-ml/opik/pull/6105
- [NA] [FE] Send project onboarding stats to assistant bridge by @Lothiraldan in https://github.com/comet-ml/opik/pull/6067
- [OPIK-5270] [BE] perf: optimize feedback score CTE pipeline to reduce memory overhead by @andrescrz in https://github.com/comet-ml/opik/pull/6107
Full Changelog: https://github.com/comet-ml/opik/compare/1.10.59...1.10.60
- V2 sidebar and navigation UX redesign
- Agent Runner UI redesign
- Local Runner improvements
- SDK: Job inputs automatically cast to declared parameter types in runner
- KPI cards component added to frontend
- Onboarding prompt updated to reference /instrument command and workspace
Full changelog
What's Changed
- [OPIK-4828] [BE] Fix thread view shows no data message but then eventually loads by @thiagohora in https://github.com/comet-ml/opik/pull/5954
- [OPIK-5223][FE]: kpi cards; by @aadereiko in https://github.com/comet-ml/opik/pull/6013
- [OPIK-5326] [SDK] feat: cast job input values to declared param types in runner by @petrotiurin in https://github.com/comet-ml/opik/pull/5952
- [OPIK-5488] [FE] Update onboarding prompt to use /instrument and include workspace by @juanferrub in https://github.com/comet-ml/opik/pull/6022
- [NA] fix: restore migration 000061 and split index change into 000062 by @ldaugusto in https://github.com/comet-ml/opik/pull/6023
- [NA] [E2E] fix: increase online scoring test timeouts for GitHub-hosted runners by @AndreiCautisanu in https://github.com/comet-ml/opik/pull/6024
Full Changelog: https://github.com/comet-ml/opik/compare/1.10.57...1.10.58
- Logs table redesign
- Runner job stdout/stderr streaming
- Experiment bug fixes
- Agent Sandbox page with trace trajectory visualization and span inspection
- TraceLogsSidebar displaying full traces table in Sheet overlay
- Project metrics for interactive chart visualization
Full changelog
What's Changed
- [OPIK-5273] [BE] feat: add new project metrics for interactive chart by @BorisTkachenko in https://github.com/comet-ml/opik/pull/5949
- [NA] [FE] fix: show only regular experiments on experiments page by @awkoy in https://github.com/comet-ml/opik/pull/5957
- [OPIK-5321] [FE] Fix incorrect sizing in playground prompt header section by @miguelgrc in https://github.com/comet-ml/opik/pull/5951
- [NA] [SDK] [DOCS] Update automatically OpenAPI spec and Fern code by @CometActions in https://github.com/comet-ml/opik/pull/5953
- [OPIK-5327] [BE] feat: support in-flight trace_id reporting for runner jobs by @BorisTkachenko in https://github.com/comet-ml/opik/pull/5958
- [OPIK-5027] [FE] feat: TraceLogsSidebar — full traces table in Sheet overlay by @andriidudar in https://github.com/comet-ml/opik/pull/5962
- [NA] [FE] chore: IA revamp cleanup — git blame ignore + stale skill removal by @andriidudar in https://github.com/comet-ml/opik/pull/5969
- [OPIK-5206] [BE] feat: consume EM opikVersion for workspace version determination by @andrescrz in https://github.com/comet-ml/opik/pull/5964
- [OPIK-5206] [FE] feat: enable workspace version endpoint integration by @andrescrz in https://github.com/comet-ml/opik/pull/5970
- [OPIK-5307] [OPIK-5308] [FE] Add Agent Sandbox page by @JetoPistola in https://github.com/comet-ml/opik/pull/5947
- [NA] [SDK] [DOCS] Update automatically OpenAPI spec and Fern code by @CometActions in https://github.com/comet-ml/opik/pull/5972
- [OPIK-5312] [FE] feat: add loading state to assistant sidebar by @awkoy in https://github.com/comet-ml/opik/pull/5961
- [OPIK-5334] [FE] Use active project scope and reset playground state on project switch by @miguelgrc in https://github.com/comet-ml/opik/pull/5974
- [NA] [FE] feat: pass organizationId through assistant bridge context by @LifeXplorer in https://github.com/comet-ml/opik/pull/5968
- [OPIK-5325] [SDK] feat: report running status before local runner job execution by @petrotiurin in https://github.com/comet-ml/opik/pull/5950
- [OPIK-5305] [FE] fix: show dashboard resize handle on hover only by @andriidudar in https://github.com/comet-ml/opik/pull/5971
- [OPIK-5309] [FE] feat: add trace trajectory and span inspection to Agent Sandbox by @JetoPistola in https://github.com/comet-ml/opik/pull/5978
- [OPIK-5206] [BE] feat: add V1 entity check for alerts in workspace version by @andrescrz in https://github.com/comet-ml/opik/pull/5975
- [NA] [BE][FE] chore: sync provider model definitions by @CometActions in https://github.com/comet-ml/opik/pull/5981
- [OPIK-5191] [BE] feat: add user identity to ClickHouse log_comment by @Nimrod007 in https://github.com/comet-ml/opik/pull/5778
Full Changelog: https://github.com/comet-ml/opik/compare/1.10.55...1.10.56
- TypeScript local runner implementation
- Playground redesign
- V2 alerts and evaluation suites with project-scoped API
- Agent config Zod API and blueprint caching for TypeScript SDK
- V2 sidebar UX polish and project-scoped v2 pages
- V2 online evaluation and annotation queues
- API calls to agent config endpoints must use separate create and update paths
- API calls to Insights/Dashboards must use distinct endpoint paths
- Agent config endpoints split into separate create and update paths
- Insights and Dashboards endpoints have been separated
- v2 workspace selector with route-based TracesPage
- Python and TypeScript SDKs: new project_name/projectName parameter for datasets, prompts, and experiments
- Project-scoped alert triggers with project_id column
Full changelog
What's Changed
- [OPIK-5231] [BE] fix: prevent parallel execution of trace threads closing job by @ldaugusto in https://github.com/comet-ml/opik/pull/5814
- [OPIK-4964] [FE] feat: v2 workspace selector, split TracesPage into route pages by @andriidudar in https://github.com/comet-ml/opik/pull/5847
- [OPIK-5201] [BE] fix: split agent config create/update endpoints and add env lock by @BorisTkachenko in https://github.com/comet-ml/opik/pull/5792
- [OPIK-4961] [OPIK-5207] [P SDK] [M2] Python SDK: Add project_name parameter to dataset, prompt, and experiment methods by @yaricom in https://github.com/comet-ml/opik/pull/5684
- [NA] [INFRA] fix: persist-credentials: false for peter-evans workflows by @JetoPistola in https://github.com/comet-ml/opik/pull/5848
- [OPIK-5233] [DOCS] Update Permissions by role table by @anastasiapyzhik in https://github.com/comet-ml/opik/pull/5849
- [NA] [SDK] [DOCS] Update automatically OpenAPI spec and Fern code by @CometActions in https://github.com/comet-ml/opik/pull/5850
- [OPIK-5217] [BE] Add project_id column to alerts for project-scoped alert triggers by @thiagohora in https://github.com/comet-ml/opik/pull/5825
- [OPIK-5196] [OPIK-5197] [OPIK-5199] [FE] Add onboarding Step 2 — Connect agent tabs by @JetoPistola in https://github.com/comet-ml/opik/pull/5839
- [NA] [SDK] [DOCS] Update automatically OpenAPI spec and Fern code by @CometActions in https://github.com/comet-ml/opik/pull/5859
- [OPIK-4963] [SDK] feat: add projectName parameter to TypeScript SDK by @alexkuzmik in https://github.com/comet-ml/opik/pull/5829
- [OPIK-4518] [BE] fix: remove cross-version dedup from multi-version CTEs by @andrescrz in https://github.com/comet-ml/opik/pull/5852
- [OPIK-5194] Separate Insights from Dashboards endpoints by @anastasiapyzhik in https://github.com/comet-ml/opik/pull/5790
Full Changelog: https://github.com/comet-ml/opik/compare/1.10.50...1.10.51
## What's Changed * [NA]Bump version from 1.10.49 to 1.10.50
- Workspace-wide fallback lookups are deprecated; use project-scoped REST endpoints instead
- get_agent_config() now requires @track context — existing calls without decorator will fail
- search_threads promoted to Opik client API
- Project-scoped REST endpoints
- Case-sensitive ID filtering with STRING_EXACT field type
Full changelog
What's Changed
- [OPIK-5152] [SDK] feat: promote search_threads to Opik client API by @alexkuzmik in https://github.com/comet-ml/opik/pull/5739
- [OPIK-4865] [SDK] fix: support None values in AgentConfig blueprints by @petrotiurin in https://github.com/comet-ml/opik/pull/5759
- [OPIK-5102]: fix go to traces button; by @aadereiko in https://github.com/comet-ml/opik/pull/5764
- [NA] [CI] chore: add comment_mode: failures to test reporters by @petrotiurin in https://github.com/comet-ml/opik/pull/5762
- [OPIK-4938] [BE] Add project-scoped REST endpoints and integration tests by @thiagohora in https://github.com/comet-ml/opik/pull/5753
- [NA] [SDK] [DOCS] Update automatically OpenAPI spec and Fern code by @CometActions in https://github.com/comet-ml/opik/pull/5766
- [OPIK-5154] [BE] Add STRING_EXACT field type for case-sensitive ID filtering by @YarivHashaiComet in https://github.com/comet-ml/opik/pull/5761
- [OPIK-4938] [BE] Add X-Opik-Deprecation header for workspace-wide fallback lookups by @thiagohora in https://github.com/comet-ml/opik/pull/5760
- [OPIK-4966] [FE] feat: v2 router, page registration, and URL redirects by @andriidudar in https://github.com/comet-ml/opik/pull/5765
- [OPIK-5176] [SDK] feat: require @track context when calling get_agent_config() by @petrotiurin in https://github.com/comet-ml/opik/pull/5751
- [OPIK-5177] [FE] fix: minor UI fixes and copy changes by @awkoy in https://github.com/comet-ml/opik/pull/5768
- [OPIK-5050] [BE] fix: trace threads closing job performance and query correctness by @ldaugusto in https://github.com/comet-ml/opik/pull/5726
- [OPIK-4714] [FE] Edit dataset permission by @anastasiapyzhik in https://github.com/comet-ml/opik/pull/5722
- [NA] [BE] Update model prices file by @CometActions in https://github.com/comet-ml/opik/pull/5779
- build(deps-dev): bump com.diffplug.spotless:spotless-maven-plugin from 3.3.0 to 3.4.0 in /apps/opik-backend by @dependabot[bot] in https://github.com/comet-ml/opik/pull/5781
- build(deps): bump org.jdbi:jdbi3-stringtemplate4 from 3.51.0 to 3.52.0 in /apps/opik-backend by @dependabot[bot] in https://github.com/comet-ml/opik/pull/5780
- [NA][DOCS] Add section for running online evals retrospectively to docs by @LeoRoccoBreedt in https://github.com/comet-ml/opik/pull/5784
- [OPIK-4966] [FE] refactor: extract shared deps from v1 for v1/v2 coexistence by @andriidudar in https://github.com/comet-ml/opik/pull/5787
- [OPIK-4966] [FE] feat: clone v1 pages, layout, and pages-shared into v2 by @andriidudar in https://github.com/comet-ml/opik/pull/5791
Full Changelog: https://github.com/comet-ml/opik/compare/1.10.45...1.10.46
- Python SDK: workspace fallback behavior is deprecated; explicitly specify workspace in code
- Added project_name and project_id scoping to prompt version and experiment stream API endpoints
- Performance optimization in experiment and optimization queries using ORDER BY/LIMIT 1
- Blueprint UX improvements
Full changelog
What's Changed
- [OPIK-4449] [FE] Revert UI labels to Datasets by @awkoy in https://github.com/comet-ml/opik/pull/5741
- [OPIK-4935] [BE] feat(api): add project_name and project_id scoping to prompt version endpoints by @thiagohora in https://github.com/comet-ml/opik/pull/5736
- [NA] [BE] Ollie State Saving by @collincunn in https://github.com/comet-ml/opik/pull/5712
- Bump version to 1.10.45 by @alexkuzmik in https://github.com/comet-ml/opik/pull/5746
- [OPIK-5150] [BE] perf: replace FINAL with ORDER BY/LIMIT 1 BY in experiment and optimization queries by @itamargolan in https://github.com/comet-ml/opik/pull/5745
- [OPIK-4962] [M2] Python SDK: Implement deprecation warning on workspace fallback by @yaricom in https://github.com/comet-ml/opik/pull/5744
- [OPIK-4955] [SDK] refactor: blueprint agent config architecture by @petrotiurin in https://github.com/comet-ml/opik/pull/5721
- [OPIK-4942] [BE] Option E — Separate assertion_results table by @JetoPistola in https://github.com/comet-ml/opik/pull/5716
- [OPIK-5017] [BE] refactor: local runner architecture follow-up improvements by @BorisTkachenko in https://github.com/comet-ml/opik/pull/5715
- [NA] [E2E] fix: update datasets page-objects for new UI labels by @NatZol in https://github.com/comet-ml/opik/pull/5747
- [NA] [SDK] [DOCS] Update automatically OpenAPI spec and Fern code by @CometActions in https://github.com/comet-ml/opik/pull/5756
- [NA] Revert "[OPIK-4690] [FE] Add user role update permission to Members tab" by @anastasiapyzhik in https://github.com/comet-ml/opik/pull/5742
- [NA] [BE] Update model prices file by @CometActions in https://github.com/comet-ml/opik/pull/5757
- [OPIK-4935] [BE] feat(api): add project_name scoping to experiment stream endpoints by @thiagohora in https://github.com/comet-ml/opik/pull/5748
- [OPIK-5102][FE]: blueprints ux improvements; by @aadereiko in https://github.com/comet-ml/opik/pull/5743
- [OPIK-4449] [FE] Fix eval suite Assertions tab and Go to traces button by @awkoy in https://github.com/comet-ml/opik/pull/5752
- [OPIK-5167] [BE] fix: remove user_role_update permission by @LifeXplorer in https://github.com/comet-ml/opik/pull/5754
Full Changelog: https://github.com/comet-ml/opik/compare/1.10.44...1.10.45
- TypeScript Evaluation Suite Phase 2 with assertions-only API, partial updates, and batch insert
- Dashboard refinements for general availability
- Optimizer screens redesign
- Blueprint names with auto-increment versioning
- Trace tag permission
Full changelog
What's Changed
- [OPIK-4956] [BE] feat: add blueprint name with auto-increment versioning by @BorisTkachenko in https://github.com/comet-ml/opik/pull/5682
- [NA] [BE] fix: use correct dataset/prompt builders in RequiredPermissionsTest by @LifeXplorer in https://github.com/comet-ml/opik/pull/5692
- [NA] [SDK] fix: normalize assertion_results to dicts to prevent TypeError after Fern regeneration by @JetoPistola in https://github.com/comet-ml/opik/pull/5696
- [OPIK-4701] Tag trace permission by @anastasiapyzhik in https://github.com/comet-ml/opik/pull/5678
- [OPIK-4902] [BE] fix: handle missing dataset_version_id in output columns query by @anastasiapyzhik in https://github.com/comet-ml/opik/pull/5662
- [OPIK-4992] [Python SDK] fix: use indexed keys in LLMJudge response schema for cross-provider compatibility by @alexkuzmik in https://github.com/comet-ml/opik/pull/5690
Full Changelog: https://github.com/comet-ml/opik/compare/1.10.41...1.10.42
- Project ID and project name resolution for datasets, prompts, and dashboards
- P1 workspace permission annotations on delete and log endpoints
- Evaluation suite run experience and performance improvements
Full changelog
What's Changed
- [OPIK-4632] find_experiments dataset_deleted Parameter Validation Error by @yaricom in https://github.com/comet-ml/opik/pull/5676
- [OPIK-4931] [BE] Add project_id to datasets, prompts, and dashboards by @thiagohora in https://github.com/comet-ml/opik/pull/5664
- [OPIK-4931] [BE] Add project_name resolution for Dataset, Dashboard, and Prompt by @thiagohora in https://github.com/comet-ml/opik/pull/5683
- [OPIK-4550] [BE] feat: add P1 workspace permission annotations to delete and log endpoints by @LifeXplorer in https://github.com/comet-ml/opik/pull/5658
- [OPIK-4387] [BE] Populate experiment items before experiment-level aggregates by @thiagohora in https://github.com/comet-ml/opik/pull/5685
- [OPIK-4957] [SDK] feat: improve evaluation suite run experience and performance by @alexkuzmik in https://github.com/comet-ml/opik/pull/5677
Full Changelog: https://github.com/comet-ml/opik/compare/1.10.40...1.10.41
- Local runner SDK completely refactored to be project-specific
- Deployment history tracking for blueprint environments
- Per-span cost tracking with cost_callback
- Dataset view and annotation queue view permissions
- Evaluation suite API improvements and feedback fixes
- Fetch user permissions endpoint for SDK use
- Update agent_config_decorator calls: use project_name parameter instead of project
- OPIK_WORKSPACE environment variable is now optional in TS SDK
- agent_config_decorator project parameter renamed to project_name
- Blueprints frontend
- Define alerts permission
- ClickHouse feedback_scores query optimization
Full changelog
What's Changed
- [OPIK-4528] [FE]: blueprints FE; by @aadereiko in https://github.com/comet-ml/opik/pull/5572
- [NA] [SDK] Rename agent_config_decorator
projectparam toproject_nameby @petrotiurin in https://github.com/comet-ml/opik/pull/5597 - [OPIK-4879] [BE] Optimize slow ClickHouse queries by narrowing feedback_scores scans by @andrescrz in https://github.com/comet-ml/opik/pull/5599
- [OPIK-4708] Implement Define alerts permission by @anastasiapyzhik in https://github.com/comet-ml/opik/pull/5612
- [NA] [DOCS] Mark OPIK_WORKSPACE as optional across docs and TS SDK by @jverre in https://github.com/comet-ml/opik/pull/5629
- [OPIK-4503] [BE] Option B: Denormalize execution_policy to experiment_items for pass_rate by @JetoPistola in https://github.com/comet-ml/opik/pull/5606
- [NA] [DOCS] Add redirects for commonly guessed TS SDK and integration paths by @jverre in https://github.com/comet-ml/opik/pull/5633
- [NA] [SDK] [DOCS] Update automatically OpenAPI spec and Fern code by @CometActions in https://github.com/comet-ml/opik/pull/5631
Full Changelog: https://github.com/comet-ml/opik/compare/1.10.37...1.10.38
- Local runner now supports parallelism with process isolation
Full changelog
What's Changed
- [OPIK-4875] [SDK] Implement local runner parallelism with process isolation by @petrotiurin in https://github.com/comet-ml/opik/pull/5598
- [NA] Update version.txt by @AndreiCautisanu in https://github.com/comet-ml/opik/pull/5617
Full Changelog: https://github.com/comet-ml/opik/compare/1.10.36...1.10.37
- Improved unsaved changes messaging with save button
- Permission checks for workspace settings and user role updates
- localStorage migration for column ordering
- Dataset info metadata added to local runner jobs
- Explicit pagination added to code review Slack commands
Full changelog
What's Changed
- [NA] [BE] Update model prices file by @CometActions in https://github.com/comet-ml/opik/pull/5558
- [NA] [SDK] [DOCS] Update automatically OpenAPI spec and Fern code by @CometActions in https://github.com/comet-ml/opik/pull/5557
- Bump com.diffplug.spotless:spotless-maven-plugin from 3.2.0 to 3.3.0 in /apps/opik-backend by @dependabot[bot] in https://github.com/comet-ml/opik/pull/5559
- Bump dev.langchain4j:langchain4j-bom from 1.11.0 to 1.12.2 in /apps/opik-backend by @dependabot[bot] in https://github.com/comet-ml/opik/pull/5560
- [OPIK-4862] [INFRA] Add explicit pagination to code review Slack commands by @JetoPistola in https://github.com/comet-ml/opik/pull/5561
- [OPIK-4839] [BE] feat: add dataset info metadata to local runner jobs by @BorisTkachenko in https://github.com/comet-ml/opik/pull/5562
- [NA] revert permissions to unblock release by @LifeXplorer in https://github.com/comet-ml/opik/pull/5563
Full Changelog: https://github.com/comet-ml/opik/compare/1.10.30...1.10.31
- Applications using gemini-2.0-flash-exp must migrate to gemini-2.0-flash
- Deprecated models removed
- gemini-2.0-flash-exp model name removed
- Unused default values removed from agent_config
- Error type visibility and analysis
- Option to disable blueprint auto-increment on prompt version commit
- New permissions for dashboards and experiments
Full changelog
What's Changed
- [OPIK-4750] [BE] [FE] feat: add error type visibility and analysis by @andriidudar in https://github.com/comet-ml/opik/pull/5532
- [OPIK-4841] [FE] Fix OpenClaw trace Pretty mode rendering by @juanferrub in https://github.com/comet-ml/opik/pull/5549
- [OPIK-4802] [SDK] Fix agent_config to avoid API calls during import and remove unused defaults by @petrotiurin in https://github.com/comet-ml/opik/pull/5530
- [OPIK-4836] [BE] feat: add option to disable blueprint auto-increment on prompt version commit by @BorisTkachenko in https://github.com/comet-ml/opik/pull/5545
- [OPIK-4852] [BE/FE] fix: remove -exp suffix from gemini-2.0-flash model name + remove deprecated models by @jackc-comet in https://github.com/comet-ml/opik/pull/5556
- [OPIK-4437] permissions generic solution fixed by @LifeXplorer in https://github.com/comet-ml/opik/pull/5483
- [OPIK-4530] [BE] Add new permissions for dashboards and experiments by @LifeXplorer in https://github.com/comet-ml/opik/pull/5341
Full Changelog: https://github.com/comet-ml/opik/compare/1.10.29...1.10.30
- Metrics Computation Service
- Assertions shorthand for EvaluationSuite API
- Mask ID support in local runner
Full changelog
What's Changed
- [OPIK-4382] [BE] Metrics Computation Service by @thiagohora in https://github.com/comet-ml/opik/pull/5361
- [NA] [SDK] Enrich agent config trace metadata with type and description by @petrotiurin in https://github.com/comet-ml/opik/pull/5542
- [OPIK-4747] [P SDK] feat: add assertions shorthand to EvaluationSuite API by @alexkuzmik in https://github.com/comet-ml/opik/pull/5535
- [NA] [SDK] Add mask ID support to local runner by @petrotiurin in https://github.com/comet-ml/opik/pull/5539
- [OPIK-4743] [BE] Add ClientErrorException as non-retryable in BaseRedisSubscriber by @andrescrz in https://github.com/comet-ml/opik/pull/5548
Full Changelog: https://github.com/comet-ml/opik/compare/1.10.28...1.10.29
- ExternalSecret API upgraded from v1beta1 to v1
- maxCompletionTokens removed from dataset expansion API
- Evaluation Suites support in TypeScript SDK for comprehensive testing
- Local Runner Python SDK
- Lightweight permissions framework for granular resource access control
Full changelog
What's Changed
- Upgrade ExternalSecret API from v1beta1 to v1 by @rpandurangan in https://github.com/comet-ml/opik/pull/5489
- [OPIK-4759] [BE] feat: add maskId to local runner job by @BorisTkachenko in https://github.com/comet-ml/opik/pull/5518
- [NA] [SDK] [DOCS] Update automatically OpenAPI spec and Fern code by @CometActions in https://github.com/comet-ml/opik/pull/5519
- [OPIK-4739] [SDK] Migrate prompts in blueprints to use commit references by @petrotiurin in https://github.com/comet-ml/opik/pull/5502
- [OPIK-4755] [FE] Fix break-all CSS on links causing broken truncation in Firefox by @awkoy in https://github.com/comet-ml/opik/pull/5522
- [OPIK-4741] [BE] Add changes delta to blueprints history by @BorisTkachenko in https://github.com/comet-ml/opik/pull/5508
- [OPIK-4743] [BE] Add NOGROUP recovery to Redis stream consumers by @andrescrz in https://github.com/comet-ml/opik/pull/5525
- [NA] [CI] fix: stabilize TypeScript SDK E2E tests and improve CI debugging by @AndreiCautisanu in https://github.com/comet-ml/opik/pull/5521
- [NA] [DOCS] fix broken agent-tracing links in tracing docs by @vincentkoc in https://github.com/comet-ml/opik/pull/5527
- [OPIK-4669] [TS SDK] Evaluation Suites support by @awkoy in https://github.com/comet-ml/opik/pull/5470
- [OPIK-4756] [FE] Add overflow-hidden to CellWrapper to prevent row content bleeding by @miguelgrc in https://github.com/comet-ml/opik/pull/5529
- [OPIK-4362] [P SDK] Implementation of lightweight permissions framework by @yaricom in https://github.com/comet-ml/opik/pull/5468
- [NA] [SDK] Local Runner Python SDK by @collincunn in https://github.com/comet-ml/opik/pull/5433
- [OPIK-4753] [SDK] fix: flush async ingestion queue before CLI import exits by @dsblank in https://github.com/comet-ml/opik/pull/5514
- [NA] [BE] Update model prices file by @CometActions in https://github.com/comet-ml/opik/pull/5541
- [NA] [SDK] [DOCS] Update automatically OpenAPI spec and Fern code by @CometActions in https://github.com/comet-ml/opik/pull/5540
- [OPIK-4771] [SDK] Add AgentConfig CRUD API for backend-synced configurations in TypeScript SDK by @petrotiurin in https://github.com/comet-ml/opik/pull/5520
- [OPIK-4631] [BE] perf: optimize trace get-by-id query to prevent memory amplification by @ldaugusto in https://github.com/comet-ml/opik/pull/5537
- [OPIK-4743] [BE] Add configurable MAXLEN trimming and trim limit to Redis stream producers by @andrescrz in https://github.com/comet-ml/opik/pull/5543
- [OPIK-4757] [FE] Fix PrettyCell showing literal \n instead of rendering newlines by @miguelgrc in https://github.com/comet-ml/opik/pull/5536
- [OPIK-4675] [BE] fix: remove maxCompletionTokens from dataset expansion to support reasoning models by @nLamprok in https://github.com/comet-ml/opik/pull/5533
- [OPIK-4691] [FE] Implement Define AI Providers permission by @anastasiapyzhik in https://github.com/comet-ml/opik/pull/5509
New Contributors
- @rpandurangan made their first contribution in https://github.com/comet-ml/opik/pull/5489
- @nLamprok made their first contribution in https://github.com/comet-ml/opik/pull/5533
Full Changelog: https://github.com/comet-ml/opik/compare/1.10.27...1.10.28
- Local Runner backend first build
Full changelog
What's Changed
- [OPIK-4524] [BE] Refactor and skills update by @BorisTkachenko in https://github.com/comet-ml/opik/pull/5503
- [OPIK-4680] [FE] fix: preserve column types when adding/editing dataset items by @ldaugusto in https://github.com/comet-ml/opik/pull/5493
- [NA] [DOCS] Update fern-api version in documentation deploy workflow by @jverre in https://github.com/comet-ml/opik/pull/5505
- [OPIK-4571] [FE] fix: add data: and blob: to CSP media-src directive by @andriidudar in https://github.com/comet-ml/opik/pull/5504
- [NA] [BE] First build of Local Runner backend by @collincunn in https://github.com/comet-ml/opik/pull/5406
- [NA] [DOCS] update docs announcement banner by @cbordz in https://github.com/comet-ml/opik/pull/5492
- [OPIK-4729] [INFRA] Add resolve-thread step to address-github-pr-comments command by @JetoPistola in https://github.com/comet-ml/opik/pull/5498
- [OPIK-4705] [INFRA] Fix create-pr command to read PR template from repo by @JetoPistola in https://github.com/comet-ml/opik/pull/5499
- [OPIK-4728] [INFRA] Add explicit pagination requirement to address-github-pr-comments by @JetoPistola in https://github.com/comet-ml/opik/pull/5500
- [NA] [SDK] [DOCS] Update automatically OpenAPI spec and Fern code by @CometActions in https://github.com/comet-ml/opik/pull/5512
- [NA] [DOCS] docs: refine OpenClaw integration setup flow by @vincentkoc in https://github.com/comet-ml/opik/pull/5513
- Update version in fern.config.json to 4.3.4 by @dsinghvi in https://github.com/comet-ml/opik/pull/5516
- [NA] [BE] Update model prices file by @CometActions in https://github.com/comet-ml/opik/pull/5517
New Contributors
- @dsinghvi made their first contribution in https://github.com/comet-ml/opik/pull/5516
Full Changelog: https://github.com/comet-ml/opik/compare/1.10.26...1.10.27
- Full-text search for traces, spans, and threads
- Auto-update agent blueprints on prompt version commit
- @opik.config decorator and Config CRUD API in Python SDK
Full changelog
What's Changed
- [OPIK-4524] [BE] Auto-update agent blueprints on prompt version commit by @BorisTkachenko in https://github.com/comet-ml/opik/pull/5465
- [OPIK-4571] [FE] fix: hydrate video/audio data in playground dataset items by @andriidudar in https://github.com/comet-ml/opik/pull/5487
- [OPIK-4464] [FE] Add delete optimization runs permission check by @anastasiapyzhik in https://github.com/comet-ml/opik/pull/5486
- [NA] [BE] Update model prices file by @CometActions in https://github.com/comet-ml/opik/pull/5496
- [NA] [SDK] [DOCS] Update automatically OpenAPI spec and Fern code by @CometActions in https://github.com/comet-ml/opik/pull/5495
- [NA] [DOCS] Add changelog for 2026-03-03 by @juanferrub in https://github.com/comet-ml/opik/pull/5491
- [OPIK-4516] [BE][FE] Add full-text search for traces, spans, and threads by @miguelgrc in https://github.com/comet-ml/opik/pull/5391
- [OPIK-4671] [BE] Move dataset type filter to generic filters (Option A) by @JetoPistola in https://github.com/comet-ml/opik/pull/5490
- [OPIK-4548] [SDK] Add @opik.config decorator and Config CRUD API to Python SDK by @petrotiurin in https://github.com/comet-ml/opik/pull/5455
- [NA] [SDK] [DOCS] Update automatically OpenAPI spec and Fern code by @CometActions in https://github.com/comet-ml/opik/pull/5501
Full Changelog: https://github.com/comet-ml/opik/compare/1.10.25...1.10.26
- Agent Configuration Management System
- Enhanced permission checks for trace, dataset, queue, and prompt operations
- PydanticAI integration improvements
- JSONPath support in Optimization Studio
- Numerical Similarity metric
- Python SDK no longer defaults to gpt-4* models
- View dashboards permission check added
- Time columns now display in relative time format
- Default columns updated across all tables
Full changelog
What's Changed
- [OPIK-4434] [SDK] Python SDK retire gpt-4* defaults by @vincentkoc in https://github.com/comet-ml/opik/pull/5188
- [OPIK-4429] [FE] Update time columns to relative time format by @andriidudar in https://github.com/comet-ml/opik/pull/5201
- [OPIK-4580] [DOCS] Add gh CLI PR comment replies to /address-github-pr-comments by @JetoPistola in https://github.com/comet-ml/opik/pull/5395
- [OPIK-4364] [FE] Update default columns across all tables by @andriidudar in https://github.com/comet-ml/opik/pull/5388
- [OPIK-4357] [FE] Implement view dashboards permission check by @anastasiapyzhik in https://github.com/comet-ml/opik/pull/5267
- [OPIK-4595] [DOCS] Add /review-github-pr slash command by @JetoPistola in https://github.com/comet-ml/opik/pull/5407
Full Changelog: https://github.com/comet-ml/opik/compare/1.10.21...1.10.22
- LangChain/LangGraph message format support
- Optimizer SDK MCP tool reintroduction
- HPA behavior configuration
- Support for tracking OpenAI TTS models (audio.speech)
- Bulk tag adding and removing operations
- Gemini 3.1 Pro support in playground and online scoring
Full changelog
What's Changed
- [OPIK-4547][HELM] Add support for additional profiles and users for clickhouse by @liyaka in https://github.com/comet-ml/opik/pull/5356
- [issue-2202] [BE] [SDK] feat: Support OpenAI TTS models tracking (audio.speech) by @Samoppakiks in https://github.com/comet-ml/opik/pull/5010
- [OPIK-4380] [BE] Fix dataset deadlock issue by wrapping version creation with reactive retry by @thiagohora in https://github.com/comet-ml/opik/pull/5364
- [OPIK-3137][OPIK-3161] [BE][FE] Add bulk tag adding and removing operations by @miguelgrc in https://github.com/comet-ml/opik/pull/5122
- [OPIK-4359] [FE] Implement view experiments permission check by @anastasiapyzhik in https://github.com/comet-ml/opik/pull/5179
- [OPIK-4307] OpikTracer incorrectly reports LangGraph control flow exceptions as errors by @yaricom in https://github.com/comet-ml/opik/pull/5342
- [OPIK-3101] [FE] Unify open in new tab icons by @andriidudar in https://github.com/comet-ml/opik/pull/5368
- [OPIK-4554] [FE][BE] Add Gemini 3.1 Pro support for playground and online scoring by @AndreiCautisanu in https://github.com/comet-ml/opik/pull/5366
- [OPIK-4517] [FE]: misplaced config button in opt studio is fixed; by @aadereiko in https://github.com/comet-ml/opik/pull/5340
- [NA] [BE] Update model prices file by @CometActions in https://github.com/comet-ml/opik/pull/5376
- [NA] [SDK] [DOCS] Update automatically OpenAPI spec and Fern code by @CometActions in https://github.com/comet-ml/opik/pull/5375
- [issue-5018] [BE] Add fallback logic to strip date suffixes from model names for cost calculation by @dsblank in https://github.com/comet-ml/opik/pull/5047
New Contributors
- @Samoppakiks made their first contribution in https://github.com/comet-ml/opik/pull/5010
Full Changelog: https://github.com/comet-ml/opik/compare/1.10.19...1.10.20
- Workspace permissions feature reverted
- OpikExporter @vercel/otel compatibility
- Replay manager framework
- OTEL GenAI semantic conventions mapping
- Workspace permissions system
- Dataset item descriptions
- OpenRouter auto/free route support
- Temperature and top_p are now mutually exclusive for Anthropic models
- Reasoning disabled for FreeModel provider
- Claude Sonnet 4.6 as default model
- Prompt comparison version tags
- TTFT filtering and sorting for traces
- Smart default to Threads tab when project has threads
- Temperature clamped for reasoning models in free model provider
Full changelog
What's Changed
- [OPIK-4173] [FE] Smart default to Threads tab when project has threads by @JetoPistola in https://github.com/comet-ml/opik/pull/5148
- [OPIK-4455] [BE] Clamp temperature for reasoning models in free model provider by @Lothiraldan in https://github.com/comet-ml/opik/pull/5252
- [OPIK-4489] [BE] Add rollback dependency order skill to migration patterns by @JetoPistola in https://github.com/comet-ml/opik/pull/5270
- [NA] [DOCS] Improve multi-turn agents evaluation docs for new users by @jverre in https://github.com/comet-ml/opik/pull/5284
- [NA] [BE] Update model prices file by @CometActions in https://github.com/comet-ml/opik/pull/5287
Full Changelog: https://github.com/comet-ml/opik/compare/1.10.14...1.10.15
- Backend dependency io.vavr upgraded from 0.11.0 to 1.0.0 (major version)
- OpenTelemetry dependency bumped from 2.24.0 to 2.25.0
- ClickHouse operator and server upgraded to latest versions
- Prompt version tags support in Python SDK
- LLM calls routed through internal proxy instead of direct provider calls
- Extended dataset_item_versions table for evaluation suites
Full changelog
What's Changed
- [OPIK-4436] [FE] Fix feedback score tag trimming value instead of only the label by @andriidudar in https://github.com/comet-ml/opik/pull/5208
- [OPIK-0000] [CI/CD] Increase be tests timeout to 45 min by @BorisTkachenko in https://github.com/comet-ml/opik/pull/5211
- [OPIK-1959] [FE] Fix markdown code block indentation and restyle per Figma by @andriidudar in https://github.com/comet-ml/opik/pull/5204
- [CUST-5054] [BE/P SDK/ TS] Allow experiments with null dataset_name to be listed by @dsblank in https://github.com/comet-ml/opik/pull/5209
- Revert: Allow experiments with null dataset_name to be listed by @dsblank in https://github.com/comet-ml/opik/pull/5212
- [NA] [INFRA] ci: Disable bake for sdk e2e library build path by @vincentkoc in https://github.com/comet-ml/opik/pull/5217
- [OPIK-4347] [BE] Add TTFT field for spans and traces by @BorisTkachenko in https://github.com/comet-ml/opik/pull/5202
- [NA] [SDK] [DOCS] Update automatically OpenAPI spec and Fern code by @CometActions in https://github.com/comet-ml/opik/pull/5221
- [NA] [BE] Update model prices file by @CometActions in https://github.com/comet-ml/opik/pull/5222
- Bump io.vavr:vavr from 0.11.0 to 1.0.0 in /apps/opik-backend by @dependabot[bot] in https://github.com/comet-ml/opik/pull/5225
- Bump opentelmetry.version from 2.24.0 to 2.25.0 in /apps/opik-backend by @dependabot[bot] in https://github.com/comet-ml/opik/pull/5223
- [OPIK-4428] [FE] Add full precision tooltip to CompareCostCell by @andriidudar in https://github.com/comet-ml/opik/pull/5238
- [issue-2801] [P SDK] Add prompt version tags support to Python SDK by @andrescrz in https://github.com/comet-ml/opik/pull/4707
- [OPIK-4446] [BE] Use pull_request_target for auto-labeling external PRs by @JetoPistola in https://github.com/comet-ml/opik/pull/5240
- [OPIK-4381] [BE] Add experiment_items.project_id with fallback logic by @thiagohora in https://github.com/comet-ml/opik/pull/5185
- [DND-686][HELM] Upgrade clickhouse operator and server to latest by @liyaka in https://github.com/comet-ml/opik/pull/5198
- [OPIK-4381] [SDK] Auto-generated code for project_id field in experiment items by @thiagohora in https://github.com/comet-ml/opik/pull/5186
- [OPIK-4330] [SDK] Split OQL configs for traces, spans, and trace threads by @petrotiurin in https://github.com/comet-ml/opik/pull/5203
- [OPIK-4434] [TS SDK] Update default evaluation model and fix documentation references by @petrotiurin in https://github.com/comet-ml/opik/pull/5213
- [OPIK-4287] [AI-BE] Route LLM calls through Opik AI proxy instead of direct provider calls by @Lothiraldan in https://github.com/comet-ml/opik/pull/5166
- [OPIK-4207] [INFRA] Add nginx configuration for local opik-ai-backend routing by @Lothiraldan in https://github.com/comet-ml/opik/pull/5243
- [OPIK-4225] [BE] Extend dataset_item_versions table for evaluation suites by @JetoPistola in https://github.com/comet-ml/opik/pull/5220
- [OPIK-4378] [AI-BACKEND] Display LLM provider error messages by @Lothiraldan in https://github.com/comet-ml/opik/pull/5180
- [NA] [SDK] [DOCS] Update automatically OpenAPI spec and Fern code by @CometActions in https://github.com/comet-ml/opik/pull/5245
- [OPIK-4330] [SDK] TypeScript SDK OQL config split by @petrotiurin in https://github.com/comet-ml/opik/pull/5210
- [DND-4288][HELM] Add opik-ai-backend component to helm chart by @liyaka in https://github.com/comet-ml/opik/pull/5192
- [NA] [BE] Update model prices file by @CometActions in https://github.com/comet-ml/opik/pull/5250
- [NA] [CI] Add a Github Issues YAML by @vincentkoc in https://github.com/comet-ml/opik/pull/5249
- [DND-724] Update helm chart dependencies and cloudpirate minio image by @liyaka in https://github.com/comet-ml/opik/pull/5248
- [NA] [DOCS] Add TypeScript SDK section to code review Slack commands by @petrotiurin in https://github.com/comet-ml/opik/pull/5246
- [OPIK-3501] [FE] Unify destructive menu options with red text and separators by @andriidudar in https://github.com/comet-ml/opik/pull/5239
- [NA] [FE] Fix prompt version tags UI regression by @andrescrz in https://github.com/comet-ml/opik/pull/5244
- [OPIK-4445] [FE] Fix experiment details UI issues and extract FeedbackScoresList by @andriidudar in https://github.com/comet-ml/opik/pull/5241
- [OPIK-4381] [SDK] Automatically populate project_name when creating experiment items by @thiagohora in https://github.com/comet-ml/opik/pull/5187
Full Changelog: https://github.com/comet-ml/opik/compare/1.10.13...1.10.14
- SDK Optimizer retires gpt-4* model defaults
- G-Eval metric added to TypeScript SDK
Full changelog
What's Changed
- [issue-674] [SDK] Optimizer fix rich tqdm postfix regression and bump version by @vincentkoc in https://github.com/comet-ml/opik/pull/5183
- [OPIK-4434] [BE] AI backend retire gpt-4* defaults by @vincentkoc in https://github.com/comet-ml/opik/pull/5191
- [OPIK-4434] [BE] Revert - AI backend retire gpt-4* defaults" by @Lothiraldan in https://github.com/comet-ml/opik/pull/5197
- [DND-700][HELM] Adjust opik-python-backend networkPolicy by @liyaka in https://github.com/comet-ml/opik/pull/5194
- [NA] [SDK] Optimizer SDK update ASCII banner by @vincentkoc in https://github.com/comet-ml/opik/pull/5196
- [OPIK-4428] [FE] Fix inconsistent number formatting across the UI by @andriidudar in https://github.com/comet-ml/opik/pull/5182
- [OPIK-4335] [SDK] Add G-Eval metric to TypeScript SDK by @petrotiurin in https://github.com/comet-ml/opik/pull/5147
- [NA] [BE] Update model prices file by @CometActions in https://github.com/comet-ml/opik/pull/5199
- [OPIK-4434] [SDK] Optimizer SDK retire gpt-4* defaults by @vincentkoc in https://github.com/comet-ml/opik/pull/5189
- [NA] [FE] Fix AccordionItem missing Accordion wrapper in ThreadDetailsPanel by @andriidudar in https://github.com/comet-ml/opik/pull/5206
Full Changelog: https://github.com/comet-ml/opik/compare/1.10.12...1.10.13
- @modelcontextprotocol/sdk high-severity vulnerabilities
- Docker base image vulnerabilities
- OpikAssist backend integration
- Workspace-level color map configuration
- Real-time score averages in CLI
- Network policy disabled by default in Helm chart deployments
- JSON path explorer for advanced trace filtering and navigation
- TypeScript SDK: searchThreads functionality and annotation queue support
- Image attachments display in thread view
Full changelog
What's Changed
- [OPIK-3863][FE]: Json path explorer by @aadereiko in https://github.com/comet-ml/opik/pull/4871
- [OPIK-3083] [FE] Allow creating feedback definitions in context from annotation queue form by @andriidudar in https://github.com/comet-ml/opik/pull/5098
- [OPIK-4133] [DOCS] Fix import order rule to match actual codebase conventions by @andriidudar in https://github.com/comet-ml/opik/pull/5139
- [issue-4986] [INFRA] Pin Opik images to appVersion in Helm chart by @GuySaar8 in https://github.com/comet-ml/opik/pull/5104
- Bump org.redisson:redisson from 3.52.0 to 4.2.0 in /apps/opik-backend by @dependabot[bot] in https://github.com/comet-ml/opik/pull/5123
- [NA] [BE] Update model prices file by @CometActions in https://github.com/comet-ml/opik/pull/5143
- [NA] [SDK] [DOCS] Update automatically OpenAPI spec and Fern code by @CometActions in https://github.com/comet-ml/opik/pull/5142
- [OPIK-3617] [FE/SDK] Fix prompt version metadata for traces by @BorisTkachenko in https://github.com/comet-ml/opik/pull/5136
- [OPIK-4329] [SDK] Add searchThreads functionality to TypeScript SDK by @petrotiurin in https://github.com/comet-ml/opik/pull/5141
- [issue-4952] [FE] Add image attachments display in thread view by @dsblank in https://github.com/comet-ml/opik/pull/5116
- [OPIK-3616] [FE] Fix "View in Prompt Library" link to show correct prompt version by @BorisTkachenko in https://github.com/comet-ml/opik/pull/5146
- [OPIK-4323] [SDK] Add annotation queue support for TypeScript SDK by @petrotiurin in https://github.com/comet-ml/opik/pull/5112
- [OPIK-4334] [BE] Optimize SpanDAO and TraceDAO ClickHouse queries by @thiagohora in https://github.com/comet-ml/opik/pull/5145
- [issue-2245] [SDK] Fix legacy ADK tracer crash on LLM errors by @dsblank in https://github.com/comet-ml/opik/pull/5137
- [OPIK-4290] [BE] Fix SSE streaming format for OpenAI SDK compatibility by @Lothiraldan in https://github.com/comet-ml/opik/pull/5149
- [NA] [BE] Revert Redisson 4.2.0 upgrade by @JetoPistola in https://github.com/comet-ml/opik/pull/5150
- [OPIK-4334] [BE] Optimize SpanDAO and TraceDAO queries with target project_ids extraction by @thiagohora in https://github.com/comet-ml/opik/pull/5151
- [NA] [BE] Update model prices file by @CometActions in https://github.com/comet-ml/opik/pull/5161
- [OPIK-3564] [FE] Improve mobile responsiveness for Run experiment SideDialog by @JetoPistola in https://github.com/comet-ml/opik/pull/4745
- [NA][OPIK-4339] disable network policy by default by @obezpalko in https://github.com/comet-ml/opik/pull/5152
- [NA] [DOCS] Add changelog for February 10, 2026 by @juanferrub in https://github.com/comet-ml/opik/pull/5163
- [OPIK-4300] messages tab virtualization by @awkoy in https://github.com/comet-ml/opik/pull/5110
Full Changelog: https://github.com/comet-ml/opik/compare/1.10.10...1.10.11
- Brace-expansion vulnerability in Cursor extension
- Base64 string support for Attachment.data
- Logs tab consolidation of traces/threads/spans
- DatasetVersion support in TypeScript SDK
Backend optimization for experiment queries with target projects extraction pattern.
- Annotation queue support added to Python SDK
- Prompt metadata now exposed in Python online evaluation rules
- Prompt metadata added to traces generated from Opik Playground
Full changelog
What's Changed
- [OPIK-3074] [FE] Add prompt metadata to traces generated from Opik Playground by @BorisTkachenko in https://github.com/comet-ml/opik/pull/5039
- [issue-5081] [FE] Expose metadata in Python online evaluation rules by @dsblank in https://github.com/comet-ml/opik/pull/5099
- [OPIK-4215] [SDK] Add annotation queue support to Python SDK by @petrotiurin in https://github.com/comet-ml/opik/pull/5069
- [OPIK-3239] [BE] Fix prompt last_updated_at not updating on version creation by @BorisTkachenko in https://github.com/comet-ml/opik/pull/5113
Full Changelog: https://github.com/comet-ml/opik/compare/1.10.7...1.10.8
- CVE-2025-64756 glob command injection
- CVE-2026-22028 preact JSON VNode Injection
- TypeScript configure tool ESM support
- Dataset versions management in SDK
- Opus 4.6 support
- CVE-2025-61927 in happy-dom
- CVE-2025-7783 in form-data
- CVE-2025-59288 in playwright
- Dataset field support for GEval metric
- Endpoint to retrieve dataset version by name
- Feedback scores logging to TypeScript SDK
- Config file path expansion now supports ~/.opik.config
- TypeScript SDK displayTraceLog behavior now matches Python SDK
- Add dataset_filter_string parameter to evaluate functions
- Loading overlay added to tables during data fetching
Full changelog
What's Changed
- [OPIK-4127] [DOCS] Fix filter syntax link and remove duplicate evaluation content by @petrotiurin in https://github.com/comet-ml/opik/pull/5043
- [OPIK-3132][frontend] extend CSP and use loop by @obezpalko in https://github.com/comet-ml/opik/pull/4835
- [OPIK-4214] docs: add Opik MCP VS Code example by @fschlz in https://github.com/comet-ml/opik/pull/5049
- [OPIK-4127] [SDK] Add dataset_filter_string parameter to evaluate functions by @petrotiurin in https://github.com/comet-ml/opik/pull/5050
- [OPIK-4200] [SDK] Fix TypeScript SDK displayTraceLog to match Python SDK by @petrotiurin in https://github.com/comet-ml/opik/pull/5046
- [OPIK-4211] [SDK] Fix config file path expansion to support ~/.opik.config by @petrotiurin in https://github.com/comet-ml/opik/pull/5044
- [OPIK-4140] [FE] [BE] improve version selection UX by @awkoy in https://github.com/comet-ml/opik/pull/5008
- [OPIK-3437] llm custom pretty by @awkoy in https://github.com/comet-ml/opik/pull/4784
- [NA] [DOCS] Add comprehensive administration documentation by @jverre in https://github.com/comet-ml/opik/pull/5015
- [OPIK-3846] [BE] Optimize experiment items stats query with IN subqueries by @thiagohora in https://github.com/comet-ml/opik/pull/5033
- [OPIK-3382] [FE] Add loading overlay to tables during data fetching by @andriidudar in https://github.com/comet-ml/opik/pull/5060
- [OPIK-3437] change "Max completion tokens" to "Completion tokens" label by @awkoy in https://github.com/comet-ml/opik/pull/5063
- [NA] [DEV] Add multi-worktree support for parallel development by @awkoy in https://github.com/comet-ml/opik/pull/5024
- [OPIK-3910] [SDK] Fix evaluatePrompt image tests by replacing Wikimedia URLs by @petrotiurin in https://github.com/comet-ml/opik/pull/5059
- [NA] [BE] Update model prices file by @CometActions in https://github.com/comet-ml/opik/pull/5055
Full Changelog: https://github.com/comet-ml/opik/compare/1.10.4...1.10.5
- Filter string support added to dataset methods and evaluation
- Workspace role permission mismatch warning
- Navigation from trace view to experiment items
Full changelog
What's Changed
- [OPIK-4127] [SDK] Add filter_string support to dataset methods and evaluation by @petrotiurin in https://github.com/comet-ml/opik/pull/5003
- [NA] [SDK] Skip flaky OpenAI ADK test by @petrotiurin in https://github.com/comet-ml/opik/pull/5030
- [OPIK-4199] [FE] Show only member workspaces in navbar selector by @andriidudar in https://github.com/comet-ml/opik/pull/5041
- [OPIK-4009] [FE] Center checkboxes in select column by @miguelgrc in https://github.com/comet-ml/opik/pull/5022
- [OPIK-3278] [FE] Hide pagination on empty tables by @andriidudar in https://github.com/comet-ml/opik/pull/5042
- [NA] [FE] Add workspace role permission mismatch warning by @anastasiapyzhik in https://github.com/comet-ml/opik/pull/5040
- [OPIK-3919] [FE][BE] Add navigation to experiment item from trace view by @JetoPistola in https://github.com/comet-ml/opik/pull/5038
Full Changelog: https://github.com/comet-ml/opik/compare/1.10.3...1.10.4
- Workspace roles management in members tab
- Filter support added to dataset item streaming endpoints
- Experiments column and filter added to Traces tab
Full changelog
What's Changed
- [OPIK-4111] [E2E] better slack messaging for post-merge runs by @AndreiCautisanu in https://github.com/comet-ml/opik/pull/4970
- [NA] [FE] Implement workspace roles management in members tab by @anastasiapyzhik in https://github.com/comet-ml/opik/pull/4999
- [OPIK-4127] [BE] Add filter support to dataset item streaming endpoints by @petrotiurin in https://github.com/comet-ml/opik/pull/4992
- [NA] [SDK] [DOCS] Update automatically OpenAPI spec and Fern code by @CometActions in https://github.com/comet-ml/opik/pull/5001
- [issue-4986] Pin docker image version to app version by @maciej-tatarski in https://github.com/comet-ml/opik/pull/4985
- [NA] [INFRA] Revert image version to latest by @GuySaar8 in https://github.com/comet-ml/opik/pull/5006
- [NA] [DOCS] Fix command as channel was renamed by @thiagohora in https://github.com/comet-ml/opik/pull/4987
- [OPIK-771] [FE] UX improvements for traces sidebar by @BorisTkachenko in https://github.com/comet-ml/opik/pull/5000
- [NA] [DOCS] Fix broken link in Google Gemini documentation by @petrotiurin in https://github.com/comet-ml/opik/pull/5004
- [OPIK-4113] [SDK] Update ruff, mypy and precommit hooks by @vincentkoc in https://github.com/comet-ml/opik/pull/4974
- [NA] Fix pullPolicy formatting in values.yaml by @GuySaar8 in https://github.com/comet-ml/opik/pull/5009
- [NA] [BE] Update model prices file by @CometActions in https://github.com/comet-ml/opik/pull/5016
- [OPIK-4135] [BE] Fix ambiguous identifier error when filtering experiment items by ID by @thiagohora in https://github.com/comet-ml/opik/pull/4993
- [OPIK-3920] [BE][FE] Add experiments column and filter to Traces tab by @JetoPistola in https://github.com/comet-ml/opik/pull/4806
- Bump com.mysql:mysql-connector-j from 9.5.0 to 9.6.0 in /apps/opik-backend by @dependabot[bot] in https://github.com/comet-ml/opik/pull/5017
- [OPIK-3993] [FE] [SDK] Log all model parameters as experiment config by @BorisTkachenko in https://github.com/comet-ml/opik/pull/4939
- [OPIK-3958] [FE] Simplify Ollama provider connection flow by @thiagohora in https://github.com/comet-ml/opik/pull/5005
New Contributors
- @maciej-tatarski made their first contribution in https://github.com/comet-ml/opik/pull/4985
Full Changelog: https://github.com/comet-ml/opik/compare/1.10.1...1.10.2
- Ollama provider support
- File-like object support for attachments
- Organization and workspace selectors in sidebar and breadcrumbs
Full changelog
What's Changed
- [NA] [SDK] fix: remove return statements from finally blocks in stream_patchers.py by @mecampbellsoup in https://github.com/comet-ml/opik/pull/4791
- [OPIK-3958] [BE] [FE] Add Ollama provider support by @thiagohora in https://github.com/comet-ml/opik/pull/4941
- [OPIK-3958] [DOCS] Add Ollama setup to AI providers (Opik configuration only) by @thiagohora in https://github.com/comet-ml/opik/pull/4964
- [OPIK-2879] [Optimizer] [DOCS] fix getting optimized prompt by @dsblank in https://github.com/comet-ml/opik/pull/4984
- [NA] [BE] Optimize SELECT_TRACES_STATS query in TraceDAO by @thiagohora in https://github.com/comet-ml/opik/pull/4982
- [OPIK-3909] [P SDK] Add support for File-like objects when creating an Attachment by @yaricom in https://github.com/comet-ml/opik/pull/4973
- [OPIK-4026] [FE] Add organization and workspace selectors to sidebar and breadcrumbs by @jverre in https://github.com/comet-ml/opik/pull/4906
- [OPIK-4074] [BE] Improve Python backend metrics and reduce log verbosity by @ldaugusto in https://github.com/comet-ml/opik/pull/4991
- [OPIK-4133] [DOCS] Rules refactored into modern pattern by @collincunn in https://github.com/comet-ml/opik/pull/4981
- [OPIK-4110] [DOCS] Add fern/img vs static/img note to documentation skill by @jverre in https://github.com/comet-ml/opik/pull/4994
- [OPIK-4126] [DOCS] Add dataset versioning documentation by @awkoy in https://github.com/comet-ml/opik/pull/4988
- [OPIK-3890] [CI] alexkuzmik / slack notifications integration tests by @alexkuzmik in https://github.com/comet-ml/opik/pull/4990
- [NA] [BE] Update model prices file by @CometActions in https://github.com/comet-ml/opik/pull/4998
Full Changelog: https://github.com/comet-ml/opik/compare/1.10.0...1.10.1
## What's Changed * [OPIK-4084] [SDK] opik import span error * [NA] Bump version
- Optimizer v3.0.1 release
- New create_prompt() parameters: id, description, change_description, tags
- Reason field always visible in Annotate interface
Full changelog
What's Changed
- [OPIK-4119] [SDK] Optimizer v3.0.1 release and docs/fix updates by @vincentkoc in https://github.com/comet-ml/opik/pull/4977
- [OPIK-4119] [BE] Optimizer v3.0.1 release by @vincentkoc in https://github.com/comet-ml/opik/pull/4979
- [issue-4887] [P SDK] Add id, description, change_description, and tags parameters to create_prompt() by @ollieagent[bot] in https://github.com/comet-ml/opik/pull/4896
- [NA] [BE] Update model prices file by @CometActions in https://github.com/comet-ml/opik/pull/4980
- [OPIK-1491] [FE] Make reason field always visible in Annotate by @BorisTkachenko in https://github.com/comet-ml/opik/pull/4971
Full Changelog: https://github.com/comet-ml/opik/compare/1.9.103...1.9.104
- Merged traces, threads, spans into logs tab
- Structure-preserving JSON truncation for traces and spans
- Tool description extraction in Langchain integration
- Project column in experiments view
- Token usage names endpoint for dashboard widget optimization
- Distributed trace headers support for Python SDK
Full changelog
What's Changed
- [OPIK-3921] [FE] [BE] Add project column to experiments view by @JetoPistola in https://github.com/comet-ml/opik/pull/4899
- [NA] [DOCS] Removed .cursor folder again by @collincunn in https://github.com/comet-ml/opik/pull/4918
- [OPIK-4047] Add new GitHub team for Opik Optimizer developers by @itamargolan in https://github.com/comet-ml/opik/pull/4920
- [NA] [BE] Improving CTE scope and performance for trace and spans by @thiagohora in https://github.com/comet-ml/opik/pull/4913
- [OPIK-3961] [FE] Refine Experiment Item Navigation: Remove ID filter by @CometActions in https://github.com/comet-ml/opik/pull/4854
- [OPIK-4003] [BE][FE] Add token usage names endpoint for dashboard widget optimization by @BorisTkachenko in https://github.com/comet-ml/opik/pull/4889
- [OPIK-3935][BE] Upgrade opik-optimizer to 3.0.0rc6 by @vincentkoc in https://github.com/comet-ml/opik/pull/4880
- [OPIK-2323] [Docs][P SDK] Add missing distributed trace headers support to ADK integration by @yaricom in https://github.com/comet-ml/opik/pull/4775
- [OPIK-3911][FE]: add settings for time formatting; by @aadereiko in https://github.com/comet-ml/opik/pull/4917
- [OPIK-3493] [DOCS] Add Optimization Studio documentation by @jverre in https://github.com/comet-ml/opik/pull/4873
- [NA][SDK] Opik Optimizer SDK v3 Release by @vincentkoc in https://github.com/comet-ml/opik/pull/4727
- [NA] [SDK] [DOCS] Update automatically OpenAPI spec and Fern code by @github-actions[bot] in https://github.com/comet-ml/opik/pull/4926
- [OPIK-3911][FE]: refactor the code and update the order of time formats; by @aadereiko in https://github.com/comet-ml/opik/pull/4925
Full Changelog: https://github.com/comet-ml/opik/compare/1.9.100...1.9.101
- Add CODE metric type for custom Python evaluation in Optimization Studio
- Add Group By feature for dashboard project metrics widget
Full changelog
What's Changed
- Bump com.diffplug.spotless:spotless-maven-plugin from 3.1.0 to 3.2.0 in /apps/opik-backend by @dependabot[bot] in https://github.com/comet-ml/opik/pull/4910
- Bump software.amazon.jdbc:aws-advanced-jdbc-wrapper from 3.0.0 to 3.1.0 in /apps/opik-backend by @dependabot[bot] in https://github.com/comet-ml/opik/pull/4911
- [OPIK-3932] [FE][BE] Add CODE metric type for custom Python evaluation in Optimization Studio by @itamargolan in https://github.com/comet-ml/opik/pull/4817
- [OPIK-3790] [BE] [FE] Add Group By feature for dashboard project metrics widget by @juanferrub in https://github.com/comet-ml/opik/pull/4689
- [OPIK-0000] [BE] Move rule for ClickHouse to agents folder by @BorisTkachenko in https://github.com/comet-ml/opik/pull/4914
- [NA] [DOCS] Cross-agent Opik FE Best Practices skill by @awkoy in https://github.com/comet-ml/opik/pull/4893
Full Changelog: https://github.com/comet-ml/opik/compare/1.9.99...1.9.100
- Project filter and group capability for experiments
- Thumbs up/down feedback for OpikAssist conversations
Full changelog
What's Changed
- [OPIK-3990] [BE] Optimize DatasetVersionDAO queries and add composite index by @thiagohora in https://github.com/comet-ml/opik/pull/4882
- [OPIK-3633] [BE][FE] Add project filter and group capability to experiments by @JetoPistola in https://github.com/comet-ml/opik/pull/4747
- [OPIK-0000] [BE] Adding Cursor rule for ClickHouse by @BorisTkachenko in https://github.com/comet-ml/opik/pull/4877
- [NA] [FE] Add thumbs up/down feedback for OpikAssist conversations by @Lothiraldan in https://github.com/comet-ml/opik/pull/4846
- [NA] [DOCS] Agentic Development Interoperability by @collincunn in https://github.com/comet-ml/opik/pull/4890
- [NA] Update .gitignore, to ignore .cursor symlink file by @JetoPistola in https://github.com/comet-ml/opik/pull/4897
- [OPIK-4022] [FE] Fix NavigationTag using composite dataset ID causing malformed URLs in Playground by @CometActions in https://github.com/comet-ml/opik/pull/4901
- [OPIK-4027] [FE] Update invite user copy to clarify email vs username search by @jverre in https://github.com/comet-ml/opik/pull/4907
- [NA] [SDK] [DOCS] Update automatically OpenAPI spec and Fern code by @github-actions[bot] in https://github.com/comet-ml/opik/pull/4908
- [NA] [BE] Update model prices file by @github-actions[bot] in https://github.com/comet-ml/opik/pull/4909
New Contributors
- @CometActions made their first contribution in https://github.com/comet-ml/opik/pull/4901
Full Changelog: https://github.com/comet-ml/opik/compare/1.9.98...1.9.99
- CLI smoke-test command for installation validation
Full changelog
What's Changed
- [OPIK-3964] [CLI] Add opik smoke-test command by @dsblank in https://github.com/comet-ml/opik/pull/4856
- [OPIK-3955] [E2E] Workflow to run happy paths end to end tests on post-merge with better reporting and notification system by @AndreiCautisanu in https://github.com/comet-ml/opik/pull/4847
- [NA] [SDK] Fix header merging and apiKey propagation in Opik constructor by @petrotiurin in https://github.com/comet-ml/opik/pull/4885
- [NA] [E2E] fix for dataset item deletion test by @AndreiCautisanu in https://github.com/comet-ml/opik/pull/4884
- [OPIK-3978] [SDK] Add experiments and datasets integration tests by @petrotiurin in https://github.com/comet-ml/opik/pull/4886
Full Changelog: https://github.com/comet-ml/opik/compare/1.9.97...1.9.98
- Dynamic sorting check for experiment queries
- Force_sorting parameter for experiment leaderboard ranking
## What's Changed * [OPIK-3647][BE] dataset versioning migration liquibase + lazy
- Review capability for completed annotation queues
- Dataset export frontend integration
- Google Veo model API integration for video generation
Full changelog
What's Changed
- [NA] Add create-jira-ticket cursor command by @YarivHashaiComet in https://github.com/comet-ml/opik/pull/4840
- [OPIK-3610] [FE] Add review capability to completed annotation queues by @miguelgrc in https://github.com/comet-ml/opik/pull/4818
- [OPIK-3413] [P SDK] Use global opik context in DSPy integration by @alexkuzmik in https://github.com/comet-ml/opik/pull/4843
- [OPIK-3894][BE] fix dataset items delete behavior by @idoberko2 in https://github.com/comet-ml/opik/pull/4841
- [OPIK-3942] [FE] Add Dataset select to dashboard config by @andriidudar in https://github.com/comet-ml/opik/pull/4844
- [OPIK-3893] [P SDK] [Docs] Implement integration with googles veo model api for video generation by @alexkuzmik in https://github.com/comet-ml/opik/pull/4810
- [OPIK-3056] [FE] [BE] Add dataset export frontend integration by @thiagohora in https://github.com/comet-ml/opik/pull/4753
- [OPIK-3888] [SDK] Generate TypeScript SDK architecture documentation by @petrotiurin in https://github.com/comet-ml/opik/pull/4842
- [OPIK-3908] [BE] [FE] Followup experiment tags by @yaricom in https://github.com/comet-ml/opik/pull/4789
- [NA] [BE] Refactor query ordering in
ExperimentDAOby @yaricom in https://github.com/comet-ml/opik/pull/4848
Full Changelog: https://github.com/comet-ml/opik/compare/1.9.90...1.9.91
- TypeScript SDK: Fern and dependencies updated
- Helm: new namespaceDomainPattern configuration parameter available for ClickHouse
- Removed langgraph output filtering logic from SDK
- Configurable Content Security Policy (CSP) headers added to frontend nginx
- Frontend: NavigationTag added to dataset items in experiment view
- Frontend: entity references now parsed in OpiKAssist tool call display names
Full changelog
What's Changed
- [OPIK-3924] [BE] Optimise get dataset experiment items stats by @andrescrz in https://github.com/comet-ml/opik/pull/4823
- [OPIK-3323] [DOCS] Add gateway integration documentation by @petrotiurin in https://github.com/comet-ml/opik/pull/4807
- [OPIK-3922] [FE] Add NavigationTag to dataset item in experiment item view by @JetoPistola in https://github.com/comet-ml/opik/pull/4803
- [NA] [FE] Parse entity references in OpiKAssist tool call display names by @Lothiraldan in https://github.com/comet-ml/opik/pull/4825
- [OPIK-3899] [SDK] Update Fern and dependencies for TypeScript SDK by @petrotiurin in https://github.com/comet-ml/opik/pull/4826
- [DND-545] [HELM] Add namespaceDomainPattern to ClickHouse configuration by @GuySaar8 in https://github.com/comet-ml/opik/pull/4790
- [OPIK-3849] Remove the logic for filterign langgraph outputs from the SDK by @alexkuzmik in https://github.com/comet-ml/opik/pull/4831
- [OPIK-3132] Add configurable Content Security Policy (CSP) headers to frontend nginx by @ldaugusto in https://github.com/comet-ml/opik/pull/4832
- [NA] [SDK] [DOCS] Update automatically OpenAPI spec and Fern code by @github-actions[bot] in https://github.com/comet-ml/opik/pull/4837
- [NA] [BE] Update model prices file by @github-actions[bot] in https://github.com/comet-ml/opik/pull/4838
- [NA] [DOCS] Slack command V2 by @thiagohora in https://github.com/comet-ml/opik/pull/4821
Full Changelog: https://github.com/comet-ml/opik/compare/1.9.89...1.9.90
- Dashboard auto-select latest experiment(s)
- Optimization studio UI/UX improvements
- CSP relaxed to allow user-provided media and Google Fonts
Full changelog
What's Changed
- [OPIK-3492] [P SDK] Attachments extraction followup - add E2E tests to check full integration with latest backend changes by @yaricom in https://github.com/comet-ml/opik/pull/4611
- [OPIK-3862][FE]: improve optimization studio UI/UX; by @aadereiko in https://github.com/comet-ml/opik/pull/4812
- [NA] [SDK] Revert TypeScript SDK dependency updates by @petrotiurin in https://github.com/comet-ml/opik/pull/4815
- [NA] [BE] Update model prices file by @github-actions[bot] in https://github.com/comet-ml/opik/pull/4819
- [OPIK-3132] Relax CSP to allow user-provided media and Google Fonts by @ldaugusto in https://github.com/comet-ml/opik/pull/4809
- [OPIK-3796] [FE] Dashboard Defaults - Ability to Auto-Select Latest Experiment(s) by @andriidudar in https://github.com/comet-ml/opik/pull/4786
- [OPIK-3925] [BE] Optimize dataset items column type extraction with materialized column by @thiagohora in https://github.com/comet-ml/opik/pull/4816
- Bump version from 1.9.88 to 1.9.89 by @miguelgrc in https://github.com/comet-ml/opik/pull/4824
Full Changelog: https://github.com/comet-ml/opik/compare/1.9.88...1.9.89
- Experiment Leaderboard for comparing and ranking experiments
Full changelog
What's Changed
- [OPIK-3409] [FE] Experiment Leaderboard in Opik by @andriidudar in https://github.com/comet-ml/opik/pull/4750
- [OPIK-3409] [FE] Simplify experiment leaderboard widget title and fix dataset ID key by @andriidudar in https://github.com/comet-ml/opik/pull/4785
Full Changelog: https://github.com/comet-ml/opik/compare/1.9.86...1.9.87
- Removed sorting limitations for experiments and datasets
- Experiment IDs and filter support for feedback and experiment scores in experiments list endpoint
- Optimization Studio configuration defaults
Full changelog
What's Changed
- [OPIK-3860] [BE] Add experiment IDs and filter support for feedback scores and experiment scores to experiments list endpoint by @BorisTkachenko in https://github.com/comet-ml/opik/pull/4769
- [OPIK-3056] [BE] Add cleanup job for dataset exports (PR#6) by @thiagohora in https://github.com/comet-ml/opik/pull/4743
- fix(docs): update broken LlamaIndex example data URLs by @kkadapa in https://github.com/comet-ml/opik/pull/4779
- [OPIK-3754] [BE] Add Optimization Studio config defaults by @ldaugusto in https://github.com/comet-ml/opik/pull/4756
- [OPIK-3898] [BE] Remove sorting limitation for experiments and datasets by @ldaugusto in https://github.com/comet-ml/opik/pull/4783
New Contributors
- @kkadapa made their first contribution in https://github.com/comet-ml/opik/pull/4779
Full Changelog: https://github.com/comet-ml/opik/compare/1.9.85...1.9.86
- Python E2E tests have been retired
- Video logging support for OpenAI integration (SORA)
- Experiment TAGs rendering on the experiment page
- ChatPrompt support with template_structure field
Full changelog
What's Changed
- [OPIK-3756] [FE BE] Implement experiment TAGs rendering on the experiment page by @yaricom in https://github.com/comet-ml/opik/pull/4690
- [NA][E2E] Python E2E tests retirement by @AndreiCautisanu in https://github.com/comet-ml/opik/pull/4731
- [OPIK-3734] [SDK] DSPy cache hit cost fix by @collincunn in https://github.com/comet-ml/opik/pull/4693
- [OPIK-3982] [FE]: jinja prompt types are not changed into mustache ones; by @aadereiko in https://github.com/comet-ml/opik/pull/4768
- [issue-4722] [FE] Fix pretty input view with system message last by @collincunn in https://github.com/comet-ml/opik/pull/4764
- [OPIK-3747] [BE] Fix CSV BOM character causing Playground variable not recognized by @thiagohora in https://github.com/comet-ml/opik/pull/4766
- [OPIK-3462] [P SDK] Implement video logging support for OpenAI integration (SORA) by @alexkuzmik in https://github.com/comet-ml/opik/pull/4754
- [OPIK-3841] [HELM] Make clickhouse-operator own enabled condition by @Dentling in https://github.com/comet-ml/opik/pull/4746
- [OPIK-3823][OPIK-3823] Enhance Helm chart publishing workflow by @obezpalko in https://github.com/comet-ml/opik/pull/4730
- [OPIK-3423] [SDK] Implement ChatPrompt support with template_structure field by @petrotiurin in https://github.com/comet-ml/opik/pull/4748
- [NA] [SDK] [DOCS] Update automatically OpenAPI spec and Fern code by @github-actions[bot] in https://github.com/comet-ml/opik/pull/4780
Full Changelog: https://github.com/comet-ml/opik/compare/1.9.84...1.9.85
- Clone capability for feedback definitions
- Increased default stream limit and bulk upload size
- Dataset version creation now accepts batchGroupId parameter
Full changelog
What's Changed
- [NA] [BE] Update model prices file by @github-actions[bot] in https://github.com/comet-ml/opik/pull/4763
- [OPIK-3856] [BE] Increase default stream limit and bulk upload size by @YarivHashaiComet in https://github.com/comet-ml/opik/pull/4749
- [DND-175][BE] Optimize opik-backend Dockerfile by @liyaka in https://github.com/comet-ml/opik/pull/4709
- [OPIK-3612] [FE] Add clone capability for feedback definitions by @miguelgrc in https://github.com/comet-ml/opik/pull/4755
- [NA] Update Playground documentation by @SrBliss in https://github.com/comet-ml/opik/pull/4758
- [NA] [SDK] Update track-decorator example to use flushAll utility by @petrotiurin in https://github.com/comet-ml/opik/pull/4765
- [OPIK-3836] [FE] Add batchGroupId param for dataset version creation by @awkoy in https://github.com/comet-ml/opik/pull/4735
Full Changelog: https://github.com/comet-ml/opik/compare/1.9.83...1.9.84
- Span-level metrics charts for observability into span performance
- Dataset item batching support for insert and delete operations
- CSV export with S3 multipart upload streaming
Full changelog
What's Changed
- [OPIK-3748] [FE] Auto-collapse base64 strings in CodeMirror viewer by @miguelgrc in https://github.com/comet-ml/opik/pull/4712
- [OPIK-2379] [BE][FE] Add span-level metrics charts by @BorisTkachenko in https://github.com/comet-ml/opik/pull/4733
- [OPIK-3779] insert and delete dataset items batching support by @idoberko2 in https://github.com/comet-ml/opik/pull/4726
- [NA] [SDK] [DOCS] Update automatically OpenAPI spec and Fern code by @github-actions[bot] in https://github.com/comet-ml/opik/pull/4757
- [OPIK-3669] [FE] Fix annotation button labels based on item completion status by @JetoPistola in https://github.com/comet-ml/opik/pull/4606
- [OPIK-3807] [SDK] Add batchGroupId parameter to dataset insert and delete operations by @awkoy in https://github.com/comet-ml/opik/pull/4708
- [OPIK-3056] [BE] Implement CSV generation with S3 multipart upload streaming by @thiagohora in https://github.com/comet-ml/opik/pull/4732
- [NA] [P SDK] Updated the dataset class to support batch_group_id parameter by @alexkuzmik in https://github.com/comet-ml/opik/pull/4711
- [NA][DOCS] Update Docs Banner Link by @vincentkoc in https://github.com/comet-ml/opik/pull/4759
Full Changelog: https://github.com/comet-ml/opik/compare/1.9.82...1.9.83
- Dataset export job management
- Bar charts grouped by metric instead of experiment
- PodDisruptionBudget template for Helm chart
Full changelog
What's Changed
- [OPIK-3805] [DOCS] Add Cursor rules for responsive design by @JetoPistola in https://github.com/comet-ml/opik/pull/4710
- [DND-524][HELM] Add PodDisruptionBudget template for Helm chart by @GuySaar8 in https://github.com/comet-ml/opik/pull/4721
- [NA] [BE] Update model prices file by @github-actions[bot] in https://github.com/comet-ml/opik/pull/4744
- [OPIK-3056] [BE] Add dataset export job management by @thiagohora in https://github.com/comet-ml/opik/pull/4691
- [OPIK-3817] [FE] Group bar charts by metric instead of experiment by @andriidudar in https://github.com/comet-ml/opik/pull/4736
- [OPIK-3816] [FE] Fix Configuration filter dropdown width issue in experiment widgets by @andriidudar in https://github.com/comet-ml/opik/pull/4738
New Contributors
- @GuySaar8 made their first contribution in https://github.com/comet-ml/opik/pull/4721
Full Changelog: https://github.com/comet-ml/opik/compare/1.9.80...1.9.81
Minor fixes and improvements.
Full changelog
What's Changed
- [OPIK-3738] [FE] Update TraceAIViewer SSE integration for tool calls and streaming by @Lothiraldan in https://github.com/comet-ml/opik/pull/4683
Full Changelog: https://github.com/comet-ml/opik/compare/1.9.79...1.9.80
- Removed support for Python 3.9; minimum version is now Python 3.10 or later
- Dataset export jobs with database schema and API models
- Dataset streaming support in the evaluate function
- ClickHouse query logging for spans and queries
Full changelog
What's Changed
- [OPIK-3777] [FE] Fix pagination size bug when adding tags to dataset items by @awkoy in https://github.com/comet-ml/opik/pull/4705
- [NA] [E2E] Update online scoring tests and remove networkidle waits by @AndreiCautisanu in https://github.com/comet-ml/opik/pull/4704
- [OPIK-3770][FE] handling scrolling opt studio by @aadereiko in https://github.com/comet-ml/opik/pull/4688
- [OPIK-3769] [BE] Add CH logging for spans by @BorisTkachenko in https://github.com/comet-ml/opik/pull/4667
- [OPIK-3789] [BE] Add clickhouse query logging by @BorisTkachenko in https://github.com/comet-ml/opik/pull/4684
- [OPIK-3775][BE] changed items should be at the top of the list by @idoberko2 in https://github.com/comet-ml/opik/pull/4697
- [NA][BE] fix minor comments from previous PRs by @idoberko2 in https://github.com/comet-ml/opik/pull/4706
- [DND-500][CI] Improve Opik Adhoc environments creation time by @liyaka in https://github.com/comet-ml/opik/pull/4663
- [OPIK-3056] [BE] Add database schema and API models for dataset export jobs by @thiagohora in https://github.com/comet-ml/opik/pull/4685
- [OPIK-3794] [Python BE] Quality-of-life improvements for Optimization Studio by @ldaugusto in https://github.com/comet-ml/opik/pull/4692
- [OPIK-3503] [FE] Refactor chart Y-axis tick precision and division logic by @andriidudar in https://github.com/comet-ml/opik/pull/4478
- [OPIK-3563] [FE] Improve mobile responsiveness for Log a trace SideDialog by @JetoPistola in https://github.com/comet-ml/opik/pull/4564
- [OPIK-3810] [BE] Fix JSON serialization for complex objects in Python online scoring by @ldaugusto in https://github.com/comet-ml/opik/pull/4713
- [OPIK-3549] [SDK] Support dataset streaming in evaluate function by @petrotiurin in https://github.com/comet-ml/opik/pull/4658
- [OPIK-3811] [FE]: manage ai provider and setup ai provider dialogs now have improved UXs; by @aadereiko in https://github.com/comet-ml/opik/pull/4714
- [OPIK-3711] [SDK] Retire EOL Python 3.9 support by @petrotiurin in https://github.com/comet-ml/opik/pull/4715
- [NA] [CI] Fix Python version quote in GitHub Actions workflow by @petrotiurin in https://github.com/comet-ml/opik/pull/4718
Full Changelog: https://github.com/comet-ml/opik/compare/1.9.77...1.9.78
- Bedrock as native provider
- Vercel AI SDK upgrade to v6
- Experiment TAG support
- Python SDK: @opik.track(create_root_span=True) parameter for root span tracking
- TypeScript SDK: prompt version tags support
Full changelog
What's Changed
- [OPIK-3195] [P SDK] Implement @opik.track(create_root_span=True) parameter by @yaricom in https://github.com/comet-ml/opik/pull/4625
- [issue-2801] [SDK] Add prompt version tags support to TypeScript SDK by @andrescrz in https://github.com/comet-ml/opik/pull/4672
- [NA][Docs] Update annoucement banner for hackathon by @vincentkoc in https://github.com/comet-ml/opik/pull/4676
- [NA][Docs] Update docs banner UTM tracking by @vincentkoc in https://github.com/comet-ml/opik/pull/4677
- [NA] [BE] Update model prices file by @github-actions[bot] in https://github.com/comet-ml/opik/pull/4679
- [NA] [SDK] [DOCS] Update automatically OpenAPI spec and Fern code by @github-actions[bot] in https://github.com/comet-ml/opik/pull/4678
- [issue-4576] [DOCS] Add troubleshooting guide for ClickHouse cluster macro requirement by @Nimrod007 in https://github.com/comet-ml/opik/pull/4581
- [NA] [BE] Revert "Bump org.redisson:redisson from 3.52.0 to 4.0.0 in /apps/opik-backend" by @thiagohora in https://github.com/comet-ml/opik/pull/4682
Full Changelog: https://github.com/comet-ml/opik/compare/1.9.75...1.9.76
- Redisson dependency upgraded from 3.52.0 to 4.0.0 — verify compatibility before deploying to production
- Experiment tags with full CRUD support
- Clone capability for online score rules
- Context7 MCP server configuration support
Full changelog
What's Changed
- [NA] [BE] Update model prices file by @github-actions[bot] in https://github.com/comet-ml/opik/pull/4661
- [OPIK-3531] [BE] Add query logs for TraceDAO by @BorisTkachenko in https://github.com/comet-ml/opik/pull/4495
- [OPIK-3211] [BE] Replace manual JSON traversal with JSONPath library by @thiagohora in https://github.com/comet-ml/opik/pull/4313
- [OPIK-3682] [CI] Add Python 3.14 to testing matrix by @petrotiurin in https://github.com/comet-ml/opik/pull/4619
- [OPIK-3725] [SDK] Fix tracing for LangGraph graph executions with interrupts by @petrotiurin in https://github.com/comet-ml/opik/pull/4635
- [NA][BE] dataset versioning fixes by @idoberko2 in https://github.com/comet-ml/opik/pull/4645
- [NA] [PROPOSAL] Add Context7 MCP server configuration by @thiagohora in https://github.com/comet-ml/opik/pull/4624
- [NA] [BE] Bump org.redisson:redisson from 3.52.0 to 4.0.0 in /apps/opik-backend by @dependabot[bot] in https://github.com/comet-ml/opik/pull/4521
- [OPIK-3572] [FE]: responsive tags rendering in list items; by @aadereiko in https://github.com/comet-ml/opik/pull/4656
- [NA] [FE] Send organizationId param for username autocomplete by @anastasiapyzhik in https://github.com/comet-ml/opik/pull/4664
- [OPIK-3195] [BE] Implement support for experiment tags with full CRUD by @yaricom in https://github.com/comet-ml/opik/pull/4638
- [OPIK-3547] [FE] Fix CSV upload validation failing on Windows by @awkoy in https://github.com/comet-ml/opik/pull/4665
- [OPIK-3771]: update templates; by @aadereiko in https://github.com/comet-ml/opik/pull/4670
- [OPIK-3613] [FE] Add clone capability for online score rules by @BorisTkachenko in https://github.com/comet-ml/opik/pull/4654
Full Changelog: https://github.com/comet-ml/opik/compare/1.9.74...1.9.75
- Add NavigationTag from annotation queues to traces and threads
- Avoid selecting OpenAI by default when feature toggle is off
Full changelog
What's Changed
- [OPIK-3727] [FE] parse json fix for dataset items edit flow by @awkoy in https://github.com/comet-ml/opik/pull/4653
- [OPIK-3743][FE]: avoid selecting openai by default if the FT is off; by @aadereiko in https://github.com/comet-ml/opik/pull/4655
- [OPIK-3614] [FE] Add NavigationTag from annotation queues to traces/threads by @JetoPistola in https://github.com/comet-ml/opik/pull/4644
- [OPIK-000][BE] Fix AWS sts dependency by @BorisTkachenko in https://github.com/comet-ml/opik/pull/4657
Full Changelog: https://github.com/comet-ml/opik/compare/1.9.73...1.9.74
Patch release with fixes for workspace UI alignment, Project Statistics widget, and dataset version fetching.
- is_empty and is_not_empty operators for feedback score filtering
- Python SDK API improvements for log_*_feedback_scores methods
- versionName field added to DatasetVersionSummary
Full changelog
What's Changed
- [OPIK-3645] [DOCS] Add headless Jira MCP configuration for local development by @JetoPistola in https://github.com/comet-ml/opik/pull/4592
- [OPIK-3648] [SDK] Add is_empty and is_not_empty operator support for feedback scores by @petrotiurin in https://github.com/comet-ml/opik/pull/4589
- [issue-4595] [SDK] Fix trace truncation in threads evaluation by @petrotiurin in https://github.com/comet-ml/opik/pull/4596
- [NA][BE] add
versionNametoDatasetVersionSummaryby @idoberko2 in https://github.com/comet-ml/opik/pull/4584 - [NA] [DOCS] Fix local development guide links in contributing documentation by @petrotiurin in https://github.com/comet-ml/opik/pull/4598
- [OPIK-3473] [SDK] Python SDK API improvements for log_*_feedback_scores methods by @petrotiurin in https://github.com/comet-ml/opik/pull/4552
- [OPIK-3646] Add Jira-Headless-CI MCP configuration for GitHub Actions by @JetoPistola in https://github.com/comet-ml/opik/pull/4597
Full Changelog: https://github.com/comet-ml/opik/compare/1.9.69...1.9.70