Skip to content

BentoML

Model Serving & MLOps

A Python library for building scalable, production‑ready model serving APIs and Docker containers.

Python Latest v1.4.39 · 2mo ago Security brief →

Features

  • Easily create REST APIs for any ML model with minimal code and Python type hints.
  • Generate reproducible Docker images automatically, handling dependencies and environment config.
  • Optimize inference performance via dynamic batching, GPU/CPU utilization, multi‑stage pipelines, and model parallelism.

Security Response History

1 CVE
CVE Severity Disclosed Patched (this tool) vs Ecosystem Median
CVE-2023-4863 KEV high
CVSS 8.8
2023-09-13 2026-01-09 2y 4mo / median 2y 4mo

Recent releases

View all 8 releases →
v1.4.39 Security relevant patches CVE-2023-4863
Security fixes
  • Prevent following symlinks when copying files in BentoStore
Full changelog

What's Changed

  • ci: pre-commit autoupdate [skip ci] by @pre-commit-ci[bot] in https://github.com/bentoml/BentoML/pull/5593
  • fix: prevent following symlinks when copying files in BentoStore by @frostming in https://github.com/bentoml/BentoML/pull/5598
  • fix: add sharing=locked to BuildKit cache mounts for multi-arch builds by @lawrence3699 in https://github.com/bentoml/BentoML/pull/5597
  • fix: enhance Dockerfile generation by normalizing base image lines and adding tests by @frostming in https://github.com/bentoml/BentoML/pull/5603
  • fix: defer prometheus_client import in bentoml.metrics to fix histogram collection in multiprocess mode by @ramkrishs in https://github.com/bentoml/BentoML/pull/5602
  • ci: pre-commit autoupdate [skip ci] by @pre-commit-ci[bot] in https://github.com/bentoml/BentoML/pull/5605
  • fix: handle string input in FileSchema by encoding to UTF-8 by @frostming in https://github.com/bentoml/BentoML/pull/5606

New Contributors

  • @lawrence3699 made their first contribution in https://github.com/bentoml/BentoML/pull/5597
  • @ramkrishs made their first contribution in https://github.com/bentoml/BentoML/pull/5602

Full Changelog: https://github.com/bentoml/BentoML/compare/v1.4.38...v1.4.39

v1.4.38 Mixed
Notable features
  • Native support for src-layout projects
Full changelog

What's Changed

  • feat: native support for src-layout projects by @VedantMadane in https://github.com/bentoml/BentoML/pull/5555
  • fix: switch to SandboxedEnvironment and remove unused Jinja2 extensions by @frostming in https://github.com/bentoml/BentoML/pull/5591
  • fix: use correct NVIDIA CUDA base images for debian distro by @mattmorganpdx in https://github.com/bentoml/BentoML/pull/5590

New Contributors

  • @mattmorganpdx made their first contribution in https://github.com/bentoml/BentoML/pull/5590

Full Changelog: https://github.com/bentoml/BentoML/compare/v1.4.37...v1.4.38

v1.4.36 Mixed
Security fixes
  • Validate symlink targets in safe_extract_tarfile
Notable features
  • New image API: build_include
  • SQLite busy_timeout and WAL mode to prevent 'database is locked' under concurrency
  • Fixed memory leak in readiness checks with remote dependencies
Full changelog

What's Changed

  • fix: correct typo 'seperators' to 'separators' by @thecaptain789 in https://github.com/bentoml/BentoML/pull/5546
  • Reapply "feat: new image API: build_include" (#5531) by @frostming in https://github.com/bentoml/BentoML/pull/5539
  • fix: resolve AnyIO NoEventLoopError when calling sync API from async API by @paipeline in https://github.com/bentoml/BentoML/pull/5550
  • fix: Set SQLite busy_timeout and WAL mode to prevent 'database is locked' under concurrency by @VedantMadane in https://github.com/bentoml/BentoML/pull/5551
  • Fix memory leak in readiness checks with remote dependencies by @paipeline in https://github.com/bentoml/BentoML/pull/5553
  • fix: validate symlink targets in safe_extract_tarfile by @q1uf3ng in https://github.com/bentoml/BentoML/pull/5548
  • Revert "fix: resolve AnyIO NoEventLoopError when calling sync API from async API" by @frostming in https://github.com/bentoml/BentoML/pull/5554
  • chore: update AWS BYOC doc to v10 by @sauyon in https://github.com/bentoml/BentoML/pull/5559
  • chore(deps): bump actions/download-artifact from 7 to 8 by @dependabot[bot] in https://github.com/bentoml/BentoML/pull/5561
  • chore(deps): bump actions/upload-artifact from 6 to 7 by @dependabot[bot] in https://github.com/bentoml/BentoML/pull/5560
  • ci: pre-commit autoupdate [skip ci] by @pre-commit-ci[bot] in https://github.com/bentoml/BentoML/pull/5562

New Contributors

  • @thecaptain789 made their first contribution in https://github.com/bentoml/BentoML/pull/5546
  • @paipeline made their first contribution in https://github.com/bentoml/BentoML/pull/5550
  • @VedantMadane made their first contribution in https://github.com/bentoml/BentoML/pull/5551
  • @q1uf3ng made their first contribution in https://github.com/bentoml/BentoML/pull/5548

Full Changelog: https://github.com/bentoml/BentoML/compare/v1.4.35...v1.4.36

Weekly OSS security release digest.

The CVE patches and breaking changes that affected production tools this week. One email, every Sunday.

No spam, unsubscribe anytime.

About

Stars
8,719
Forks
983
Languages
Python Shell Jinja

Install & Platforms

Install via
pip

Community & Support

Beta — feedback welcome: [email protected]