0.71.0 (Draft)#

Draft — GitHub Release

Changes#

⚠️ Breaks#

Switch python runtime to CurrentThreadRuntime (#7896) @robert3005

✨ Features#

pluggable registry for input/export arrow kernels (#7824) @a10y
feat[fastlanes]: allow delta to support signed bases (#7923) @joseph-isaacs
Updated Variant array and the new VariantGet expression (#7877) @AdamGS
Add Arrow to Vortex conversion to C FFI (#7906) @robert3005
Add statistic expression (#7854) @gatesn
Add DType::Union variant carrying just Nullability (#7901) @connortsui20
tracing logger for duckdb (#7892) @myrrc
simplify projection expression for SELECT * in duckdb (#7885) @myrrc
TurboQuant again! (#7829) @connortsui20
feat: all_non_distinct aggregation make fuzzer faster (#7827) @joseph-isaacs
Add a new AggregateFn for UncompressedSize (#7715) @AdamGS
feat: iterative execution for SparseArray (#7711) @joseph-isaacs
feat: check VortexReadAt::read_at results in the I/O driver (#7783) @danking
feat[vortex-cuda]: GPU FSST decompression kernel (#7776) @asubiotto
Make struct cast implementation pluggable (#7684) @robert3005
[claude] feat(bench): emit v3 JSONL records and dual-write to bench server (#7780) @connortsui20

🚀 Performance#

perf[array]: add the SimplifyCache to optimize (#7948) @joseph-isaacs
Mimic duckdb’s post-filter cardinality estimates (#7895) @myrrc
Use many connections on the benchmarks server (#7852) @connortsui20
Faster Mask::from_slices (#7857) @gatesn
Improve intersect_by_rank performance (#7744) @robert3005
perf[array]: small vec for slots (#7825) @joseph-isaacs
perf[array]: outline the array parts data from the DynArray (#7750) @joseph-isaacs
Remove more scalar_at from sparse arrays (#7439) @gatesn

🐛 Bug Fixes#

16 changes

Fix segfault when calling vx CLI from Python bindings (#7947) @joseph-isaacs
register_splits to get both offset and relative row_range (#7913) @onursatici
Fix IsSorted return dtype (#7914) @connortsui20
fix[gpu]: CUDA sliced patch views with device patches (#7911) @0ax1
Reorder agg kernel dispatch, and have Combined use inner accumulators (#7889) @gatesn
Widen VarBinBuilder offets during FSST compress (#7853) @connortsui20
fix[array]: get_item reduce + struct wrong nullability (#7887) @joseph-isaacs
fix[bitpacked]: slice patches in execute method (not reduce). (#7839) @joseph-isaacs
Stop ignoring tests (#7844) @robert3005
Fix features of vortex-python (#7837) @robert3005
fix[py]: remove mimalloc in library (#7826) @joseph-isaacs
fix[sparse]: ensure cached patches are updated and use PatchesData (#7811) @joseph-isaacs
fix(ffi): double-free in partition scan on error (#7817) @m7kss1
fix: partition in filter should err (not panic). (#7816) @joseph-isaacs
Fix logo on benchmarks website (#7779) @connortsui20
fix: make ExtDType metadata deserialization total over byte input (#7782) @gatesn

🧰 Maintenance#

58 changes

Clippy deny absolute_paths longer than 3 elements (#7950) @robert3005
Add stats rewrite session API (#7930) @gatesn
Add a nicer progress bar and file-based filter (#7942) @AdamGS
Use async_fs file for java and python writes to avoid object_store buffering on local disks (#7920) @robert3005
Add NullCount aggregate function (#7933) @gatesn
Centralize aggregate stat bridge (#7931) @gatesn
Remove chunked special case from stat execution (#7928) @gatesn
Remove needless fmt_sql (#7409) @gatesn
Add more benchmarks for take on filter array (#7876) @robert3005
use nonnull in lifetime_wrapper (#7908) @myrrc
Pin nightly toolchain version in public-api (#7909) @robert3005
Update flatbuffers generated (#7899) @connortsui20
Add Executor::spawn_io (#7894) @AdamGS
Update dependency urllib3 to v2.7.0 [SECURITY] (#7888) @renovate[bot]
Remove unused protobuf dependency in java bindings (#7886) @robert3005
bench: dyn dispatch / standalone perf comparsion (#7883) @0ax1
Update all patch updates (#7862) @renovate[bot]
Lock file maintenance (#7863) @renovate[bot]
Pin actions/checkout action to de0fac2 (#7858) @renovate[bot]
Update anthropics/claude-code-action digest to 476e359 (#7859) @renovate[bot]
Update Rust crate noodles-vcf to 0.88.0 (#7870) @renovate[bot]
Update aws-actions/configure-aws-credentials digest to d979d5b (#7860) @renovate[bot]
Update taiki-e/install-action digest to fa0dd4c - autoclosed (#7861) @renovate[bot]
Lock file maintenance (#7864) @renovate[bot]
Update dependency io.netty:netty-bom to v4.2.13.Final (#7865) @renovate[bot]
Update Rust crate noodles-bgzf to 0.47.0 (#7869) @renovate[bot]
Update opentelemetry-rust monorepo to 0.32.0 (#7867) @renovate[bot]
Update tailwindcss monorepo to v4.3.0 (#7872) @renovate[bot]
Update release-drafter/release-drafter action to v7.3.0 (#7868) @renovate[bot]
Update react monorepo to v19.2.6 (#7866) @renovate[bot]
Collect slots directly into smallvec instead of using vec and into (#7847) @robert3005
bench[gpu]: CUDA device memory pool benchmarks (#7831) @0ax1
Use smallvec for internal stats storage (#7823) @robert3005
bench[gpu]: overlap of compute and copying (#7828) @0ax1
bench: CUDA host-to-device copy modes (#7815) @0ax1
use rstest for some test cleanups (#7813) @a10y
Update dependency pip to v26.1 [SECURITY] (#7805) @renovate[bot]
Run vortex-mask benchmarks with codspeed (#7804) @robert3005
Add more benchmarks for intersect by rank (#7800) @robert3005
bench: CUDA sync load-to-device benchmark (#7799) @0ax1
Add Patches lookup benchmarks (#7795) @palaska
Allow Claude to open PRs (#7798) @gatesn
Fix weird signature of with_slots functions (#7758) @robert3005
Update anthropics/claude-code-action digest to 2cc1ac1 (#7761) @renovate[bot]
Update taiki-e/install-action digest to 711e1c3 (#7762) @renovate[bot]
Update release-drafter/release-drafter action to v7.2.1 (#7763) @renovate[bot]
Update storybook monorepo to v10.3.6 (#7765) @renovate[bot]
Update crate-ci/typos action to v1.46.0 (#7766) @renovate[bot]
Update dependency eslint to v10.3.0 (#7767) @renovate[bot]
Update dependency globals to v17.6.0 (#7768) @renovate[bot]
Update Gradle to v9.5.0 (#7770) @renovate[bot]
Lock file maintenance (#7772) @renovate[bot]
Lock file maintenance (#7771) @renovate[bot]
Update dependency typescript-eslint to v8.59.2 (#7764) @renovate[bot]
Update dependency lucide-react to v1.14.0 (#7769) @renovate[bot]
Allow bot approvals (#7774) @gatesn
Fix Claude workflow cancellation (#7775) @gatesn
chore: codspeed display names (#7752) @0ax1