Spice v0.19.2-beta (Oct 21, 2024)

Announcing the release of Spice v0.19.2-beta ⚡

Spice v0.19.2-beta continues to improve performance and stability of data connectors and data accelerators, further expands TPC-DS coverage, and includes several bug fixes.

Highlights in v0.19.2

DataFusion Fixes: Resolved bugs in DataFusion and DataFusion Table Providers, improving TPC-DS query support and correctness.

TPC-DS Snapshots: Extended support for TPC-DS benchmarks with added snapshot tests for validating query plans and result accuracy.

PostgreSQL Accelerator Beta: Postgres Data Accelerator has been promoted to Beta Quality

Breaking changes

• The hive_infer_partitions parameter been changed to hive_partitioning_enabled, now defaults to false and must be explicitly enabled.

Contributors

• @ewgenius
• @sgrebnov
• @slyons
• @Jeadie
• @Sevenannn
• @phillipleblanc
• @dependabot
• @peasee

Dependencies

• DataFusion Table Providers: Upgraded to rev 2bcf481b4abe9d0bd6bb2479ce49020df66ff97f.
• duckdb-rs: Upgraded from 1.0.0 to 1.1.1.

What’s Changed

• Update Helm chart for v0.19.1-beta by @ewgenius in https://github.com/spiceai/spiceai/pull/3106
• Add more TPC-DS snapshots for Postgres acceleration by @sgrebnov in https://github.com/spiceai/spiceai/pull/3107
• Bumping version to 1.0.0-rc.1 by @slyons in https://github.com/spiceai/spiceai/pull/3109
• New table sampling methods: sample_distinct_columns, random_sample, top_n_sample by @Jeadie in https://github.com/spiceai/spiceai/pull/3108
• Add TPCDS snapshot tests for file-based and in-mem duckdb by @Sevenannn in https://github.com/spiceai/spiceai/pull/3115
• Add Postgres acceleration E2E test for MySQL by @sgrebnov in https://github.com/spiceai/spiceai/pull/3110
• Update datafusion logical plan to avoid wrong group_by columns in aggregation by @Sevenannn in https://github.com/spiceai/spiceai/pull/3111
• Warn if user tries to embed column that does not exist by @Jeadie in https://github.com/spiceai/spiceai/pull/3120
• Changes for Rust version upgrade by @Sevenannn in https://github.com/spiceai/spiceai/pull/3134
• Add unnest support for federated plans by @sgrebnov in https://github.com/spiceai/spiceai/pull/3133
• Don’t .clone() unnecessarily by @Jeadie in https://github.com/spiceai/spiceai/pull/3128
• Fix Flight get_schema to construct logical plan and return that schema. by @phillipleblanc in https://github.com/spiceai/spiceai/pull/3131
• Bump clap from 4.5.19 to 4.5.20 by @dependabot in https://github.com/spiceai/spiceai/pull/3099
• Add GitHub Workflow to build spice-postgres-tpcds-bench image by @sgrebnov in https://github.com/spiceai/spiceai/pull/3140
• test: Add basic MySQL integration test by @peasee in https://github.com/spiceai/spiceai/pull/3143
• Bump datafusion-federation and datafusion-table-providers crates by @sgrebnov in https://github.com/spiceai/spiceai/pull/3148
• docs: Add MySQL limitation for division by zero by @peasee in https://github.com/spiceai/spiceai/pull/3144
• fix: Dataset refresh by @peasee in https://github.com/spiceai/spiceai/pull/3147
• Update arrow, duckdb, postgres accelerator tpcds snapshots by @Sevenannn in https://github.com/spiceai/spiceai/pull/3145
• Add TPC-DS benchmarks for Postgres data connector by @sgrebnov in https://github.com/spiceai/spiceai/pull/3149
• Update E2E test ci to include tests for accelerating Postgres into accelerators by @Sevenannn in https://github.com/spiceai/spiceai/pull/3137
• Add TPCDS Benchmark test and snapshots for S3 by @Sevenannn in https://github.com/spiceai/spiceai/pull/3152
• [cli] Include 200 in acceptable response codes for doRuntimeApiRequest by @phillipleblanc in https://github.com/spiceai/spiceai/pull/3157
• Use -build.{GIT_SHA} for unreleased versions by @phillipleblanc in https://github.com/spiceai/spiceai/pull/3159
• Upgrade to Rust 1.82 by @phillipleblanc in https://github.com/spiceai/spiceai/pull/3158
• Disable hive_infer_partitions by default by @phillipleblanc in https://github.com/spiceai/spiceai/pull/3160
• Upgrade to DuckDB 1.1.1 by @phillipleblanc in https://github.com/spiceai/spiceai/pull/3161
• feat: Add MySQL TPCDS results snapshots and exclude workarounds by @peasee in https://github.com/spiceai/spiceai/pull/3165
• Fix task_history output for sql, add output to table_schema & list_datasets tool by @phillipleblanc in https://github.com/spiceai/spiceai/pull/3166
• feat: Add ClickBench queries as separate files by @peasee in https://github.com/spiceai/spiceai/pull/3169
• Calculate embeddings in a separate blocking thread by @phillipleblanc in https://github.com/spiceai/spiceai/pull/3170
• docs: Update ROADMAP.md and release criterias by @peasee in https://github.com/spiceai/spiceai/pull/3124
• Handle OpenTelemetry errors by @phillipleblanc in https://github.com/spiceai/spiceai/pull/3173
• Update version to 0.19.2-beta by @Sevenannn in https://github.com/spiceai/spiceai/pull/3182

Full Changelog: https://github.com/spiceai/spiceai/compare/v0.19.1-beta...v0.19.2-beta

Resources

• Getting started with Spice.ai
• Documentation

Community

Spice.ai started with the vision to make AI easy for developers. We are building Spice.ai in the open and with the community. Reach out on Discord or by email to get involved.

• Twitter: @spice_ai
• Discord: https://discord.gg/kZnTfneP5u
• Telegram: Spice AI Discussion
• Reddit: https://www.reddit.com/r/spiceai
• Email: [email protected]

• ←Previous
• Next→