Spice v0.13.3-alpha (June 10, 2024)

The v0.13.3-alpha release is focused on quality and stability with improvements to metrics, telemetry, and operability.

Highlights

Ready API: - Add /v1/ready API that returns success once all datasets and models are loaded and ready.

Enhanced Grafana dashboard: The dashboard now includes charts for query duration and failures, the last update time of accelerated datasets, the count of refresh errors, and the last successful time the runtime was able to access federated datasets

Contributors

• @Jeadie
• @ewgenius
• @phillipleblanc
• @sgrebnov
• @gloomweaver
• @y-f-u
• @mach-kernel

What’s Changed

Dependencies

• DuckDB 1.0.0: Upgrades embedded DuckDB to 1.0.0.

Commits

• Scalar UDF array_distance as euclidean distance between Float32[] by @Jeadie in https://github.com/spiceai/spiceai/pull/1601
• Update version to v0.14.0-alpha by @ewgenius in https://github.com/spiceai/spiceai/pull/1614
• Update helm for v0.13.2-alpha by @ewgenius in https://github.com/spiceai/spiceai/pull/1618
• Upgrade duckdb-rs to DuckDB 1.0.0 by @phillipleblanc in https://github.com/spiceai/spiceai/pull/1615
• initial idea for ‘POST v1/assist’ by @Jeadie in https://github.com/spiceai/spiceai/pull/1585
• openai server trait and move HTTP endpoints to crates/runtime/src/http/v1/ by @Jeadie in https://github.com/spiceai/spiceai/pull/1619
• Add branching policy & updated endgame instructions by @phillipleblanc in https://github.com/spiceai/spiceai/pull/1620
• Update Cargo.lock & add CI check for updated Cargo.lock by @phillipleblanc in https://github.com/spiceai/spiceai/pull/1627
• Add first-class support for views by @phillipleblanc in https://github.com/spiceai/spiceai/pull/1622
• Add /v1/ready API that returns 200 when all datasets have loaded by @phillipleblanc in https://github.com/spiceai/spiceai/pull/1629
• Separate NQL logic from LLM Chat messages, and add OpenAI compatiblility per LLM trait. by @Jeadie in https://github.com/spiceai/spiceai/pull/1628
• Log queries failing on get_flight_info step (Flight Api) by @sgrebnov in https://github.com/spiceai/spiceai/pull/1626
• Graphql Data Connector by @gloomweaver in https://github.com/spiceai/spiceai/pull/1624
• GraphQL improved Error formatting, proper format request body by @gloomweaver in https://github.com/spiceai/spiceai/pull/1637
• Fix v1/assist response and panic bug. Include primary keys in response too by @Jeadie in https://github.com/spiceai/spiceai/pull/1635
• skip integration test if no secret by @y-f-u in https://github.com/spiceai/spiceai/pull/1638
• [append] Refresher::get_latest_timestamp / get_df to add refresh_sql predicates to scan by @mach-kernel in https://github.com/spiceai/spiceai/pull/1636
• GraphQL integration test by @gloomweaver in https://github.com/spiceai/spiceai/pull/1600
• Add err_code to query_failures metric by @sgrebnov in https://github.com/spiceai/spiceai/pull/1639
• use epoch_ms to replace epoch to work with timestamptz by @y-f-u in https://github.com/spiceai/spiceai/pull/1641
• fix the schema mismatch issue on the fallback plan use schema casting by @y-f-u in https://github.com/spiceai/spiceai/pull/1642
• bug report template update by @y-f-u in https://github.com/spiceai/spiceai/pull/1640
• Add query duration, failures and accelerated dataset metrics to Grafana dashboard by @sgrebnov in https://github.com/spiceai/spiceai/pull/1598
• Fix FTP/sftp support for ObjectStoreMetadataTable & ObjectStoreTextTable by @Jeadie in https://github.com/spiceai/spiceai/pull/1649
• Support accelerated embedding tables in v1/assist by @Jeadie in https://github.com/spiceai/spiceai/pull/1648
• GraphQL pagination, limit pushdown and refactor by @gloomweaver in https://github.com/spiceai/spiceai/pull/1643
• Support indexes in accelerated tables by @phillipleblanc in https://github.com/spiceai/spiceai/pull/1644
• Federated datasets availability monitoring by @sgrebnov in https://github.com/spiceai/spiceai/pull/1650
• Reset federated dataset availability during dataset registration by @sgrebnov in https://github.com/spiceai/spiceai/pull/1661
• Change to v0.13.3-alpha by @phillipleblanc in https://github.com/spiceai/spiceai/pull/1666
• Add Time Since Offline chart to Grafana dashboard by @sgrebnov in https://github.com/spiceai/spiceai/pull/1664

• readme fix to correct the number of rows for show tables by @y-f-u in https://github.com/spiceai/spiceai/pull/1667
• Update acknowledgements by @github-actions in https://github.com/spiceai/spiceai/pull/1668
• Add missing dependency on arrow_sql_gen from duckdb data_component by @phillipleblanc in https://github.com/spiceai/spiceai/pull/1669

Full Changelog: https://github.com/spiceai/spiceai/compare/v0.13.2-alpha...v0.13.3-alpha

Resources

• Getting started with Spice.ai
• Documentation

Community

Spice.ai started with the vision to make AI easy for developers. We are building Spice.ai in the open and with the community. Reach out on Discord or by email to get involved.

• Twitter: @spice_ai
• Discord: https://discord.gg/kZnTfneP5u
• Telegram: Spice AI Discussion
• Reddit: https://www.reddit.com/r/spiceai
• Email: [email protected]

• ←Previous
• Next→