githubEdit

plugConnecting Data

Connect your databases, warehouses, lakes, and APIs to Spice.ai Cloud.

Overview

Spice.ai supports federated SQL queriesarrow-up-right across a wide range of data sources. Data connectors let you query external data directly or replicate it into Spice for accelerated access.

For the full list of connectors and configuration options, see Data Connectorsarrow-up-right.

Supported Data Sources

Adding a Data Source

1. Store credentials as secrets

Data source credentials should be stored as secretsarrow-up-right in your app. In the Portal, go to your app → Secrets and create entries for connection strings, access keys, or tokens.

circle-info

Secret values are write-only and cannot be retrieved after saving.

2. Configure the dataset in your Spicepod

Add a dataset entry to your app's spicepod.yaml referencing the connector and secrets:

3. Deploy

Commit and deploy your app to make the dataset available for querying.

Data Acceleration

For faster queries, enable data accelerationarrow-up-right to cache datasets in a local engine:

Available acceleration engines:

Common Issues

Table not found

Spice normalizes unquoted SQL identifiers to lowercase (PostgreSQL-style). If your source uses mixed-case table or column names, double-quote them:

Object store file format errors

When connecting to object stores (S3, ABFS):

  • Folder paths require an explicit file_format (e.g., parquet, csv).

  • Single file paths auto-detect the format from the file extension.

Schema changes break data refresh

Spice infers the schema at deployment time. If the source schema changes, refresh will fail. Redeploy the app to pick up the new schema.

Connection failures

  • Confirm the data source is network-accessible from Spice.ai Cloud (firewalls, IP allowlists).

  • Verify secrets are correct and referenced with ${secrets:SECRET_NAME} syntax.

  • Check connector-specific docs for required parameters.

Further Reading

Last updated

Was this helpful?