Perplexity

Instructions for using language models hosted on Perplexity with Spice.

To use a language model hosted on Perplexity, specify perplexity in the from field.

To use a specific model, include its model ID in the from field (see example below). If not specified, the default model is sonar.

models:
  - name: webs
    from: perplexity:sonar
    params:
      perplexity_auth_token: ${ secrets:SPICE_PERPLEXITY_AUTH_TOKEN }

The following parameters are specific to Perplexity models:

Parameter
Description
Default

perplexity_auth_token

The Perplexity API authentication token.

-

perplexity_*

Additional, perplexity specific parameters to use on all requests. See Perplexity API Reference

-

Note: Like other models in Spice, Perplexity can set default overrides for OpenAI parameters. See Parameter Overrides.

Example Configuration

models:
  - name: webs
    from: perplexity:sonar
    params:
      perplexity_auth_token: ${ secrets:SPICE_PERPLEXITY_AUTH_TOKEN }
      perplexity_search_domain_filter:
       - docs.spiceai.org
       - huggingface.co
      openai_temperature: 0.3141595

Last updated

Was this helpful?