Memory

Memory Data Connector Documentation

The Memory Data Connector enables configuring an in-memory dataset for tables used, or produced by the Spice runtime. Only certain tables, with predefined schemas, can be defined by the connector. These are:

• store: Defines a table that LLMs, with memory tooling, can store data in. Requires mode: read_write.

Examples

datasets:
  - from: memory:store
    name: llm_memory
    mode: read_write
    columns:
      - name: value
        embeddings: # Easily make your LLM learnings searchable.
          - from: all-MiniLM-L6-v2

embeddings:
  - name: all-MiniLM-L6-v2
    from: huggingface:huggingface.co/sentence-transformers/all-MiniLM-L6-v2