Quickstart

This section provides a quickstart example for creating an AI Agent with Llama Stack.

Prerequisites

  • Python 3.12 or higher (if not satisfied, refer to FAQ: How to prepare Python 3.12 in Notebook)
  • Llama Stack Server installed and running via Operator (see Install Llama Stack), with VLLM_URL pointing at a vLLM-served model endpoint (see install notes)
  • Access to a Notebook environment (e.g., Jupyter Notebook, JupyterLab)
  • Python environment with llama-stack-client, fastmcp (for the MCP section), and other notebook dependencies installed

Quickstart Example

A simple example of creating an AI Agent with Llama Stack is available in the following resources:

Download the notebook and upload it to a Notebook environment to run.

The notebook demonstrates:

  • Two tool options: client-side tools (@client_tool) and MCP tools (FastMCP + toolgroups.register)
  • Shared agent flow: connect to Llama Stack Server, select a model, create an Agent with tools=AGENT_TOOLS, then run sessions and streaming turns
  • Streaming responses and event logging
  • Optional FastAPI deployment of the agent

FAQ

How to prepare Python 3.12 in Notebook

  1. Download the pre-compiled Python installation package:

    wget -O /tmp/python312.tar.gz https://github.com/astral-sh/python-build-standalone/releases/download/20260114/cpython-3.12.12+20260114-x86_64-unknown-linux-gnu-install_only.tar.gz
  2. Extract with:

    mkdir -p ~/python312
    tar -xzf /tmp/python312.tar.gz -C ~/python312 --strip-components=1
  3. Install and Register Kernel:

    export PATH="${HOME}/python312/bin:${PATH}"
    
    python3 -m pip install ipykernel
    python3 -m ipykernel install --user --name python312 --display-name "Python 3.12"
  4. Switch kernel in the notebook page:

    • Open your Notebook environment (e.g., Jupyter Notebook or JupyterLab) in the browser, then open an existing notebook or create a new one.
    • In the notebook interface, find the current kernel name (usually shown in the top-right corner of the page, e.g., "Python 3" or "python3").
    • Click that kernel name, or use the menu Kernel → Change Kernel.
    • In the kernel list, select "Python 3.12" (the display name registered in step 3).
    • After switching, new cells will run with Python 3.12.

Note: When executing python and pip commands directly in the notebook page, the default python will still be used. You need to specify the full path to use the python312 version commands.

Additional Resources

For more resources on developing AI Agents with Llama Stack, see: