> ## Documentation Index
> Fetch the complete documentation index at: https://docs.agno.com/llms.txt
> Use this file to discover all available pages before exploring further.

# Async Reliability Evaluation

> Example showing how to run reliability evaluations asynchronously.

<Steps>
  <Step title="Create a Python file">
    ```python reliability_async.py theme={null}
    """This example shows how to run a Reliability evaluation asynchronously."""

    import asyncio
    from typing import Optional

    from agno.agent import Agent
    from agno.eval.reliability import ReliabilityEval, ReliabilityResult
    from agno.models.openai import OpenAIResponses
    from agno.run.agent import RunOutput
    from agno.tools.calculator import CalculatorTools


    def factorial():
        agent = Agent(
            model=OpenAIResponses(id="gpt-5.2"),
            tools=[CalculatorTools()],
        )
        response: RunOutput = agent.run("What is 10!?")
        evaluation = ReliabilityEval(
            agent_response=response,
            expected_tool_calls=["factorial"],
        )

        # Run the evaluation calling the arun method.
        result: Optional[ReliabilityResult] = asyncio.run(
            evaluation.arun(print_results=True)
        )
        if result:
            result.assert_passed()


    if __name__ == "__main__":
        factorial()
    ```
  </Step>

  <Snippet file="create-venv-step.mdx" />

  <Step title="Install dependencies">
    ```bash theme={null}
    uv pip install -U openai agno
    ```
  </Step>

  <Step title="Export your OpenAI API key">
    <CodeGroup>
      ```bash Mac/Linux theme={null}
        export OPENAI_API_KEY="your_openai_api_key_here"
      ```

      ```bash Windows theme={null}
        $Env:OPENAI_API_KEY="your_openai_api_key_here"
      ```
    </CodeGroup>
  </Step>

  <Step title="Run Agent">
    ```bash theme={null}
    python reliability_async.py
    ```
  </Step>
</Steps>