agentura init

Initialize Agentura in your repository

Usage

bash

agentura init

What it does

Scaffolds an agentura.yaml config file in the current directory. If you include sample eval cases, it also creates an evals/ directory with example JSONL files.

Interactive prompts

Prompt	What to enter
Agent endpoint URL	Your agent's HTTP POST endpoint
Include sample eval cases?	Enter y to generate example files

Output

yaml

version: 1
agent:
  type: http
  endpoint: http://localhost:3001/api/agent
  timeout_ms: 10000
evals:
  - name: accuracy
    type: golden_dataset
    dataset: ./evals/accuracy.jsonl
    scorer: exact_match
    threshold: 0.8
ci:
  block_on_regression: false
  compare_to: main
  post_comment: true

Next steps

After init, run agentura generate to automatically create eval test cases for your specific agent.

agentura generate →