Introduction to Provably Docs

SourceryKit is the Python SDK for Provably. It provides verifiable guardrails for AI agents by automatically recording outbound HTTP calls, enforcing endpoint policies, and checking your agent’s claims against a source of truth—all before any request leaves your process.

How Does It Work?

SourceryKit handles policy enforcement and logging right inside your agent’s normal workflow:

The Pieces

• HTTP Interceptor: Patches your HTTP libraries to watch and log outbound calls, blocking untrusted requests on the spot.
• Trusted Endpoints: A database allow-list of approved destinations for your agent.
• Intercepts Table: An append-only DB table that logs every request and response for auditing.
• SourceryKitAgentResponse: A Pydantic model used as the structured response_format for your agent. Enforces a typed response contract with a claimed_values list of extracted values.
• Handoff Payload: A clean data bundle containing the claims your agent is making about its external actions.
• Evaluator: Compares the handoff payload against records in the Provably backend to give you a clear verdict.
• Provably Backend: The source of truth that turns your local intercepts into anchored verification proofs.

Installation

SourceryKit requires Python 3.12+. You can grab it directly from source:

git clone [email protected]:ProvablyAI/sourcerykit.git
pip install -e ./sourcerykit

Or install it directly via pip:

pip install sourcerykit

Configuration

To get things running, SourceryKit must be configured with your project variables. The interactive CLI handles account provisioning, organization workspace initialization, database validation, and persists credentials globally (OS application folder) and locally (project .env).

sourcerykit init

The wizard will guide you through:

• Account Setup & Authorization: Create a new account or log into an existing one, and select your organization workspace.
• API Key Generation: Automatically fetch your SDK API-KEY from your account profile.
• Database Handshake: Enter your database details, test the connection, and ensure it’s accessible.
• Save Config: Automatically write your credentials and tokens straight to a local .env file.

For a full list of CLI commands, check out the CLI commands file, or simply run:

sourcerykit --help

For a full list of environment variables, see .env.example.

Manual configuration (fallback)

Already have credentials, or need to bypass the wizard (CI, containers, debugging)? Environment variables override the stored config:

export PROVABLY_API_KEY="..."
export SOURCERYKIT_ORG_ID="..."
export SOURCERYKIT_POSTGRES_URL="postgresql://user:password@host:5432/db"

Quick Example

Here is how to bootstrap the system, run an intercepted request, build a payload, and check if everything passes validation:

import uuid
import httpx
import sourcerykit
from agents import Agent, Runner
from sourcerykit import SourceryKitAgentResponse

async def run_verifiable_agent():
    # 1. Fire up the system
    await sourcerykit.bootstrap_system()

    # 2. Tell the registry which URL is allowed
    await sourcerykit.insert_trusted_endpoint(url="https://api.example.com/data")

    # 3. Make a network call inside an intercept context
    async with sourcerykit.async_intercept_context(agent_id="demo-agent", action_name="get_data"):
        async with httpx.AsyncClient() as client:
            response = await client.get(
                "https://api.example.com/data",
                params={"query": "example_parameter"}
            )
            response.raise_for_status()

    # 4. Configure your agent with SourceryKitAgentResponse as the structured output type
    #    and run it. Each framework exposes the typed result differently, but the output
    #    is always a SourceryKitAgentResponse with `claimed_values`.
    #    Pass the keyword argument supported by your framework, e.g.:
    #      output_type=SourceryKitAgentResponse   (OpenAI Agents SDK)
    #      response_format=SourceryKitAgentResponse  (LangChain)
    prompt = You are a helpful assistant.
    agent = Agent(
        name="demo-agent",
        instructions=prompt,
        tools=[...],
        model=MODEL_NAME,
        output_type=SourceryKitAgentResponse,
    )
    result = await Runner.run(agent, prompt)
    final_output: SourceryKitAgentResponse = result.final_output

    # 5. Build the handoff payload from the agent's structured output
    payload_data = {
        "reasoning": final_output.reasoning,
        "claims": [
            {
                "action_name": "get_data",
                "claimed_value": final_output.claimed_values,
                "verification_mode": "field_extraction",
            }
        ],
    }

    payload = await sourcerykit.build_handoff_payload(
        payload_data,
        run_id=uuid.uuid4(),
        prompt=prompt,
        intercept_agent_id="demo-agent",
    )

    # 6. Ask the evaluator for a verdict
    result = await sourcerykit.evaluate_handoff(payload=payload)
    print(f"Evaluation Outcome: {result.get('outcome')}") # PASS, CAUGHT, or ERROR

More Docs

Want to dig into the details? Check out our documentation and specific guides:

• Official Documentation: Visit provably.ai/docs for the complete reference.
• End-to-End Walkthrough — Get up and running from scratch.
• Cookbooks & Examples — Practical recipes and code samples.

Technical Guides

• Architecture Overview
• HTTP Interception
• Managing Trusted Endpoints
• Handoff Contracts & Evaluation

Contributing

We welcome fixes, features, and doc updates! Check out CONTRIBUTING.md to see how to run tests and open up a pull request.

License

This project is licensed under the Business Source License 1.1.

• Copyright © 2026 Provably Technologies LTD
• You may not offer the Software as a commercial hosted service without purchasing a commercial license from Provably Technologies Ltd.
• On 2029-05-07, the license will automatically convert to GPL-3.0-or-later.
  

See the LICENSE file for full terms and details.