Skip to content

Pipelex Features

Pipelex is the reference runtime for AI methods written in MTHDS. This section covers the main capabilities you use to define methods, run them, and operate them in production.

This section covers all Pipelex capabilities, organized by area.

Declarative AI Methods

  • MTHDS Language

    A declarative, TOML-based .mthds file format for defining AI methods without writing code. Domains, bundles, packages, and cross-references.

  • Concepts & Structured Types

    Semantic typing system for AI data. Native types, inline structures, Python classes, concept refinement, and hierarchies.

  • Pipe Operators

    The workers that do the actual processing: PipeLLM, PipeExtract, PipeImgGen, PipeSearch, PipeCompose, and PipeFunc.

  • Pipeline Orchestration

    Controllers for building complex workflows: PipeSequence, PipeParallel, PipeBatch, PipeCondition, and working memory for data flow.

AI Capabilities

  • Pipelex Gateway & Model Access

    Unified access to 60+ AI models through a single API key, or bring your own keys for direct provider access. Open-source model support via Hugging Face, Scaleway, and Groq.

  • LLM Integration

    Text generation, structured outputs, vision language models, prompting styles, system prompt inheritance, and model presets.

  • Document Extraction

    Multi-provider OCR with Mistral OCR, Azure Document Intelligence, docling, and Deepseek-OCR. PDF processing, page rendering, layout analysis, and table recognition.

  • Image Generation

    Text-to-image generation with FLUX, GPT Image, and other providers. Cloud storage integration for generated images.

  • Web Search

    Structured web search results with source citations and advanced filters via PipeSearch.

Developer Tools

  • Claude Code Skills Plugin

    Build, run, validate, and edit AI methods directly from Claude Code with the MTHDS skills plugin. Slash commands cover the full method lifecycle.

  • CLI

    Full command-line interface: login, init, doctor, build, validate, run, graph, show, which, and more. Dry run mode, graph generation, and agent CLI.

  • plxt Formatter & Linter

    Fast formatting and linting for TOML, MTHDS, and PLX files. CI-ready with --check mode.

  • Execution Graph Visualization

    Interactive HTML visualization and Mermaid chart export for pipeline execution. Step-by-step data inspection with JSON, HTML, images, and PDFs.

Production & Operations

  • Validation & Dry Run

    Pipeline validation without execution, dry run with mocked LLM responses, input validation, and allowed-to-fail pipes.

  • Telemetry & Observability

    Production monitoring with Langfuse, OpenTelemetry, and PostHog integration. Gateway telemetry, span tracing, and custom destinations.

  • Cloud Storage

    Store generated artifacts on AWS S3 or Google Cloud Storage with public or signed URLs.

  • Cost Tracking & Reporting

    Automatic token cost tracking per operation with console logging and CSV report export.

Configuration & Extensibility

  • Configuration System

    Multi-level TOML configuration: base defaults, project overrides, environment-specific, and run-mode-specific. Environment variable support.

  • Advanced Customizations

    Dependency injection framework for secrets, storage, observers, content generators, and pipe routers.