@@ -70,6 +70,7 @@ Restart your LLM client, and you're ready to go!
7070
7171- ** DAG-Based Workflows** : Automatic dependency resolution and parallel execution
7272- ** 🔐 Secrets Management** : Server-side credential handling with automatic redaction (v5.0.0+)
73+ - ** 🤖 LLM Integration** : Native LLM API calls with schema validation and retry logic
7374- ** Workflow Composition** : Reusable workflows via Workflow blocks
7475- ** Conditional Execution** : Boolean expressions for dynamic control flow
7576- ** Variable Resolution** : Five-namespace system (inputs, metadata, blocks, secrets, __ internal__ )
@@ -114,6 +115,47 @@ blocks:
114115}
115116```
116117
118+ ### 🤖 LLM Integration
119+
120+ Call LLM APIs directly from workflows with automatic retry logic and JSON schema validation:
121+
122+ ``` yaml
123+ blocks :
124+ - id : extract_data
125+ type : LLMCall
126+ inputs :
127+ provider : openai
128+ model : gpt-4o-mini
129+ api_key : " {{secrets.OPENAI_API_KEY}}"
130+ prompt : " Extract key information from: {{inputs.text}}"
131+ response_schema :
132+ type : object
133+ required : [summary, confidence]
134+ properties :
135+ summary : {type: string}
136+ confidence : {type: number, minimum: 0, maximum: 1}
137+ max_retries : 3
138+ ` ` `
139+
140+ **Supported Providers:**
141+
142+ - **OpenAI** - API access with native Structured Outputs
143+ - **Anthropic** - API access for Claude models
144+ - **Gemini** - API access for Gemini models
145+ - **Ollama** - Local Ollama server API
146+ - **OpenAI-compatible** - LM Studio, vLLM, and other compatible endpoints
147+
148+ **Key Features:**
149+
150+ - ✅ **Native schema validation** - Send JSON Schema to API for guaranteed structure
151+ - ✅ **Automatic retry** - Exponential backoff with validation feedback loop
152+ - ✅ **Token tracking** - Monitor usage and costs
153+ - ✅ **Secrets integration** - Secure API key management
154+
155+ **For Local CLI Tools:**
156+
157+ To use local Claude CLI or Gemini CLI instead of APIs, use the ` llm-process` workflow template which wraps CLI commands.
158+
117159# # What Can You Do With It?
118160
119161# ## Built-in Workflows
0 commit comments