Changes for version 0.300 - 2026-02-26
- Plugin system: Langertha::Plugin base class with lifecycle hooks (plugin_before_raid, plugin_build_conversation, plugin_before_llm_call, plugin_after_llm_response, plugin_before_tool_call, plugin_after_tool_call, plugin_after_raid) and self_tools support. Plugins can be specified by short name (resolved to Langertha::Plugin::* or LangerthaX::Plugin::*).
- Langertha::Plugin::Langfuse: Langfuse observability as a plugin (alternative to engine-level Role::Langfuse), with cascading traces, generations, and tool call spans in the Raider loop.
- Role::PluginHost: shared plugin hosting for engines and Raider, with plugin resolution, instantiation, and _plugin_instances caching.
- Wrapper classes: Langertha::Chat, Langertha::Embedder, Langertha::ImageGen for wrapping engines with optional overrides (model, system_prompt, temperature, etc.) and plugin lifecycle hooks.
- Class sugar: `use Langertha qw( Raider )` and `use Langertha qw( Plugin )` for quick subclass setup with auto-import of Moose and Future::AsyncAwait.
- Image generation: Role::ImageGeneration with image_model attribute, OpenAICompatible image_request/image_response/simple_image methods, OpenAI now composes ImageGeneration role (default: gpt-image-1).
- Role::KeepAlive: extracted keep_alive attribute from Ollama into a reusable role with get_keep_alive accessor.
- Ollama: update to current API — use operationIds chat/embed/list/ps (was generateChat/generateEmbeddings/getModels/getRunningModels), embedding response uses embeddings[0] (was embedding).
- NousResearch: reasoning_prompt is now a configurable attribute (was hardcoded string).
- Groq, Mistral, OpenAI: consolidate `with 'Langertha::Role::Tools'` into the main role composition block.
- Log::Any debug/trace logging in Role::Chat, Role::Embedding, Role::HTTP, Role::Tools, and Role::OpenAPI for request lifecycle visibility.
- Add Log::Any to cpanfile runtime dependencies.
- Update OpenAPI specs: openai.yaml, mistral.yaml, ollama.yaml to latest upstream versions.
- Pre-computed OpenAPI lookup tables: ship Langertha::Spec::OpenAI (148 ops), Langertha::Spec::Mistral (67 ops), and Langertha::Spec::Ollama (12 ops) as static Perl data instead of parsing YAML + constructing OpenAPI::Modern at runtime. Startup cost drops from ~16s to <1ms.
- New openapi_operations attribute in Role::OpenAPI with automatic fallback: engines that override _build_openapi_operations get the fast path; custom engines using openapi_file still work via the slow YAML/OpenAPI::Modern path.
- Add maint/generate_spec_data.pl to regenerate Spec modules from share/*.yaml when specs are updated.
- New tests: t/84_live_imagegen.t, t/87_raider_plugins.t, t/89_langertha_sugar.t, t/91_plugin_config.t, t/92_embedder.t, t/93_chat.t, t/94_plugin_langfuse.t, t/95_imagegen.t.
Documentation
Simple chat with Ollama
Simple chat with OpenAI
Simple script to check the model list on an OpenAI compatible API
Simple transcription with a Whisper compatible server or OpenAI
Modules
The clan of fierce vikings with 🪓 and 🛡️ to AId your rAId
Chat abstraction wrapping an engine with optional overrides
Embedding abstraction wrapping an engine with optional model override
AKI.IO native API
AKI.IO via OpenAI-compatible API
Anthropic API
Cerebras Inference API
DeepSeek API
Google Gemini API
GroqCloud API
llama.cpp server
MiniMax API
Mistral API
Nous Research Inference API
Ollama API
Ollama via OpenAI-compatible API
OpenAI API
Base class for OpenAI-compatible engines
OpenRouter API
Perplexity Sonar API
Base class for all remote engines
Replicate API
Whisper compatible transcription server
vLLM inference server
Image generation abstraction wrapping an engine with optional overrides
Base class for plugins
Langfuse observability plugin for any PluginHost
Autonomous agent with conversation history and MCP tools
Result object from a Raider raid
A HTTP Request inside of Langertha
LLM response with metadata
Role for APIs with normal chat functionality
Role for an engine where you can specify the context size (in tokens)
Role for APIs with embedding functionality
Role for HTTP APIs
Role for engines that support image generation
Role for JSON
Role for engines that support keep-alive duration
Langfuse observability integration
Role for APIs with several models
Role for OpenAI-compatible API format
Role for APIs with OpenAPI definition
Role for objects that host plugins (Raider, Engine)
Role for an engine where you can specify structured output
Role for an engine where you can specify the response size (in tokens)
Role for an engine that can set a seed
Role for streaming support
Role for APIs with system prompt
Role for an engine that can have a temperature setting
Configurable think tag filtering for reasoning models
Role for MCP tool calling support
Role for APIs with transcription functionality
Pre-computed OpenAPI operations for Mistral
Pre-computed OpenAPI operations for Ollama
Pre-computed OpenAPI operations for OpenAI
Iterator for streaming responses
Represents a single chunk from a streaming response
Bring your own viking!
Examples
- ex/async_await.pl
- ex/ctx.pl
- ex/embedding.pl
- ex/hermes_tools.pl
- ex/ircbot.pl
- ex/json_grammar.pl
- ex/langfuse-k8s.yaml
- ex/langfuse.pl
- ex/logic.pl
- ex/mcp_inprocess.pl
- ex/mcp_stdio.pl
- ex/ollama.pl
- ex/ollama_image.pl
- ex/raider.pl
- ex/raider_plugin_sugar.pl
- ex/raider_rag.pl
- ex/raider_run.pl
- ex/response.pl
- ex/sample.ogg
- ex/streaming_anthropic.pl
- ex/streaming_callback.pl
- ex/streaming_future.pl
- ex/streaming_gemini.pl
- ex/streaming_iterator.pl
- ex/streaming_mojo.pl
- ex/structured_code.pl
- ex/structured_output.pl
- ex/structured_sentences.pl
- ex/synopsis.pl
- ex/transcription.pl