The London Perl and Raku Workshop takes place on 26th Oct 2024. If your company depends on Perl, please consider sponsoring and/or attending.

Changes for version 0.004

  • Change: ae525aa4b1af0b6379ad15ec603b05b06540cd55 Author: Torsten Raudssus <torsten@raudss.us> Date : 2024-08-13 23:10:57 +0000
    • Fixing interpretation of max_tokens on Anthropic (thought its context, but its response size), adapted code and tests

Documentation

Simple chat with Ollama
Simple chat with OpenAI
Simple transcription with a Whisper compatible server or OpenAI

Modules

The clan of fierce vikings with 🪓 and 🛡️ to AId your rAId
Whisper compatible transcription server
vLLM inference server
A HTTP Request inside of Langertha
Role for APIs with normal chat functionality
Role for an engine where you can specify the context size (in tokens)
Role for APIs with embedding functionality
Role for HTTP APIs
Role for JSON
Role for APIs with several models
Role for APIs with OpenAPI definition
Role for an engine where you can specify the response size (in tokens)
Role for an engine that can set a seed
Role for APIs with system prompt
Role for an engine that can have a temperature setting
Role for APIs with transcription functionality
Bring your own viking!