/ 
Langertha-0.100
/ Langertha::Engine::Groq

NAME

Langertha::Engine::Groq - GroqCloud API

VERSION

version 0.100

SYNOPSIS

use Langertha::Engine::Groq;

my $groq = Langertha::Engine::Groq->new(
  api_key => $ENV{GROQ_API_KEY},
  model => 'llama-3.3-70b-versatile',
  system_prompt => 'You are a helpful assistant',
);

print($groq->simple_chat('Say something nice'));

# Audio transcription
my $text = $groq->transcription('/path/to/audio.mp3');

DESCRIPTION

This module provides access to Groq's ultra-fast LLM inference via their API. Groq's LPU (Language Processing Unit) provides extremely fast inference speeds.

Popular Models (February 2026):

  • llama-3.3-70b-versatile - Meta's Llama 3.3 70B model. Excellent general-purpose model with strong reasoning capabilities.

  • llama-3-groq-70b-tool-use - Llama 3 optimized for tool use and function calling.

  • deepseek-r1-distill-llama-70b - DeepSeek R1 reasoning model distilled into Llama architecture. Best for complex reasoning tasks.

  • qwen-2.5-coder-32b - Qwen 2.5 specialized for coding tasks.

  • llama-4-scout-17b-16e-instruct - Meta's Llama 4 Scout vision model for image understanding.

  • whisper-large-v3 - OpenAI Whisper for audio transcription (default transcription model).

  • whisper-large-v3-turbo - Faster Whisper variant for audio transcription.

Features:

  • Ultra-fast inference with Groq's LPU technology

  • Chat completions

  • Audio transcription (Whisper models)

  • Tool use and function calling

  • Vision models for image understanding

  • Reasoning models with chain-of-thought

  • Dynamic model discovery via API (inherited from OpenAI)

Note: Groq inherits from Langertha::Engine::OpenAI, so it supports list_models() for dynamic model discovery. See Langertha::Engine::OpenAI for documentation on model listing, caching, and other features.

THIS API IS WORK IN PROGRESS

HOW TO GET GROQ API KEY

https://console.groq.com/keys

SEE ALSO

SUPPORT

Issues

Please report bugs and feature requests on GitHub at https://github.com/Getty/langertha/issues.

CONTRIBUTING

Contributions are welcome! Please fork the repository and submit a pull request.

AUTHOR

Torsten Raudssus <torsten@raudssus.de> https://raudss.us/

COPYRIGHT AND LICENSE

This software is copyright (c) 2026 by Torsten Raudssus.

This is free software; you can redistribute it and/or modify it under the same terms as the Perl 5 programming language system itself.