NAME

Langertha::Engine::vLLM - vLLM inference server

VERSION

version 0.100

SYNOPSIS

use Langertha::Engine::vLLM;

my $vllm = Langertha::Engine::vLLM->new(
  url => $ENV{VLLM_URL},
  model => $ENV{VLLM_MODEL},
  system_prompt => 'You are a helpful assistant',
);

print($vllm->simple_chat('Say something nice'));

DESCRIPTION

THIS API IS WORK IN PROGRESS

HOW TO INSTALL VLLM

https://docs.vllm.ai/en/latest/getting_started/installation.html

SUPPORT

Issues

Please report bugs and feature requests on GitHub at https://github.com/Getty/langertha/issues.

CONTRIBUTING

Contributions are welcome! Please fork the repository and submit a pull request.

AUTHOR

Torsten Raudssus <torsten@raudssus.de> https://raudss.us/

COPYRIGHT AND LICENSE

This software is copyright (c) 2026 by Torsten Raudssus.

This is free software; you can redistribute it and/or modify it under the same terms as the Perl 5 programming language system itself.