NAME
Alien::Xrepo - Install shared libraries and third-party binaries (tools, interpreters) for FFI, XS, and build systems
SYNOPSIS
use v5.40;
use Alien::Xrepo;
use Path::Tiny;
# Initialize
my $repo = Alien::Xrepo->new( );
# Add a custom repository (optional)
# $repo->add_repo( 'my-repo', 'https://github.com/my/repo.git' );
# Install a shared lib with an automatic configuration
my $ogg = $repo->install('libvorbis');
# Install a library with specific configuration
# equivalent to: xrepo install -p windows -a x86_64 -m debug --configs='shared=true,vs_runtime=MD' libpng
my $pkg = $repo->install(
'libpng', '1.6.x',
plat => 'windows',
arch => 'x64',
mode => 'debug',
configs => { vs_runtime => 'MD' }
);
die 'Install failed' unless $pkg;
# Or install a binary tool and run it (ninja, cmake, python, node, ...)
my $ninja = $repo->install('ninja');
my ($ninja_exe) = map { path($_)->child($^O eq 'MSWin32' ? 'ninja.exe' : 'ninja') } $ninja->bin_dir;
system $ninja_exe, '--version';
# Wrap a single function from sqlite3 with Affix
use Affix;
my $sqlite3 = $repo->install('sqlite3');
affix $sqlite3->libpath, 'sqlite3_libversion', [], String;
say 'SQLite version: ' . sqlite3_libversion();
DESCRIPTION
This module acts as an intelligent bridge between Perl and a wide range of package systems: xrepo, vcpkg, conan, brew (homebrew/linuxbrew), conda, dub (Dlang libs), apt on Debian, pacman (if you use arch, btw), clib, Cargo for Rust crates, Portage on Gentoo, Nimble for nimlang, NuGet for .NET, Zypper on openSUSE, and even your own custom repositories with smart prerequisite management.
With a single line, you can fetch shared libraries as well as binary tools and interpreters without touching a system package manager:
Libraries (
zlib,libpng,sqlite3, ...) to bind with FFI or link from XS.Tools and interpreters (
ninja,cmake,meson,python,node,go,rust, ...) to run from your Perl code or to drive your build.
You are free to install both kinds into the same store: ninja next to libpng. Use Affix, FFI::Platypus, Inline, or plain XS to bind the libraries, and bin_dir/installdir to locate and run the binaries.
While FFI or XS can handle the binding or linking to native functions, Alien::Xrepo handles the acquisition of the libraries and binaries. It automates the entire dependency lifecycle:
- 1. Provisioning:
-
Downloads and installs both libraries (
libpng,openssl, ...) and binary tools (ninja,python, ...) viaxrepo, handling version constraints and custom repository lookups. - 2. Configuration:
-
Ensures libraries are compiled with FFI compatible flags (forcing
sharedlibraries instead of static archives) and supports cross-compilation parameters (platform, architecture, toolchains). - 3. Introspection:
-
Parses the build metadata to locate the exact absolute paths to the runtime binaries (
.dll,.so,.dylib) and header files, thebin_dirof any installed tool, and the-I/-L/-lflags a compiler needs, abstracting away operating system filesystem differences.
This eliminates the need for manual compilation steps or hard coding paths in your Perl scripts, making your FFI bindings or XS wrappers portable and reproducible.
THIRD-PARTY PACKAGE MANAGERS
xrepo can install from external C/C++ package managers instead of (or alongside) the official xmake-repo. You select the manager with a package-spec namespace and every Alien::Xrepo method takes it verbatim:
# Vcpkg, Homebrew/Linuxbrew, Conan
my $zlib = $repo->install( 'vcpkg::zlib' );
my $zlib = $repo->install( 'brew::zlib' );
my $zlib = $repo->install( 'conan::zlib/1.2.11' );
# Pacman (archlinux/msys2), Clib, Dub, Cargo, Conda, apt
$repo->install( 'pacman::libcurl' );
$repo->install( 'dub::log 0.4.3' );
Searching and flag fetching work against them too:
$repo->search( 'vcpkg::pcre' ); # search the vcpkg namespace
my $flags = $repo->fetch( 'conan::zlib/1.2.11', undef, cflags => 1, ldflags => 1 );
The installed results (libpath, includedirs, links, ...) are decoded into an Alien::Xrepo::PackageInfo exactly like any xmake-repo package, so your wrapper code does not care where the library came from.
See the xmake-repo integration notes at https://github.com/xmake-io/xrepo-docs/blob/master/getting_started.md for the corresponding add_requires syntax inside an xmake project.
CONSTRUCTOR
new( ... )
my $repo = Alien::Xrepo->new( verbose => 1 );
Creates a new instance.
- verbose
-
Boolean. If true, prints command output and status messages to
STDOUT. Defaults to0. - root
-
Optional default installation root (package store) for this instance. Every store-touching method (
install,fetch,scan,uninstall, ...) usesinstalldir => $rootunless a per-callinstalldiris given, so the instance is confined to its own project-local directory instead of the shared per-user store. Used by Alien::Xrepo::Base and the dist builder to keep a distribution's native dependencies inside itssharedirectory. - theme
-
Optional xmake output theme, passed to xmake as
$ENV{XMAKE_THEME}. Defaults toplain, which suppresses ANSI color codes from xmake/xrepo output (clean CPAN test reports, CI logs, and captures). Settheme => 'default'to restore xmake's colored output. May be overridden per-call withtheme => ...on any store-touching method. - yes
-
Boolean. Auto-confirms interactive xmake/xrepo prompts (e.g. "are you sure to install these packages?") by passing
-y, so an install never hangs waiting onSTDIN. This is important when output is captured with Capture::Tiny, which would otherwise swallow the prompt.confirm => ...takes precedence when both are set. - confirm
-
Supplies an explicit answer (
yes,no, ordef) to any prompt, passed through as--confirm=.... Takes precedence overyes => 1. Both may be overridden per-call withyes => ...orconfirm => ...on any store-touching method.
METHODS
install( ... )
my $pkg_info = $repo->install( $package_name, $version_constraint, %options );
Installs (if missing) and fetches the metadata for a package.
- $package_name
-
The name of the package (e.g.,
zlib,opencv). - $version_constraint
-
Optional semantic version string (
1.2.x,latest). Passundefor an empty string for default. - %options
-
Optional configuration options passed to
xrepo(shared by most other methods and missing options are filled in automatically):- plat
-
Target platform (e.g.,
windows,linux,macosx,android,iphoneos,wasm). - arch
-
Target architecture (e.g.,
x86_64,arm64,riscv64). - mode
-
Build mode:
debugorrelease. - kind
-
Library kind:
shared(default) orstatic.Note: For FFI, you almost always want
shared, butstaticis available if you are linking archives with, say, an XS module. - toolchain
-
Specify a toolchain (e.g.,
llvm,zig,mingw). - toolchain_host
-
Specify the host toolchain for cross compilation.
- vs, vs_toolset, vs_sdkver
-
Visual Studio toolset/sdk selection (e.g.,
--vs=2017,--vs_toolset=14.0). - ndk
-
The Android NDK directory.
- sdk
-
The SDK directory of a cross toolchain.
- mingw
-
The MinGW SDK directory.
- jobs, linkjobs
-
Parallel compilation/link job counts.
- force
-
install/download: force reinstall/redownload all packages. remove: force removal even when still depended on.
- shallow
-
Do not install/download dependent packages.
- build
-
Always build and install from source.
- debugdir
-
Source directory used for debugging; enables
forceandshallowby default. - configs( ... )
-
A hashref or string of package-specific configurations.
configs => { openssl => 'true', shared => 'true' } # becomes --configs='openssl=true,shared=true' - includes
-
A list or string of extra dependencies to include in the environment.
- installdir, cachedir
-
Root directories for the installed packages and the download/build cache, applied per-call via the
XMAKE_PKG_INSTALLDIR/XMAKE_PKG_CACHEDIRenvironment variables. This lets each wrapper keep its libraries in a project-local directory instead of the shared per-user store, which gives reproducible builds and protects against an unrelatedxreporun upgrading or removing the packages your wrapper depends on. Pass the same values tofetch,scan,uninstall, and friends so they operate on the same store. - theme
-
Per-call xmake output theme override. Defaults to the
themeconstructor value (plain). See "new( ... )". - yes, confirm
-
Per-call auto-confirmation overrides for the constructor
yes => .../confirm => ...options, applied as-yor--confirm=...to the underlyingxrepoinvocation. Defaults to the constructor values. See "new( ... )".
Returns an Alien::Xrepo::PackageInfo object.
fetch( $pkg, $version, %options )
my $pkg_info = $repo->fetch( 'libpng' );
my $cflags = $repo->fetch( 'zlib', undef, cflags => 1 );
Fetches metadata for an already-installed package without installing it again. Returns an Alien::Xrepo::PackageInfo object, or a raw flag string when cflags or ldflags is requested.
- cflags
-
Fetch
-I...include flags as a string. - ldflags
-
Fetch
-L.../-l...link flags as a string. - deps
-
Fetch packages together with their dependencies.
- system
-
Only fetch the package on the current system.
- external
-
Show
cflagsas external packages (with-isystem). - installdir, cachedir
-
Target the same isolated store used by
install( ... )(see there).
info( $pkg, %options )
my $json = $repo->info( 'zlib', format => 'json' );
my $text = $repo->info( 'libpng' );
my $dot = $repo->info( 'libpng', depgraph => 1, format => 'dot' ); # dependency graph (Graphviz)
Shows package information. Pass format => 'json' to receive the decoded data structure (array of hashes), format => 'dot' for a Graphviz DOT dependency graph, or depgraph => 1 to include the package dependency tree. A DOT graph can be rendered with dot -Tpng dep.dot -o dep.png.
scan( [$pkg], %options )
my @installed = $repo->scan( 'libpng' );
my @all = $repo->scan( );
Lists installed packages (optionally filtered by a lua pattern). Returns the output lines as a list.
download( $pkg, $version, %options )
$repo->download( 'zlib', undef, outputdir => './dl', shallow => 1 );
Only downloads the package source archives without building them. outputdir selects the destination directory (default packages). Supports force, shallow and the standard %options.
import_pkg( $pkg, $version, %options )
$repo->import_pkg( 'zlib', undef, packagedir => './packages' );
Imports pre-downloaded package archives into the local cache. packagedir selects the source directory.
export( $pkg, $version, %options )
$repo->export( 'zlib', undef, packagedir => './packages', shallow => 1 );
Exports installed package files for offline use. packagedir selects the destination directory.
env( [$program], %options )
$repo->env( 'bash', bind => 'zlib' ); # run a program inside the package env
$repo->env( undef, show => 1 ); # only print the environment
Sets up the package environment and either prints it (show) or executes $program (default shell) inside it. bind selects which environment config or package to bind, list lists global configs, and add/remove manage global environment config files.
list_repo( )
my @repos = $repo->list_repo( );
Lists all configured remote repositories (output lines).
uninstall( $lib, %options )
$repo->uninstall( 'zlib' );
$repo->uninstall( 'zl*', all => 1 );
Removes the specified package from the local cache. Accepts the same %options as install( ... ). all removes all matching packages (ignoring extra configs, lua patterns allowed) and force removes addon packages even when they are still depended upon.
search( $query, %options )
$repo->search( $query );
$repo->search( $query, addon => 1 );
Runs xrepo search and prints the results to STDOUT. addon searches the addons/ sub-repository.
clean( %options )
$repo->clean( );
$repo->clean( installdir => './store' ); # clean an isolated store
Cleans the cached packages and downloads. Pass installdir and/or cachedir to target an isolated store.
add_repo( ... )
$repo->add_repo( $name, $git_url, $branch );
Adds a custom xmake repository.
remove_repo( ... )
$repo->remove_repo( $name );
Removes a custom repository.
update_repo( [$repo] )
$repo->update_repo( ); # Update all
$repo->update_repo( 'main' ); # Update specific repo
Updates the local package lists from the remote repositories.
Alien::Xrepo::PackageInfo
Returned by install( ... ), this object contains the results of the dependency resolution.
Attributes
- libpath
-
The absolute path to the main library file (
.dll,.dylib, or.so). Returnsundefif the package is header-only or the binary could not be identified. - includedirs
-
List of include paths.
- installdir
-
The package install root. Packages that mostly exist as tools or runnable binaries (
ninja,python,cmake, ...) put their executables underinstalldir/bin. - bin_dir
-
List of directories holding executables. Comes from the
bindirsfetch metadata, or falls back toinstalldir/binwhen the package is a tool. Run a freshly installed binary like so:my $ninja = $repo->install('ninja'); my ($exe) = grep { -e $_ } map { path($_)->child($^O eq 'MSWin32' ? 'ninja.exe' : 'ninja') } $ninja->bin_dir; system $exe, '--version'; - libfiles
-
List of all library files associated with the package (may include import libs, static archives, etc.).
- license
-
The license identifier.
- version
-
The installed version.
Methods
find_header( ... )
my $path = $info->find_header( 'png.h' );
Scans includedirs for the given filename and returns the absolute path if found. Returns undef otherwise.
Examples
If you just want to use a library, copy one of these. Each one installs whatever is missing on the first run and takes care of the rest.
Hello World (install then call)
install( ... ) downloads and builds the library for you, then libpath points Affix or FFI::Platypus to the matching shared .dll / .so / .dylib.
Affix first:
use v5.40;
use Alien::Xrepo;
use Affix;
my $zlib = Alien::Xrepo->new->install('zlib');
affix $zlib->libpath, 'zlibVersion', [], String;
say 'zlib ' . zlibVersion();
The same simple demo with FFI::Platypus:
use v5.40;
use Alien::Xrepo;
use FFI::Platypus;
my $zlib = Alien::Xrepo->new->install('zlib');
my $ffi = FFI::Platypus->new;
$ffi->lib( $zlib->libpath );
$ffi->attach( zlibVersion => [] => 'string' );
say 'zlib ' . zlibVersion();
And if you want the whole library wrapped (prototypes generated from the headers) instead of one function at a time, use Affix::Wrap:
use v5.40;
use Alien::Xrepo;
use Affix::Wrap;
my $zlib = Alien::Xrepo->new->install('zlib');
Affix::Wrap->new(
project_files => [ $zlib->find_header('zlib.h') ],
include_dirs => [ $zlib->includedirs ],
types => { gzFile_s => Pointer [Void] }
)->wrap( $zlib->libpath );
say 'zlib ' . zlibVersion();
Link an XS extension with Inline::C (multiple libraries)
Same idea for an actual C extension, compiled with Inline::C. Install every library you want to link; merge their include and link directories, hand them to Inline::C, and write plain C that uses whichever header you need. Here we bind both libpng and zlib (installed together into one store) into a single XS function:
use v5.40;
use Alien::Xrepo;
use Config;
my $repo = Alien::Xrepo->new;
my $png = $repo->install('libpng'); # shared lib
my $zlib = $repo->install('zlib'); # second shared lib
# The compiled XS loads png.dll / libpng.so at runtime, so put both native
# "bin" dirs on PATH before calling into it (Windows especially).
my @png_bins = $png->bin_dir;
my @zlib_bins = $zlib->bin_dir;
local $ENV{PATH} = join $Config{path_sep}, (@png_bins, @zlib_bins, $ENV{PATH});
# Merge include and link directories into plain flag strings.
my $incs = join ' ', map { "-I$_" } (@{ $png->includedirs }, @{ $zlib->includedirs });
my $libs = join ' ',
map { "-L$_" } (@{ $png->linkdirs }, @{ $zlib->linkdirs }),
map { "-l$_" } (@{ $png->links }, @{ $zlib->links });
use Inline ();
Inline->bind(
'C',
<<'C',
#include <png.h>
#include <zlib.h>
const char *versions () {
return "libpng " PNG_LIBPNG_VER_STRING ", zlib " ZLIB_VERSION;
}
C
INC => $incs,
LIBS => $libs,
);
say versions();
The eg/xrepo_inline_c.pl script is the runnable copy of this example. Inline::C is not installed with this distribution - install it once with cpanm Inline::C.
Install and run a binary tool
xrepo does not build only shared libraries - it also ships ready-to-run binaries (ninja, cmake, meson, node, python, go, rust, ...). install returns the package installdir, and bin_dir tells you where the executables live. Run one directly, or stick bin_dir in front of PATH so all the children you spawn find the tool:
use v5.40;
use Alien::Xrepo;
use Path::Tiny;
use Config;
my $repo = Alien::Xrepo->new;
my $ninja = $repo->install('ninja');
my @bins = $ninja->bin_dir;
# Option A: run a single binary from bin_dir
my ($ninja_exe) = map { path($_)->child($^O eq 'MSWin32' ? 'ninja.exe' : 'ninja') } @bins;
system $ninja_exe, '--version';
# Option B: put bin_dir first on PATH, then plain 'ninja' resolves
local $ENV{PATH} = join $Config{path_sep}, (@bins, $ENV{PATH});
system 'ninja', '--version';
Use installdir for everything the tool ships, not just bin:
say 'ninja install root: ' . $ninja->installdir;
Build a C program against a library
install builds the library once; fetch tells you the -I... and -L.../-l... flags if you are building with something other than xmake (e.g. MakeMaker or a plain cc):
use v5.40;
use Alien::Xrepo;
my $repo = Alien::Xrepo->new;
$repo->install( 'libpng' ); # build it once
my $cflags = $repo->fetch( 'libpng', undef, cflags => 1 );
my $ldflags = $repo->fetch( 'libpng', undef, ldflags => 1 );
say "cc $cflags $ldflags pngprog.c -o pngprog";
What can I install? What do I already have?
use v5.40;
use Alien::Xrepo;
my $repo = Alien::Xrepo->new;
say '[What is available?]';
$repo->search('sqlite');
say '[Already installed:]';
say for $repo->scan;
search prints matching packages from every configured repository and scan lists everything already on disk.
Cross-compile without memorizing SDK paths
All of xrepo's platform switches become named options. ndk is just one example, alongside toolchain, sdk, mingw and the rest.
use v5.40;
use Alien::Xrepo;
my $pkg = Alien::Xrepo->new->install(
'zlib', '1.3.x',
plat => 'android',
arch => 'arm64',
ndk => 'C:/Android/Sdk/ndk/26.1.10909125' # adapt to your NDK
);
say $pkg->libpath;
Drop into a shell inside the library's environment
env sets up the environment for a package (PATH, etc.) and either runs $program inside it (default: the system shell) or just prints it with show.
use v5.40;
use Alien::Xrepo;
Alien::Xrepo->new->env( 'bash', bind => 'zlib' ); # or env( undef, bind => 'zlib' )
# Alien::Xrepo->new->env( undef, show => 1 ); # just print the environment
SEE ALSO
https://xrepo.xmake.io, https://packages.xmake.io/
Affix, Affix::Wrap, Alien::Xmake, FFI::Platypus, Inline::C; subclass the base class with Alien::Xrepo::Base
LICENSE
Copyright (C) Sanko Robinson.
This library is free software; you can redistribute it and/or modify it under the terms found in the Artistic License 2. Other copyrights, terms, and conditions may apply to data transmitted through this module.
AUTHOR
Sanko Robinson https://github.com/sanko