NAME
Alien::Xrepo - Install shared libraries and third-party binaries (tools, interpreters) for FFI, XS, and build systems
SYNOPSIS
use v5.40;
use Alien::Xrepo;
use Path::Tiny;
# Initialize
my $repo = Alien::Xrepo->new( );
# Add a custom repository (optional)
# $repo->add_repo( 'my-repo', 'https://github.com/my/repo.git' );
# Install a shared lib with an automatic configuration
my $ogg = $repo->install('libvorbis');
# Install a library with specific configuration
# equivalent to: xrepo install -p windows -a x86_64 -m debug --configs='shared=true,vs_runtime=MD' libpng
my $pkg = $repo->install(
'libpng', '1.6.x',
plat => 'windows',
arch => 'x64',
mode => 'debug',
configs => { vs_runtime => 'MD' }
);
die 'Install failed' unless $pkg;
# Or install a binary tool and run it (ninja, cmake, python, node, ...)
my $ninja = $repo->install('ninja');
my ($ninja_exe) = map { path($_)->child($^O eq 'MSWin32' ? 'ninja.exe' : 'ninja') } $ninja->bin_dir;
system $ninja_exe, '--version';
# Wrap a single function from sqlite3 with Affix
use Affix;
my $sqlite3 = $repo->install('sqlite3');
affix $sqlite3->libpath, 'sqlite3_libversion', [], String;
say 'SQLite version: ' . sqlite3_libversion();
DESCRIPTION
This module acts as an intelligent bridge between Perl and a wide range of package systems: xrepo, vcpkg, conan, brew (homebrew/linuxbrew), conda, dub (Dlang libs), apt on Debian, pacman (if you use arch, btw), clib, Cargo for Rust crates, Portage on Gentoo, Nimble for nimlang, NuGet for .NET, Zypper on openSUSE, and even your own custom repositories with smart prerequisite management.
With a single line, you can fetch shared libraries as well as binary tools and interpreters without touching a system package manager:
Libraries (
zlib,libpng,sqlite3, ...) to bind with FFI or link from XS.Tools and interpreters (
ninja,cmake,meson,python,node,go,rust, ...) to run from your Perl code or to drive your build.
You are free to install both kinds into the same store: ninja next to libpng. Use Affix, FFI::Platypus, Inline, or plain XS to bind the libraries, and bin_dir/installdir to locate and run the binaries.
While FFI or XS can handle the binding or linking to native functions, Alien::Xrepo handles the acquisition of the libraries and binaries. It automates the entire dependency lifecycle:
- 1. Provisioning:
-
Downloads and installs both libraries (
libpng,openssl, ...) and binary tools (ninja,python, ...) viaxrepo, handling version constraints and custom repository lookups. - 2. Configuration:
-
Ensures libraries are compiled with FFI compatible flags (forcing
sharedlibraries instead of static archives) and supports cross-compilation parameters (platform, architecture, toolchains). - 3. Introspection:
-
Parses the build metadata to locate the exact absolute paths to the runtime binaries (
.dll,.so,.dylib) and header files, thebin_dirof any installed tool, and the-I/-L/-lflags a compiler needs, abstracting away operating system filesystem differences.
This eliminates the need for manual compilation steps or hard coding paths in your Perl scripts, making your FFI bindings or XS wrappers portable and reproducible.
THIRD-PARTY PACKAGE MANAGERS
xrepo can install from external C/C++ package managers instead of (or alongside) the official xmake-repo. You select the manager with a package-spec namespace and every Alien::Xrepo method takes it verbatim:
# Vcpkg, Homebrew/Linuxbrew, Conan
my $zlib = $repo->install( 'vcpkg::zlib' );
my $zlib = $repo->install( 'brew::zlib' );
my $zlib = $repo->install( 'conan::zlib/1.2.11' );
# Pacman (archlinux/msys2), Clib, Dub, Cargo, Conda, apt
$repo->install( 'pacman::libcurl' );
$repo->install( 'dub::log 0.4.3' );
Searching and flag fetching work against them too:
$repo->search( 'vcpkg::pcre' ); # search the vcpkg namespace
my $flags = $repo->fetch( 'conan::zlib/1.2.11', undef, cflags => 1, ldflags => 1 );
The installed results (libpath, includedirs, links, ...) are decoded into an Alien::Xrepo::PackageInfo exactly like any xmake-repo package, so your wrapper code does not care where the library came from.
See the xmake-repo integration notes at https://github.com/xmake-io/xrepo-docs/blob/master/getting_started.md for the corresponding add_requires syntax inside an xmake project.
CONSTRUCTOR
new( ... )
my $repo = Alien::Xrepo->new( verbose => 1 );
Creates a new instance.
- verbose
-
Boolean. If true, prints command output and status messages to
STDOUT. Defaults to0. - root
-
Optional default installation root (package store) for this instance. Every store-touching method (
install,fetch,scan,uninstall, ...) usesinstalldir => $rootunless a per-callinstalldiris given, so the instance is confined to its own project-local directory instead of the shared per-user store. Used by Alien::Xrepo::Base and the dist builder to keep a distribution's native dependencies inside itssharedirectory. - theme
-
Optional xmake output theme, passed to xmake as
$ENV{XMAKE_THEME}. Defaults toplain, which suppresses ANSI color codes from xmake/xrepo output (clean CPAN test reports, CI logs, and captures). Settheme => 'default'to restore xmake's colored output. May be overridden per-call withtheme => ...on any store-touching method. - yes
-
Boolean. Auto-confirms interactive xmake/xrepo prompts (e.g. "are you sure to install these packages?") by passing
-y, so an install never hangs waiting onSTDIN. This is important when output is captured with Capture::Tiny, which would otherwise swallow the prompt.confirm => ...takes precedence when both are set. - confirm
-
Supplies an explicit answer (
yes,no, ordef) to any prompt, passed through as--confirm=.... Takes precedence overyes => 1. Both may be overridden per-call withyes => ...orconfirm => ...on any store-touching method.
METHODS
install( ... )
my $pkg_info = $repo->install( $package_name, $version_constraint, %options );
Installs (if missing) and fetches the metadata for a package.
- $package_name
-
The name of the package (e.g.,
zlib,opencv). - $version_constraint
-
Optional semantic version string (
1.2.x,latest). Passundefor an empty string for default. - %options
-
Optional configuration options passed to
xrepo(shared by most other methods and missing options are filled in automatically):- plat
-
Target platform (e.g.,
windows,linux,macosx,android,iphoneos,wasm). - arch
-
Target architecture (e.g.,
x86_64,arm64,riscv64). - mode
-
Build mode:
debugorrelease. - kind
-
Library kind:
shared(default) orstatic.Note: For FFI, you almost always want
shared, butstaticis available if you are linking archives with, say, an XS module. - toolchain
-
Specify a toolchain (e.g.,
llvm,zig,mingw). - toolchain_host
-
Specify the host toolchain for cross compilation.
- vs, vs_toolset, vs_sdkver
-
Visual Studio toolset/sdk selection (e.g.,
--vs=2017,--vs_toolset=14.0). - ndk
-
The Android NDK directory.
- sdk
-
The SDK directory of a cross toolchain.
- mingw
-
The MinGW SDK directory.
- jobs, linkjobs
-
Parallel compilation/link job counts.
- force
-
install/download: force reinstall/redownload all packages. remove: force removal even when still depended on.
- shallow
-
Do not install/download dependent packages.
- build
-
Always build and install from source.
- debugdir
-
Source directory used for debugging; enables
forceandshallowby default. - configs( ... )
-
A hashref or string of package-specific configurations.
configs => { openssl => 'true', shared => 'true' } # becomes --configs='openssl=true,shared=true' - includes
-
A list or string of extra dependencies to include in the environment.
- installdir, cachedir
-
Root directories for the installed packages and the download/build cache, applied per-call via the
XMAKE_PKG_INSTALLDIR/XMAKE_PKG_CACHEDIRenvironment variables. This lets each wrapper keep its libraries in a project-local directory instead of the shared per-user store, which gives reproducible builds and protects against an unrelatedxreporun upgrading or removing the packages your wrapper depends on. Pass the same values tofetch,scan,uninstall, and friends so they operate on the same store. - theme
-
Per-call xmake output theme override. Defaults to the
themeconstructor value (plain). See "new( ... )". - yes, confirm
-
Per-call auto-confirmation overrides for the constructor
yes => .../confirm => ...options, applied as-yor--confirm=...to the underlyingxrepoinvocation. Defaults to the constructor values. See "new( ... )".
Returns an Alien::Xrepo::PackageInfo object.
fetch( $pkg, $version, %options )
my $pkg_info = $repo->fetch( 'libpng' );
my $cflags = $repo->fetch( 'zlib', undef, cflags => 1 );
Fetches metadata for an already-installed package without installing it again. Returns an Alien::Xrepo::PackageInfo object, or a raw flag string when cflags or ldflags is requested.
- cflags
-
Fetch
-I...include flags as a string. - ldflags
-
Fetch
-L.../-l...link flags as a string. - deps
-
Fetch packages together with their dependencies.
- system
-
Only fetch the package on the current system.
- external
-
Show
cflagsas external packages (with-isystem). - installdir, cachedir
-
Target the same isolated store used by
install( ... )(see there).
info( $pkg, %options )
my $json = $repo->info( 'zlib', format => 'json' );
my $text = $repo->info( 'libpng' );
my $dot = $repo->info( 'libpng', depgraph => 1, format => 'dot' ); # dependency graph (Graphviz)
Shows package information. Pass format => 'json' to receive the decoded data structure (array of hashes), format => 'dot' for a Graphviz DOT dependency graph, or depgraph => 1 to include the package dependency tree. A DOT graph can be rendered with dot -Tpng dep.dot -o dep.png.
scan( [$pkg], %options )
my @installed = $repo->scan( 'libpng' );
my @all = $repo->scan( );
Lists installed packages (optionally filtered by a lua pattern). Returns the output lines as a list.
download( $pkg, $version, %options )
$repo->download( 'zlib', undef, outputdir => './dl', shallow => 1 );
Only downloads the package source archives without building them. outputdir selects the destination directory (default packages). Supports force, shallow and the standard %options.
import_pkg( $pkg, $version, %options )
$repo->import_pkg( 'zlib', undef, packagedir => './packages' );
Imports pre-downloaded package archives into the local cache. packagedir selects the source directory.
export( $pkg, $version, %options )
$repo->export( 'zlib', undef, packagedir => './packages', shallow => 1 );
Exports installed package files for offline use. packagedir selects the destination directory.
env( [$program], %options )
$repo->env( 'bash', bind => 'zlib' ); # run a program inside the package env
$repo->env( undef, show => 1 ); # only print the environment
Sets up the package environment and either prints it (show) or executes $program (default shell) inside it. bind selects which environment config or package to bind, list lists global configs, and add/remove manage global environment config files.
list_repo( )
my @repos = $repo->list_repo( );
Lists all configured remote repositories (output lines).
uninstall( $lib, %options )
$repo->uninstall( 'zlib' );
$repo->uninstall( 'zl*', all => 1 );
Removes the specified package from the local cache. Accepts the same %options as install( ... ). all removes all matching packages (ignoring extra configs, lua patterns allowed) and force removes addon packages even when they are still depended upon.
search( $query, %options )
$repo->search( $query );
$repo->search( $query, addon => 1 );
Runs xrepo search and prints the results to STDOUT. addon searches the addons/ sub-repository.
clean( %options )
$repo->clean( );
$repo->clean( installdir => './store' ); # clean an isolated store
Cleans the cached packages and downloads. Pass installdir and/or cachedir to target an isolated store.
add_repo( ... )
$repo->add_repo( $name, $git_url, $branch );
Adds a custom xmake repository.
remove_repo( ... )
$repo->remove_repo( $name );
Removes a custom repository.
update_repo( [$repo] )
$repo->update_repo( ); # Update all
$repo->update_repo( 'main' ); # Update specific repo
Updates the local package lists from the remote repositories.
Alien::Xrepo::PackageInfo
Returned by install( ... ), this object contains the results of the dependency resolution.
Attributes
- libpath
-
The absolute path to the main library file (
.dll,.dylib, or.so). Returnsundefif the package is header-only or the binary could not be identified. - includedirs
-
List of include paths.
- installdir
-
The package install root. Packages that mostly exist as tools or runnable binaries (
ninja,python,cmake, ...) put their executables underinstalldir/bin. - bin_dir
-
List of directories holding executables. Comes from the
bindirsfetch metadata, or falls back toinstalldir/binwhen the package is a tool. Run a freshly installed binary like so:my $ninja = $repo->install('ninja'); my ($exe) = grep { -e $_ } map { path($_)->child($^O eq 'MSWin32' ? 'ninja.exe' : 'ninja') } $ninja->bin_dir; system $exe, '--version'; - libfiles
-
List of all library files associated with the package (may include import libs, static archives, etc.).
- license
-
The license identifier.
- version
-
The installed version.
Methods
find_header( ... )
my $path = $info->find_header( 'png.h' );
Scans includedirs for the given filename and returns the absolute path if found. Returns undef otherwise.
Examples
If you just want to use a library, copy one of these. Each one installs whatever is missing on the first run and takes care of the rest.
Hello World (install then call)
install( ... ) downloads and builds the library for you, then libpath points Affix or FFI::Platypus to the matching shared .dll / .so / .dylib.
Affix first:
use v5.40;
use Alien::Xrepo;
use Affix;
my $zlib = Alien::Xrepo->new->install('zlib');
affix $zlib->libpath, 'zlibVersion', [], String;
say 'zlib ' . zlibVersion();
The same simple demo with FFI::Platypus:
use v5.40;
use Alien::Xrepo;
use FFI::Platypus;
my $zlib = Alien::Xrepo->new->install('zlib');
my $ffi = FFI::Platypus->new;
$ffi->lib( $zlib->libpath );
$ffi->attach( zlibVersion => [] => 'string' );
say 'zlib ' . zlibVersion();
And if you want the whole library wrapped (prototypes generated from the headers) instead of one function at a time, use Affix::Wrap:
use v5.40;
use Alien::Xrepo;
use Affix::Wrap;
my $zlib = Alien::Xrepo->new->install('zlib');
Affix::Wrap->new(
project_files => [ $zlib->find_header('zlib.h') ],
include_dirs => [ $zlib->includedirs ],
types => { gzFile_s => Pointer [Void] }
)->wrap( $zlib->libpath );
say 'zlib ' . zlibVersion();
Link an XS extension with Inline::C (multiple libraries)
Same idea for an actual C extension, compiled with Inline::C. Install every library you want to link; merge their include and link directories, hand them to Inline::C, and write plain C that uses whichever header you need. Here we bind both libpng and zlib (installed together into one store) into a single XS function:
use v5.40;
use Alien::Xrepo;
use Config;
my $repo = Alien::Xrepo->new;
my $png = $repo->install('libpng'); # shared lib
my $zlib = $repo->install('zlib'); # second shared lib
# The compiled XS loads png.dll / libpng.so at runtime, so put both native
# "bin" dirs on PATH before calling into it (Windows especially).
my @png_bins = $png->bin_dir;
my @zlib_bins = $zlib->bin_dir;
local $ENV{PATH} = join $Config{path_sep}, (@png_bins, @zlib_bins, $ENV{PATH});
# Merge include and link directories into plain flag strings.
my $incs = join ' ', map { "-I$_" } (@{ $png->includedirs }, @{ $zlib->includedirs });
my $libs = join ' ',
map { "-L$_" } (@{ $png->linkdirs }, @{ $zlib->linkdirs }),
map { "-l$_" } (@{ $png->links }, @{ $zlib->links });
use Inline ();
Inline->bind(
'C',
<<'C',
#include <png.h>
#include <zlib.h>
const char *versions () {
return "libpng " PNG_LIBPNG_VER_STRING ", zlib " ZLIB_VERSION;
}
C
INC => $incs,
LIBS => $libs,
);
say versions();
The eg/xrepo_inline_c.pl script is the runnable copy of this example. Inline::C is not installed with this distribution. Install it once with cpanm Inline::C.
Install and run a binary tool
xrepo does not build only shared libraries, it also ships ready-to-run binaries (ninja, cmake, meson, node, python, go, rust, ...). install returns the package installdir, and bin_dir tells you where the executables live. Run one directly, or stick bin_dir in front of PATH so all the children you spawn find the tool:
use v5.40;
use Alien::Xrepo;
use Path::Tiny;
use Config;
my $repo = Alien::Xrepo->new;
my $ninja = $repo->install('ninja');
my @bins = $ninja->bin_dir;
# Option A: run a single binary from bin_dir
my ($ninja_exe) = map { path($_)->child($^O eq 'MSWin32' ? 'ninja.exe' : 'ninja') } @bins;
system $ninja_exe, '--version';
# Option B: put bin_dir first on PATH, then plain 'ninja' resolves
local $ENV{PATH} = join $Config{path_sep}, (@bins, $ENV{PATH});
system 'ninja', '--version';
Use installdir for everything the tool ships, not just bin:
say 'ninja install root: ' . $ninja->installdir;
Build a C program against a library
install builds the library once; fetch tells you the -I... and -L.../-l... flags if you are building with something other than xmake (e.g. MakeMaker or a plain cc):
use v5.40;
use Alien::Xrepo;
my $repo = Alien::Xrepo->new;
$repo->install( 'libpng' ); # build it once
my $cflags = $repo->fetch( 'libpng', undef, cflags => 1 );
my $ldflags = $repo->fetch( 'libpng', undef, ldflags => 1 );
say "cc $cflags $ldflags pngprog.c -o pngprog";
What can I install? What do I already have?
use v5.40;
use Alien::Xrepo;
my $repo = Alien::Xrepo->new;
say '[What is available?]';
$repo->search('sqlite');
say '[Already installed:]';
say for $repo->scan;
search prints matching packages from every configured repository and scan lists everything already on disk.
Cross-compile without memorizing SDK paths
All of xrepo's platform switches become named options. ndk is just one example, alongside toolchain, sdk, mingw and the rest.
use v5.40;
use Alien::Xrepo;
my $pkg = Alien::Xrepo->new->install(
'zlib', '1.3.x',
plat => 'android',
arch => 'arm64',
ndk => 'C:/Android/Sdk/ndk/26.1.10909125' # adapt to your NDK
);
say $pkg->libpath;
Drop into a shell inside the library's environment
env sets up the environment for a package (PATH, etc.) and either runs $program inside it (default: the system shell) or just prints it with show.
use v5.40;
use Alien::Xrepo;
Alien::Xrepo->new->env( 'bash', bind => 'zlib' ); # or env( undef, bind => 'zlib' )
# Alien::Xrepo->new->env( undef, show => 1 ); # just print the environment
Guard an install against a package that may not exist
search reports what the configured repositories actually provide. Check before you install so a spec that is absent (or renamed) in the active repos fails cleanly instead of erroring mid-way:
use v5.40;
use Alien::Xrepo;
my $repo = Alien::Xrepo->new;
if ( grep {/zlib/} $repo->search('zlib') ) {
my $zlib = $repo->install('zlib');
say 'zlib at ' . $zlib->libpath;
}
else {
warn "zlib is unavailable in the configured repositories\n";
}
Run a binary tool and check it worked
env wraps the given program with the package's environment (PATH already adjusted) and returns its exit status, so it doubles as a smoke test that the tool actually runs:
use v5.40;
use Alien::Xrepo;
my $repo = Alien::Xrepo->new;
my $cmake = $repo->install('cmake'); # kind: binary
my $rc = $repo->env('cmake', '--version'); # runs cmake with its bin_dir on PATH
die "cmake failed to run" unless $rc == 0;
Bundle a package for offline use
download fetches the source archives without building, import_pkg drops them into the local cache, and a subsequent install uses them even on a machine with no network. Handy for air-gapped CI or offline installs:
use v5.40;
use Alien::Xrepo;
my $repo = Alien::Xrepo->new;
$repo->download( 'zlib', undef, outputdir => './dl', shallow => 1 ); # fetch sources (no build)
$repo->import_pkg( 'zlib', undef, packagedir => './dl' ); # load into the cache
my $zlib = $repo->install('zlib'); # install offline
say 'installed ' . $zlib->version;
Render the dependency graph
info( ... depgraph = 1, format => 'dot')> emits a Graphviz DOT description of a package and everything it pulls in. Pipe it to dot -Tpng dep.dot -o dep.png to picture how a library's prerequisites resolve:
use v5.40;
use Alien::Xrepo;
my $dot = Alien::Xrepo->new->info( 'libpng', depgraph => 1, format => 'dot' );
say $dot; # e.g. dot -Tpng dep.dot -o dep.png
Cross-compile a library, then read its compiler/link flags
Install a library for another platform/architecture (the same switches xrepo accepts become named options), then fetch the -I... / -L.../-l... flags you would pass to your own compiler:
use v5.40;
use Alien::Xrepo;
my $repo = Alien::Xrepo->new;
$repo->install(
'libpng', '1.6.x',
plat => 'windows',
arch => 'x64',
mode => 'debug',
kind => 'shared'
);
my $cflags = $repo->fetch( 'libpng', undef, cflags => 1 ); # "-Ic:/.../include ..."
my $ldflags = $repo->fetch( 'libpng', undef, ldflags => 1 ); # "-Lc:/.../lib -l... .."
say "CFLAGS: $cflags";
say "LDFLAGS: $ldflags";
Remove a package from the cache
uninstall removes a package from the local store (the same one install/fetch/scan use, or an isolated root you installed into). It accepts the same options as install; all removes every stored variant, force removes a package even when others still depend on it. It returns the underlying exit status, so check $?:
use v5.40;
use Alien::Xrepo;
my $repo = Alien::Xrepo->new;
$repo->uninstall('freetype'); # remove one package
$repo->uninstall('zl*', all => 1); # every variant matching the pattern
$repo->uninstall('fontconfig', force => 1); # remove even if still depended upon
Note that this edits the shared store unlike a builder's prune, which slims the share dir a distribution ships, uninstall frees space in the store you manage yourself.
SEE ALSO
https://xrepo.xmake.io, https://packages.xmake.io/
Affix, Affix::Wrap, Alien::Xmake, FFI::Platypus, Inline::C; subclass the base class with Alien::Xrepo::Base
LICENSE
Copyright (C) Sanko Robinson.
This library is free software; you can redistribute it and/or modify it under the terms found in the Artistic License 2. Other copyrights, terms, and conditions may apply to data transmitted through this module.
AUTHOR
Sanko Robinson https://github.com/sanko