NAME
Database::Join - Read-only combined view across two or more Database::Abstraction objects
VERSION
Version 0.001.0
SYNOPSIS
Basic two-database join
use Database::Join;
# Step 1: create each component database the normal way
my $customers = Database::Customers->new(directory => '/data');
my $loyalty = Database::Loyalty->new(directory => '/data');
# Step 2: combine them on the shared key column 'entry'
my $join = Database::Join->new(
databases => [ $customers, $loyalty ],
join_column => 'entry',
);
# Step 3: query exactly as you would a single Database::Abstraction object
my $all_rows = $join->selectall_arrayref();
my $vip_rows = $join->selectall_arrayref(tier => 'gold');
my $one_row = $join->fetchrow_hashref(entry => 'C001');
my $total = $join->count();
my $col_names = $join->columns();
Hiding internal columns
my $join = Database::Join->new(
databases => [ $customers, $loyalty ],
join_column => 'entry',
remove_columns => [ 'internal_id', 'audit_ts' ],
);
# 'internal_id' and 'audit_ts' never appear in results or columns()
join_map: when the key column has different names in each database
# $cities (index 0) has a column called 'statecode' -- matches join_column
# $stnames (index 1) has a column called 'entry' -- different name
my $join = Database::Join->new(
databases => [ $cities, $stnames ],
# index 0 index 1
join_column => 'statecode',
join_map => { 1 => 'entry' }, # index 1 calls its join key 'entry'
);
# All returned rows use 'statecode'; 'entry' is never exposed
my $rows = $join->selectall_arrayref();
filters: permanently restrict a database's visible rows
# Only show orders placed more than 60 days ago, without repeating
# the criterion on every query call.
my $join = Database::Join->new(
databases => [ $customers, $orders ],
join_column => 'entry',
filters => { 1 => { age_days => { '>' => 60 } } },
);
my $rows = $join->selectall_arrayref(); # all old orders
my $vip = $join->selectall_arrayref(tier => 'gold'); # old + gold tier
Inner and outer join types
my $inner = Database::Join->new(
databases => [ $customers, $loyalty ],
join_column => 'entry',
join_type => 'inner', # only keys present in BOTH databases
);
my $outer = Database::Join->new(
databases => [ $customers, $loyalty ],
join_column => 'entry',
join_type => 'outer', # all keys from EITHER database
);
Building the view incrementally with add_database
my $join = Database::Join->new(
databases => [ $customers ],
join_column => 'entry',
);
$join->add_database($loyalty)
->add_database($scores, remove_columns => ['raw_score']);
AUTOLOAD column shortcut
# Returns the 'name' value for entry 'C001' (scalar context)
my $name = $join->name(entry => 'C001');
# Returns all 'tier' values (list context)
my @tiers = $join->tier();
DESCRIPTION
Database::Join merges two or more Database::Abstraction objects into a
single logical, read-only view. Each component database is queried
independently through its own Database::Abstraction interface. The results
are combined in Perl memory using a shared key column (join_column).
The module exposes the same read-only API as Database::Abstraction:
selectall_arrayref, selectall_array, fetchrow_hashref, count,
columns, schema, updated, set_logger, and the AUTOLOAD column
shortcut. Callers do not need to know how many underlying databases are
involved.
Think of it as a virtual database table that is assembled on demand from several real tables, one per component database.
Join semantics
The join_type parameter controls what happens when a particular key value
exists in some component databases but not all:
-
left(the default)All rows from the primary (first) database are returned. Columns from subsequent databases are included where a matching row is found, and simply absent from the hashref where there is no match. If you are familiar with SQL, this is a LEFT OUTER JOIN on the first table.
-
innerOnly rows whose join-column value is present in every component database are returned. This is equivalent to a SQL INNER JOIN.
-
outerEvery join-column value found in any component database is returned. Columns from databases that do not have that key value are absent from the merged row. This is a FULL OUTER JOIN.
Important override rule: whenever you pass a query criterion for a column
that belongs to a secondary database, that database automatically acts as an
inner-join partner for that query only -- regardless of join_type. This
gives WHERE-clause semantics. For example, if you have a LEFT join but query
tier => 'gold' on a secondary database, only rows whose secondary entry
has tier = 'gold' are returned (rows with no secondary entry are excluded, just
as a WHERE clause would exclude them).
Column ownership and routing
At construction time, Database::Join calls columns() on each component
database and builds an internal index that maps every column name to the
database that owns it.
When you pass criteria to a query method, each key-value pair is automatically routed to the right database. You never need to say which database a column belongs to.
The join_column is special: criteria on it are broadcast to all
databases so that each database fetches only the relevant rows before the
in-memory merge.
When the same non-join column name exists in more than one database, the
last database in the databases array wins: its value overwrites earlier
ones in merged rows.
LIMITATIONS
-
In-memory join only
All matching rows from every component database are fetched into memory before the merge. This is not suitable for very large result sets.
-
No chained builder or raw SQL
query()andexecute()are not implemented. Useselectall_arrayreforfetchrow_hashrefinstead. -
Single-column equi-join only
Joining on more than one column simultaneously, or on expressions, is not supported. When the join key has different names in different databases, use
join_mapto declare each database's local column name. -
Sort order
Results are sorted by the
join_columnvalue only. Caller-specifiedORDER BYis not propagated to the component databases. -
count() fetches all rows
count()executes the full join and counts the resulting rows in Perl. It does not push aCOUNT(*)query down to the databases.
COMMON PITFALLS
-
The join_column must exist in every component database
If even one database is missing the join key column,
new()(oradd_database()) willcroakimmediately. Usejoin_mapwhen the column has a different local name in some databases. -
Criteria on a removed column are silently dropped
If you call
remove_column('tier')and later queryselectall_arrayref(tier => 'gold'), the criterion is ignored (with acarpwarning) and all rows are returned. Always pass criteria before removing columns, or restructure your code to avoid this. -
You cannot remove the join column
$join->remove_column($join->join_column)willcroak. The join key is required for the merge to work. -
Left join does not guarantee all columns are populated
Under a LEFT join, rows from the primary database that have no matching row in a secondary database will be returned with no keys from that secondary database. Accessing
$row->{score}on such a row returnsundef-- not zero, not an empty string. Always testdefined $row-{score}> rather than just$row-{score}> when the secondary match is optional. -
Filters act as inner-join partners
Any database that has a
filtersentry is promoted to an inner-join partner, regardless ofjoin_type. A row whose join-key value does not appear in the filtered database's result is removed from the merged output entirely, not merely missing its secondary columns. This is intentional but can be surprising if you expected LEFT join semantics. -
Criteria-merging replaces scalar filters
When both a base filter and a query criterion target the same column, and both are operator hashrefs (e.g.
{ '>' => 60 }), the operators are combined (AND semantics). But if the query criterion is a plain scalar (e.g.score => 75), it replaces the base filter for that column entirely -- the base filter is ignored for that query. -
AUTOLOAD sees the full merged join when filters or join_map are active
When either
filtersorjoin_mapis in effect, the AUTOLOAD shortcut ($join->columnname(...)) runs the full join query rather than delegating directly to the owning database. This is necessary for correctness but means the result respects all active filters and join-key translations, which may differ from what the owning database would return on its own. -
Duplicate column names: last database wins
When two component databases each have a column called
notes, the second database's value silently overwrites the first in every merged row. Useremove_columns(orremove_column) to drop the unwanted duplicate.
METHODS
new
SYNOPSIS
my $join = Database::Join->new(
databases => [ $db1, $db2 ],
join_column => 'entry',
join_type => 'left',
join_map => { 1 => 'local_col' },
filters => { 1 => { score => { '>' => 60 } } },
remove_columns => [ 'email', 'internal_id' ],
logger => $log,
i18n => $locale,
);
DESCRIPTION
Constructs and returns a new Database::Join object.
Each element of databases must be an already-instantiated subclass of
Database::Abstraction. The constructor calls columns() on every
database to build an internal column-routing table and verifies that
join_column (or its local alias from join_map) is present in each one.
Columns listed in remove_columns are hidden immediately: they do not appear
in columns(), schema(), or any returned row hashref. This is equivalent
to calling remove_column once per name after construction.
API SPECIFICATION
Input
databases => { type => 'arrayref', required => 1 }
# One or more Database::Abstraction subclass objects.
#
# DOMAIN -- EP valid: non-empty arrayref of blessed DA subclasses.
# DOMAIN -- EP invalid: scalar, hashref, or absent => croak.
# DOMAIN -- BVA size: minimum 1 element; no documented upper bound.
# DOMAIN -- BVA elem: each element must pass isa('Database::Abstraction').
join_column => { type => 'string', optional => 1, default => 'entry' }
# The column name shared by all databases (the join key).
#
# DOMAIN -- EP valid: any non-empty string present in every component DA.
# DOMAIN -- EP invalid: column absent from any DA => croak join_col_missing.
# DOMAIN -- BVA: empty string '' is treated as a column name and
# will croak if (as expected) it is absent from every DA.
# DOMAIN -- NOTE: matching is case-sensitive and exact.
join_type => { type => 'string', optional => 1, default => 'left',
enum => ['inner', 'left', 'outer'] }
# Controls which keys appear in the result when not all
# databases share the same key values.
#
# DOMAIN -- EP valid: exactly 'inner', 'left', or 'outer'.
# DOMAIN -- EP invalid: any other string including 'INNER', 'LEFT',
# 'OUTER' (enum check is case-sensitive), 'cross',
# or '' => croak from validate_strict.
join_map => { type => 'hashref', optional => 1 }
# Zero-based database index => local column name.
# See the join_map section for full details.
#
# DOMAIN -- EP valid: hashref values must be plain strings.
# DOMAIN -- EP invalid: reference value (hashref, arrayref, coderef, etc.)
# => croak; the guard prevents heap-address leakage.
# DOMAIN -- BVA: out-of-range keys (beyond the databases array) are
# silently ignored.
filters => { type => 'hashref', optional => 1 }
# Zero-based database index => criteria hashref.
# Permanent row restrictions on individual databases.
# See the filters section for full details.
remove_columns => { type => 'arrayref', optional => 1 }
# Column names to hide from the merged view.
#
# DOMAIN -- EP valid: arrayref of any strings; non-existent columns
# are silently ignored (idempotent).
# DOMAIN -- EP invalid: join_column itself => croak remove_join_col.
# DOMAIN -- BVA: [] empty arrayref is a safe no-op.
logger => { type => 'object', optional => 1 }
# Logger object propagated to all component databases.
i18n => { type => 'object', optional => 1 }
# Localisation object with a translate($key, @args) method.
Output
A blessed Database::Join object.
EXAMPLE
# Customers database: entry | name | email
# Loyalty database: entry | tier | points
my $join = Database::Join->new(
databases => [ $customers, $loyalty ],
join_column => 'entry',
join_type => 'inner', # only customers who also have loyalty records
remove_columns => [ 'email' ], # hide PII from query results
filters => { 1 => { points => { '>' => 0 } } }, # ignore zero-point records
);
my $rows = $join->selectall_arrayref();
# Each row: { entry => ..., name => ..., tier => ..., points => ... }
# 'email' is absent. Zero-point loyalty records are excluded.
PSEUDOCODE
validate all parameters with validate_strict
croak if databases is empty
croak if any element of databases is not a Database::Abstraction subclass
bless the object with all fields initialised
call _build_col_index to map every column to its owning database
and verify join_column presence in each database
for each column in remove_columns: call remove_column
return the new object
MESSAGES
error_no_databases -- databases arrayref was empty
error_invalid_db -- an element of databases is not a D::A subclass
error_join_col_missing -- join_column (or its join_map alias) not found in a database
join_map - joining on differently-named columns
By default every component database must have a column whose name matches
join_column. If a database uses a different local name for the join key,
declare the mapping with join_map.
join_map is a hashref. Each key is the zero-based position of a
database in the databases array (0 = first, 1 = second, and so on). Each
value is the name that that particular database uses for the join key.
Databases not listed in join_map are assumed to already have a column
named join_column and need no entry.
Throughout the merged view the join key is always referred to by the name
given in join_column. The local alias is never exposed in returned rows,
in columns(), or in schema().
When do you need join_map?
You need join_map when you have two tables like:
cities table : entry (the city name) | statecode
stnames table : entry (the state code) | state
Here you want to join cities.statecode to stnames.entry. You choose
join_column => 'statecode' as the canonical name, but stnames calls
that same concept entry, so you declare:
join_map => { 1 => 'entry' } # stnames (index 1) calls it 'entry'
Example
# index 0 index 1
my @databases = ( $cities, $stnames );
# join key column: 'statecode' 'entry'
# join_column: 'statecode' (chosen canonical name)
# stnames differs, so declare the alias:
my $join = Database::Join->new(
databases => \@databases,
join_column => 'statecode',
join_map => { 1 => 'entry' },
);
my $rows = $join->selectall_arrayref();
# Each $row has keys: entry (city), statecode, state
# 'entry' from stnames is never exposed directly.
my $row = $join->fetchrow_hashref(statecode => 'CA');
Using add_database instead
If you build the join incrementally with add_database, pass
join_column directly to that call instead of using join_map:
my $join = Database::Join->new(
databases => [ $cities ],
join_column => 'statecode',
);
$join->add_database($stnames, join_column => 'entry');
This is exactly equivalent to the join_map form above.
filters - permanent per-database row filters
filters lets you restrict a component database to a subset of its rows
permanently, without repeating the criterion on every query call.
Think of it as telling the join: "whenever you query this database, always add these extra conditions". Callers never need to specify the restriction themselves and can never accidentally omit it.
filters is a hashref. Each key is the zero-based position of a
database in the databases array (same numbering as join_map). Each
value is a criteria hashref in the same format as selectall_arrayref
accepts.
Key-set semantics
A filtered database always acts as an inner-join partner, regardless of the
join_type setting. Any join-key value that does not pass the filter is
excluded from the merged output entirely -- not just missing its secondary
columns. This ensures the filter genuinely restricts the view rather than
simply hiding a few fields.
Criteria merging
When a query call also passes a criterion for a column that already has a base filter, the two constraints are combined:
- When both the base filter value and the query criterion are operator hashrefs
(e.g.
{ '>' => 60 }and{ '<' => 365 }), their operators are merged: both constraints apply simultaneously (AND semantics). - When either value is a plain scalar, or the operators conflict, the query-time criterion wins and the base filter for that column is ignored for that one call.
Example -- only show orders placed more than 60 days ago
my $join = Database::Join->new(
databases => [ $customers, $orders ],
join_column => 'entry',
filters => { 1 => { age_days => { '>' => 60 } } },
);
# Every query automatically sees only old orders
my $rows = $join->selectall_arrayref();
# Additional criteria layer on top -- gold tier AND old order
my $vip = $join->selectall_arrayref(tier => 'gold');
# Range intersection: age_days > 60 AND age_days < 365
my $mid = $join->selectall_arrayref(age_days => { '<' => 365 });
When using add_database, pass filter (singular) to set the base
criteria for the new database:
$join->add_database($orders, filter => { age_days => { '>' => 60 } });
selectall_arrayref
SYNOPSIS
my $rows = $join->selectall_arrayref();
my $rows = $join->selectall_arrayref(tier => 'gold');
my $rows = $join->selectall_arrayref(score => { '>' => 80 });
my $rows = $join->selectall_arrayref('C001'); # positional: entry => 'C001'
DESCRIPTION
Returns an arrayref of hashrefs representing the merged view of all component databases, optionally filtered by the given criteria.
Criteria for columns that live in different databases are routed
automatically: each database is queried with only the criteria that apply to
its own columns. The results are combined in memory using join_column.
Accepts the same criteria syntax as Database::Abstraction::selectall_arrayref.
A single plain scalar argument is interpreted as the join_column value
(equivalent to entry => 'C001' when join_column is 'entry').
API SPECIFICATION
Input
Calling conventions (in order of precedence):
1. No arguments -- returns all rows
2. One plain scalar -- shorthand for join_column => $scalar
3. Key-value pairs or
a criteria hashref -- routed per-database
Values may be:
Plain scalar -- exact match
Hashref of operators -- e.g. { '>' => 80 }
Output
Arrayref of hashrefs; one hashref per qualifying merged row,
sorted ascending by join_column value.
Returns a reference to an empty array when no rows match.
EXAMPLE
# All rows from both databases
my $all = $join->selectall_arrayref();
# Only rows where the 'tier' column (from the loyalty database)
# equals 'gold' -- the criterion is routed to the right database
my $vip = $join->selectall_arrayref(tier => 'gold');
# Operator hashref: score > 80
my $high = $join->selectall_arrayref(score => { '>' => 80 });
# Access each merged row
for my $row (@{$vip}) {
printf "%-10s tier=%-8s score=%d\n",
$row->{entry}, $row->{tier}, $row->{score} // 0;
}
selectall_array
SYNOPSIS
my @rows = $join->selectall_array(tier => 'gold');
# Scalar context: only the first matching row
my $first = $join->selectall_array(entry => 'C001');
DESCRIPTION
In list context returns a list of merged hashrefs -- the same rows that
selectall_arrayref would return, just as a flat list rather than an
arrayref.
In scalar context returns only the first matching hashref (or undef if
nothing matches).
API SPECIFICATION
Input
Same as selectall_arrayref.
Output
List context: list of hashrefs (may be empty).
Scalar context: single hashref or undef.
EXAMPLE
my @all = $join->selectall_array();
print scalar @all, " rows\n";
# First gold-tier customer only
my $first_vip = $join->selectall_array(tier => 'gold');
print $first_vip->{name}, "\n" if defined $first_vip;
fetchrow_hashref
SYNOPSIS
my $row = $join->fetchrow_hashref(entry => 'C001');
my $row = $join->fetchrow_hashref('C001'); # positional shorthand
DESCRIPTION
Returns a single merged hashref for the first row matching the given
criteria, or undef when nothing matches.
Equivalent to calling selectall_arrayref and taking only the first element.
All the same criteria conventions apply.
API SPECIFICATION
Input
Same as selectall_arrayref.
Output
Hashref, or undef when no row matches.
EXAMPLE
my $row = $join->fetchrow_hashref(entry => 'C001');
if (defined $row) {
print "Name: $row->{name}, Tier: $row->{tier}\n";
} else {
print "No record for C001\n";
}
# Positional: works when join_column is 'entry'
my $row2 = $join->fetchrow_hashref('C001');
count
SYNOPSIS
my $total = $join->count();
my $active = $join->count(tier => 'gold');
DESCRIPTION
Returns the number of merged rows that satisfy the given criteria.
The full join is performed and the resulting rows are counted in Perl; no
COUNT(*) is pushed down to the component databases.
API SPECIFICATION
Input
Same criteria syntax as selectall_arrayref.
Output
Non-negative integer.
EXAMPLE
my $total = $join->count();
my $gold = $join->count(tier => 'gold');
my $high = $join->count(score => { '>' => 90 });
printf "%d total, %d gold-tier, %d high-scorers\n",
$total, $gold, $high;
columns
SYNOPSIS
my $cols = $join->columns();
DESCRIPTION
Returns an arrayref of all column names visible in the merged view, deduplicated and sorted alphabetically.
The join_column appears exactly once, even if it exists under different
local names in some databases (see join_map). Columns that have been
hidden with remove_column or remove_columns do not appear.
The result is memoised: repeated calls are cheap.
API SPECIFICATION
Input
None.
Output
Arrayref of column name strings, sorted alphabetically.
EXAMPLE
my $cols = $join->columns();
print join(', ', @{$cols}), "\n";
# e.g. "entry, name, score, tier"
schema
SYNOPSIS
my $schema = $join->schema();
DESCRIPTION
Returns a merged schema hashref for all visible columns across all component
databases. Each key is a column name; each value is the schema metadata
hashref returned by Database::Abstraction::schema() for that column
(typically { type, nullable, default, pk }).
When the same column name appears in more than one database the last
database's metadata is used. Columns hidden with remove_column are not
included.
The result is memoised.
API SPECIFICATION
Input
None.
Output
Hashref: column_name => { type => ..., nullable => ..., default => ..., pk => ... }.
EXAMPLE
my $schema = $join->schema();
for my $col (sort keys %{$schema}) {
my $info = $schema->{$col};
printf "%-15s type=%-10s nullable=%s\n",
$col, $info->{type}, $info->{nullable} ? 'yes' : 'no';
}
updated
SYNOPSIS
my $ts = $join->updated();
DESCRIPTION
Returns the Unix timestamp of the most recent modification across all
component databases. This is the maximum of all individual updated()
return values.
Use this to implement simple cache-invalidation logic: if updated()
has advanced since your last snapshot, re-query.
API SPECIFICATION
Input
None.
Output
Unix timestamp (positive integer).
EXAMPLE
my $last_modified = $join->updated();
if ($last_modified > $my_cache_timestamp) {
$my_cache = $join->selectall_arrayref();
$my_cache_timestamp = $last_modified;
}
set_logger
SYNOPSIS
$join->set_logger($log);
DESCRIPTION
Attaches a new logger object to the join and propagates it to every component database. The logger is used for diagnostic output by all component databases.
API SPECIFICATION
Input
$log Positional: a logger object (required).
Must support whatever interface Database::Abstraction expects.
Output
Returns C<$self> for method chaining.
EXAMPLE
# Log::Any is used here as an example; any object that implements
# debug() and info() (or whichever methods your component databases
# call internally) works equally well.
use Log::Any qw($log);
my $join = Database::Join->new(databases => [$db1, $db2], join_column => 'entry');
$join->set_logger($log);
# $log is now used by $join and by $db1 and $db2
add_database
SYNOPSIS
# Positional: database object as first argument
$join->add_database($db);
# Named: equivalent to the above
$join->add_database(database => $db);
# With options (mixed positional + named)
$join->add_database($db, remove_columns => ['internal_id']);
$join->add_database($db, join_column => 'local_key_name');
$join->add_database($db, filter => { score => { '>' => 60 } });
# Chainable
$join->add_database($db1)->add_database($db2, remove_columns => ['notes']);
DESCRIPTION
Adds one more Database::Abstraction subclass object to the logical view
and immediately updates the column-ownership index.
After the call, all query methods return rows that include columns from the newly added database, and criteria on those new columns are routed to it automatically.
When a column name in the new database already exists in an earlier database, the new database becomes the authoritative source for that column (last-database-wins, the same rule that applies at construction time).
The join-column must be present in the new database (or declared via
join_column). The logger is propagated to the new database if one is set.
add_database is the runtime equivalent of listing the database in the
databases array to new. The optional join_column parameter is
equivalent to a join_map entry; the optional filter parameter is
equivalent to a filters entry.
API SPECIFICATION
Input
database => { type => 'object', required => 1 }
# A Database::Abstraction subclass instance.
#
# DOMAIN -- EP valid: blessed object that passes
# isa('Database::Abstraction').
# DOMAIN -- EP invalid: non-reference, unblessed ref, wrong class,
# or non-reference non-key scalar (the guard at
# the top of add_database rejects it with
# error_invalid_db before validate_strict runs).
join_column => { type => 'string', optional => 1 }
# The name of the join key in THIS new database,
# when it differs from the canonical join_column.
#
# DOMAIN -- EP valid: any string that exists as a column in the
# new database.
# DOMAIN -- EP invalid: string absent from the new database's columns()
# => croak error_join_col_missing.
filter => { type => 'hashref', optional => 1 }
# Permanent criteria for this database only.
# Same format as selectall_arrayref.
remove_columns => { type => 'arrayref', optional => 1 }
# Column names from this database to hide.
Output
Returns C<$self> to support method chaining.
EXAMPLE
my $join = Database::Join->new(
databases => [ $customers ],
join_column => 'entry',
);
# Add loyalty data; hide internal columns from it
$join->add_database($loyalty, remove_columns => ['audit_ts']);
# Add score data; only include rows with score > 60
$join->add_database($scores, filter => { score => { '>' => 60 } });
# Add a database whose join key has a different local name
$join->add_database($stnames, join_column => 'state_code');
# All three options combined, and chained
$join->add_database($db4,
join_column => 'ref_id',
filter => { active => 1 },
remove_columns => ['legacy_col'],
);
PSEUDOCODE
determine the new database's index (length of current _dbs array)
extract the database object from positional or named argument
croak if it is not a Database::Abstraction subclass
register join_column alias in _join_map if different from canonical
register filter in _filters if provided
fetch column list from the new database
croak if the join key is missing from the new database
append the new database to _dbs and _db_cols
update _col_db: for each new column, point it at the new index
(last-database-wins; skip removed columns and the local join alias)
invalidate _col_cache and _schema_cache
propagate logger if set
apply remove_columns if provided
return $self
MESSAGES
error_invalid_db -- argument is not a Database::Abstraction subclass
error_join_col_missing -- join_column not found in the new database
remove_column
SYNOPSIS
$join->remove_column('email');
# Chainable
$join->remove_column('internal_id')->remove_column('audit_ts');
DESCRIPTION
Permanently hides a column from the merged view. After this call:
- The column does not appear in
columns()orschema(). - Returned row hashrefs do not contain the column key.
- Any query criterion that references the removed column is silently dropped
(with a
carpwarning).
The join_column cannot be removed; attempting to do so will croak.
Removing a column that does not exist in any database is silently ignored
(the call is idempotent and safe). The columns() and schema()
memoisation caches are cleared automatically.
API SPECIFICATION
Input
$col Positional string: the column name to remove.
DOMAIN -- EP valid: any string; non-existent columns are silently
ignored (idempotent call, returns $self).
DOMAIN -- EP invalid: join_column value => croak error_remove_join_col.
DOMAIN -- BVA: undef and '' are explicit no-ops (returns $self).
These are below the minimum meaningful string
length and are handled without any warning.
Output
Returns C<$self> to support method chaining.
EXAMPLE
# Hide private fields immediately after construction
my $join = Database::Join->new(
databases => [ $customers, $loyalty ],
join_column => 'entry',
)->remove_column('email')
->remove_column('internal_notes');
# Verify they are gone
my $cols = $join->columns();
# 'email' and 'internal_notes' are absent
MESSAGES
error_remove_join_col -- attempt to remove the join_column itself
query
Not supported. Database::Join does not implement the chained query
builder. Calling this method will always croak with an explanatory message.
Use selectall_arrayref, selectall_array, fetchrow_hashref, or
count instead.
execute
Not supported. Raw SQL cannot span heterogeneous backends that may use
different database engines. Calling this method will always croak.
Use selectall_arrayref or fetchrow_hashref to query the joined view.
AUTOLOAD - column shortcut
Calling an unknown method whose name matches a visible column name performs a column lookup across the merged view.
SYNOPSIS
# Scalar context: value from the first matching row
my $name = $join->name(entry => 'C001');
# List context: values from every matching row
my @tiers = $join->tier();
# With a positional join-key argument (when join_column is 'entry')
my $score = $join->score('C001');
DESCRIPTION
AUTOLOAD routes the call to the appropriate component database by looking up the column name in the internal column-ownership index.
When either join_map or filters is active, AUTOLOAD performs a full
join query instead of delegating directly to the owning database. This is
necessary because:
- With
join_map, the owning database's primary key may differ from the canonical join key used in the call arguments. - With
filters, bypassing the join would return rows that the filter is meant to exclude.
In list context, every matching merged row contributes one value to the returned list. In scalar context, only the first row's value is returned.
Calling a method whose name begins with _ (a private method) via AUTOLOAD
will croak with a clear error message rather than being silently ignored.
EXAMPLE
# Lookup a single customer's name (scalar context)
my $name = $join->name('C001'); # 'C001' maps to entry => 'C001'
print "Name: $name\n";
# Get every tier value in the view (list context)
my @all_tiers = $join->tier();
my %freq;
$freq{$_}++ for @all_tiers;
# join_map active: AUTOLOAD runs a full join so the criteria are
# translated correctly between the canonical and local key names.
my @leesburg_states = sort $join->state('Leesburg');
# ['Florida', 'Virginia'] if Leesburg appears in two states
PSEUDOCODE
extract column name from $AUTOLOAD
return if DESTROY
croak if column name starts with '_' (private method guard)
croak if column name is not in _col_db (unknown column)
if join_map or filters are active:
parse calling arguments using _parse_query_args
call _joined_query to get all merged rows
return map { $_->{col} } @rows in list context
return $rows[0]{col} in scalar context
else:
delegate directly to the owning database
MESSAGES
The following messages can be produced by Database::Join. All messages
can be localised by supplying an i18n object to new.
-
error_no_databasesWhen: The
databasesarrayref passed tonewis empty.Fix: Pass at least one
Database::Abstractionsubclass object. -
error_invalid_dbWhen: An element of the
databasesarray (or the argument toadd_database) is not an object, or is not aDatabase::Abstractionsubclass.Fix: Instantiate the component database with its own
newmethod before passing it toDatabase::Join. -
error_join_col_missingWhen: The join key column (or its
join_mapalias) does not exist in one of the component databases.Fix: Either add the column to the database, change
join_columnto a column that is present everywhere, or usejoin_mapto declare the local alias for databases that call it something different. -
error_remove_join_colWhen:
remove_columnis called with the name of the join key column.Fix: The join key is required for the merge to work and cannot be hidden. Remove a different column.
-
warn_unknown_column(carp)When: A criterion is passed for a column that does not exist in any component database (or has been removed with
remove_column).Fix: Check the column name spelling. The criterion is ignored.
-
error_query_unsupportedWhen:
query()is called on aDatabase::Joinobject.Fix: Use
selectall_arrayref,selectall_array,fetchrow_hashref, orcountinstead. -
error_execute_unsupportedWhen:
execute()is called on aDatabase::Joinobject.Fix: Use the Perl-level query methods instead. Raw SQL cannot span heterogeneous database backends.
REPOSITORY
https://github.com/nigelhorne/Database-Join
SUPPORT
This module is provided as-is without any warranty.
SEE ALSO
SECURITY CONSIDERATIONS
Database::Join is a pure in-memory routing and merge layer. It never
generates SQL strings, never opens files, and never calls system(),
exec(), or eval(). The security properties described below are
architectural guarantees, not run-time checks.
What Database::Join guarantees
-
Criteria partition isolation
Every criterion you pass to a query method is routed to exactly one component database (the one that owns that column), or to all databases when the criterion is on the join key column. A hostile value in a criterion for column
name(owned by database A) will never reach database B. -
Unknown columns are rejected before reaching any database
If a criterion column name is not present in any component database (or has been hidden with
remove_column),Database::Joinlogs acarpwarning and silently drops the criterion. No database receives the hostile key. -
AUTOLOAD only accepts word-character column names
Perl's method dispatch extracts the column name via
\w+, which matches only[A-Za-z0-9_]. Hostile method names with shell metacharacters, quotes, or spaces cannot reach the AUTOLOAD dispatch path. Private names (starting with_) are additionally blocked with an explicitcroak. -
No value sanitisation (by design)
Database::Joindoes not sanitise, HTML-encode, or validate the values in criteria hashrefs. Preventing SQL injection is the responsibility of the underlyingDatabase::Abstractionobjects (which use parameterised queries). Preventing XSS or header injection is the responsibility of the CGI or web layer that renders the output. -
Taint-mode compatible
Database::Joincontains nosystem(),exec(), backtick,open(PIPE), oreval STRINGcalls. It neither opens files nor constructs shell commands. The AUTOLOAD regex/::(\w+)$/produces an untainted capture, so the column name used for dispatch is clean under-T. Criteria values are passed verbatim to componentDatabase::Abstractionobjects; those objects are responsible for handling tainted values at the SQL parameterisation layer. -
Operator hashref aliasing
When the same join-key criterion (an operator hashref such as
{ '>' => 'A' }) is broadcast to multiple component databases, all of them receive a reference to the same hashref. A malicious component database that mutates the hashref's contents could affect what subsequent databases receive. Component databases are assumed to be trusted.
What the caller is responsible for
-
Sanitise values before building criteria
DJ passes criterion values verbatim to component databases. If your application accepts user-supplied filter values (e.g. from a CGI query string), those values must be validated or sanitised by your application before being passed to DJ.
-
Restrict which columns the caller can filter on
Any column in
columns()can be used as a filter criterion. If a column should not be filterable by end users (e.g. an internal status flag), hide it withremove_columnso that queries on it are silently dropped. -
Do not expose the joined view directly to user-supplied criteria
DJ is not a firewall. It faithfully routes user input to component databases. Wrap DJ calls in a thin service layer that whitelists the permitted criterion columns and validates their values.
API SPECIFICATION (security surface)
Input accepted by all query methods and passed through DJ to component databases:
Criterion values:
type: scalar string | operator hashref { OP => scalar }
validation: NONE (DJ trusts the caller; component DA is responsible)
max size: unconstrained (OOM risk on very large values)
Column name keys in criteria:
type: string
validation: must be present in _col_db (else carp + drop)
character set: any Perl string (including control chars); DJ does
not impose a character-set restriction on criteria KEYS
AUTOLOAD method-name-as-column:
type: \w+ (enforced by Perl regex /::(\w+)$/)
validation: must not start with '_'; must be in _col_db
FORMAL SPECIFICATION
Z calculus schemas for the key invariants and operations. Unicode is used throughout this section as required by Z notation.
─── Database_Join ─────────────────────────────────────────────────
dbs : seq DATABASE_ABSTRACTION
join_col : NAME
join_type : {left, inner, outer}
join_map : ℕ ⇸ NAME
filters : ℕ ⇸ CRITERIA
col_db : NAME ⇸ ℕ
removed : ℙ NAME
───────────────────────────────────────────────────────────────────
#dbs ≥ 1
dom join_map ⊆ 0 ‥ (#dbs - 1)
dom filters ⊆ 0 ‥ (#dbs - 1)
dom col_db = (⋃ { i : 0 ‥ #dbs-1 • ran((dbs i).columns) }) \ removed
join_col ∉ removed
∀ i : 0 ‥ #dbs-1 •
local_jc(i) = if i ∈ dom join_map then join_map(i) else join_col
∀ i : 0 ‥ #dbs-1 •
local_jc(i) ∈ ran((dbs i).columns)
─── Init ──────────────────────────────────────────────────────────
ΔDatabase_Join
dbs? : seq DATABASE_ABSTRACTION
join_col? : NAME
join_type? : {left, inner, outer}
join_map? : ℕ ⇸ NAME
filters? : ℕ ⇸ CRITERIA
removed? : ℙ NAME
───────────────────────────────────────────────────────────────────
#dbs? ≥ 1
dbs' = dbs?
join_col' = join_col?
join_type'= join_type?
join_map' = join_map?
filters' = filters?
col_db' = buildColIndex(dbs?, join_col?, join_map?)
removed' = removed?
─── SelectAllArrayref ─────────────────────────────────────────────
ΞDatabase_Join -- state unchanged
criteria? : CRITERIA
result! : seq MERGED_ROW
───────────────────────────────────────────────────────────────────
∀ c : dom criteria? • c ∈ dom col_db ∪ {join_col}
result! = joinedQuery(criteria?)
result! is sorted ascending by join_col value
─── AddDatabase ───────────────────────────────────────────────────
ΔDatabase_Join
db? : DATABASE_ABSTRACTION
local_jc? : NAME -- optional; defaults to join_col
filter? : CRITERIA -- optional
remove? : ℙ NAME -- optional
───────────────────────────────────────────────────────────────────
db?.isa('Database::Abstraction')
local_jc? ∈ ran(db?.columns)
dbs' = dbs ^ ⟨db?⟩
col_db' = col_db ⊕ { c ↦ #dbs | c ∈ ran(db?.columns) \ {local_jc?} \ removed }
filters' = if filter? ≠ ∅ then filters ⊕ {#dbs ↦ filter?} else filters
join_map' = if local_jc? ≠ join_col
then join_map ⊕ {#dbs ↦ local_jc?}
else join_map
removed' = removed ∪ remove?
─── RemoveColumn ──────────────────────────────────────────────────
ΔDatabase_Join
col? : NAME
───────────────────────────────────────────────────────────────────
col? ≠ join_col
removed' = removed ∪ {col?}
col_db' = col_db \ {col?}
join_map' = join_map
filters' = filters
dbs' = dbs
join_map
─── JoinMap ───────────────────────────────────────────────────────
join_map : ℕ ⇸ NAME
dbs : seq DATABASE_ABSTRACTION
join_col : NAME
───────────────────────────────────────────────────────────────────
dom join_map ⊆ 0 ‥ (#dbs - 1)
∀ i : dom join_map • (join_map i) ∈ ran(dbs i).columns
∀ i : 0 ‥ (#dbs - 1) \ dom join_map •
join_col ∈ ran(dbs i).columns
-- Resolution of the local join-key name for database i:
local_jc(i) == if i ∈ dom join_map then join_map(i) else join_col
-- The canonical name is always join_col; local_jc is never exposed.
SECURITY INVARIANTS
─── PartitionIsolation ─────────────────────────────────────────────
-- For every query call with criteria C and column col ≠ join_col:
∀ i : 0 ‥ #dbs-1 •
i ≠ _col_db(col) ⟹ col ∉ dom(per_db(i))
-- Unknown column is dropped before any database sees it:
col ∉ dom(_col_db) ∧ col ≠ join_col ⟹
(∀ i : 0 ‥ #dbs-1 • col ∉ dom(per_db(i)))
─── NoCodeExecution ────────────────────────────────────────────────
-- DJ contains no call to system(), exec(), open(PIPE), or eval().
-- Hostile criterion values therefore cannot achieve code execution
-- within the Database::Join layer.
∀ v : VALUE • _joined_query({col ↦ v}) ≠ ⊥ due to code injection
filters
─── Filters ─────────────────────────────────────────────────────
filters : ℕ ⇸ CRITERIA
dbs : seq DATABASE_ABSTRACTION
─────────────────────────────────────────────────────────────────
dom filters ⊆ 0 ‥ (#dbs - 1)
-- A filtered database i always contributes to key-set intersection.
-- For each query with criteria C:
effective_criteria(i, C) ==
if i ∈ dom filters
then merge_criteria(filters(i), partition(C, i))
else partition(C, i)
-- Criteria merging (AND semantics for operator hashrefs):
merge_criteria(base, extra) ==
{ col : dom base ∪ dom extra •
if col ∈ dom base ∩ dom extra
∧ base(col) ∈ HASHREF ∧ extra(col) ∈ HASHREF
then col ↦ base(col) ∪ extra(col) -- operator union
else col ↦ (if col ∈ dom extra then extra(col) else base(col)) }
selectall_arrayref
selectall_arrayref : CRITERIA → seq MERGED_ROW
pre: ∀ col : dom criteria • col ∈ dom self._col_db ∪ {self._join_col}
post: result = _joined_query(criteria)
result is sorted ascending by join_col value
selectall_array
selectall_array : CRITERIA → seq MERGED_ROW | MERGED_ROW?
pre: same as selectall_arrayref
post: wantarray => result = @{ selectall_arrayref(criteria) }
!wantarray => result = selectall_arrayref(criteria)[0] (or undef)
fetchrow_hashref
fetchrow_hashref : CRITERIA → MERGED_ROW?
post: result = selectall_arrayref(criteria)[0] (or undef if empty)
count
count : CRITERIA → ℕ
post: result = #selectall_arrayref(criteria)
columns
columns : → seq NAME
post: result = sort(
(⋃ { i : 0 ‥ #dbs-1 • ran(dbs(i).columns) }
\ dom removed_cols
\ { local_jc(i) | i ∈ dom join_map ∧ local_jc(i) ≠ join_col })
)
schema
schema : → NAME ⇸ SCHEMA_INFO
post: dom(result) = ran(columns())
∀ col : dom(result) •
result(col) = (last database containing col).schema()(col)
updated
updated : → ℕ
post: result = max { i : 0 ‥ #dbs-1 • dbs(i).updated() }
remove_column
remove_column : NAME → Database_Join
pre: col ≠ self._join_col
post: self'._removed_cols = self._removed_cols ∪ {col}
self'._col_db = self._col_db \ {col}
self'._col_cache = undef
self'._schema_cache = undef
AUTOLOAD
AUTOLOAD : NAME × CRITERIA → VALUE | seq VALUE
pre: col ∈ dom self._col_db
col does not begin with '_'
post: let rows = _joined_query(criteria)
wantarray => result = { r : rows • r(col) }
!wantarray => result = rows(0)(col) (or undef if rows is empty)
AUTHOR
Nigel Horne, <njh@nigelhorne.com>
LICENSE AND COPYRIGHT
Copyright (C) 2026 Nigel Horne.
Usage is subject to the GPL2 licence terms. If you use it, please let me know.