NAME
SPVM::Document::NativeModule - How to write the native module
DESCRIPTION
The native module is the module that is implemented by native language such as C language or C++.
Native Method Declaration
A native method declaration are written using the method descriptor native in a SPVM module file. The method can't have the block. it ends with a semicolon.
# SPVM/Foo/Bar.spvm
class Foo::Bar {
native static method sum : int ($num1 : int, $num2 : int);
}Native Config File
A native config file is needed for the native module. The extension is config. Put the config file in the same directory as the SPVM module.
# Native configuration file for Foo::Bar module
SPVM/Foo/Bar.configIf the native config file does not exist, an exception occurs.
Native config files are writen by Perl. It must return Builder::Config object, otherwise an exception occurs.
I show some examples of native config files.
GNU99 Config File
# GNU99 Config File
use strict;
use warnings;
use SPVM::Builder::Config;
my $config = SPVM::Builder::Config->new_gnu99(file => __FILE__);
$config;C99 Config File
# C99 Config File
use strict;
use warnings;
use SPVM::Builder::Config;
my $config = SPVM::Builder::Config->new_c99(file => __FILE__);
$config;C11 Config File
# C11 Config File
use strict;
use warnings;
use SPVM::Builder::Config;
my $config = SPVM::Builder::Config->new_c(file => __FILE__);
$config->set_std('c11');
$config;C++ Config File
# C++ Config File
use strict;
use warnings;
use SPVM::Builder::Config;
my $config = SPVM::Builder::Config->new_cpp(file => __FILE__);
$config;C++11 Config File
# C++11 Config File
use strict;
use warnings;
use SPVM::Builder::Config;
my $config = SPVM::Builder::Config->new_cpp(file => __FILE__);
$config->set_std('c++11');
$config;CUDA/nvcc Config File
use strict;
use warnings;
my $config = SPVM::Builder::Config->new(file => __FILE__);
# Compiler and Linker common
my @ccldflags = qw(--compiler-options '-fPIC');
# Compiler
$config->cc('nvcc');
$config->add_ccflags(@ccldflags);
$config->ext('cu');
# Linker
$config->ld('nvcc');
$config->add_ldflags('-shared', @ccldflags);
$config;Config Setting
Output the commands of the compililation and the link
use strict;
use warnings;
use SPVM::Builder::Config;
my $config = SPVM::Builder::Config->new_gnu99(file => __FILE__);
# Output the commands of the compililation and link
$config->quiet(0);
$config;Force the compilation and the link
use strict;
use warnings;
use SPVM::Builder::Config;
my $config = SPVM::Builder::Config->new_gnu99(file => __FILE__);
# Force the compilation and the link
$config->force(1);
$config;Native Module
A native module is written by a native language such as C language, C++, or the language that the rule of function call is the same as C language.
Native Module File Extension
The file extension of the native module is defined ext method in the config file.
$config->ext('cpp');Generally the extension of C language is c, the extension of C++ is cpp, the extension of CUDA/nvcc is cu.
Put the config file in the same directory as the SPVM module.
# Native module file for Foo::Bar module
SPVM/Foo/Bar.cNative Function Definition
This is an example of SPVM natvie module. The config file is GNU99.
#include "spvm_native.h"
int32_t SPVM__Foo__Bar__sum(SPVM_ENV* env, SPVM_VALUE* stack) {
int32_t num1 = stack[0].ival;
int32_t num2 = stakc[1].ival;
int32_t total = num1 + num2;
stack[0].ival = total;
return 0;
}Native Function Name
A SPVM native method have a native function.
Native funtions have the rule of the names. For example, the name is SPVM__Foo__Bar__sum.
SPVM__Foo__Bar__sumThis name is write by the following rules.
The function name starts with SPVM__.
Followed by the class name "Foo__Bar", that is replaced :: with __.
Followed by __.
Followed by the method name "sum".
If the name is invalid, a compilation error occurs.
Native API Header
Include spvm_native.h at the beginning of the natvie module. spvm_native.h is the header of Native APIs. It defines the native APIs and the data structures, such as SPVM_ENV, SPVM_VALUE.
#include "spvm_native.h"Native Function Arguments
A native function has two arguments.
The first argument is env that type is SPVM_ENV*. This has the information of the runtime environment.
The second argument is stack that type is SPVM_VALUE*. This is used for getting the values of the arguments and setting the return value.
int32_t SPVM__Foo__Bar__sum(SPVM_ENV* env, SPVM_VALUE* stack) {
}In the above example, SPVM native method takes two arguments that type is int. It calculates the sum of the tow values, and returns the total value.
#include "spvm_native.h"
int32_t SPVM__Foo__Bar__sum(SPVM_ENV* env, SPVM_VALUE* stack) {
int32_t num1 = stack[0].ival;
int32_t num2 = stakc[1].ival;
int32_t total = num1 + num2;
stack[0].ival = total;
return 0;
}Native Function Return Value
The type of return value of native function is int32_t. If the method succeeds, the method must return 1. If the method fails, the method must return 0.
Note that this is not the return value of the SPVM native method, such as the total value in the above example.
Compile Native Method
Native methods are compiled into a shared libraries. teay are shared libraries (.so) on Unix/Linux, dynamic link libraries (.dll) on Windows or etc corresponding to your os.
The compilation is done when SPVM is compiled. The build directory must exist, otherwise an exception occures.
The default build directory is the "~/.spvm_build" directory in the directory containing the executed Perl script, and can be changed with the environment variable "SPVM_BUILD_DIR".
If you want to use SPVM Native Method from Perl, create a "~/.spvm_build" directory in the directory where the executed Perl script exists.
~/.spvm_buildThe generated object files exists under "work/object" under the build directory. The object file name is the name which the extension of the SPVM module name is changed to ".o".
~/.spvm_build/work/object/Foo/Bar.oThe generated shared libraries exists under "work/lib" under the build directory. The name of shared library is the name which the extension of the SPVM module name is changed to ".so", or etc corresponding to your os.
# Unix/Linux
~/.spvm_build/work/object/Foo/Bar.so
# Windows
~/.spvm_build/work/object/Foo/Bar.dllStack
The stack is the second argument of the definition of the Native Method. This is called stack. Stack is used getting arguments and return the value.
int32_t SPVM__Foo__Bar__sum(SPVM_ENV* env, SPVM_VALUE* stack) {
}SPVM_VALUE is a union type of C language to store SPVM values. You can save integral value, floating point value, object value, and reference value to it.
For example, to get the value of the first argument(0th) of int type, write as follows.
int32_t args0 = stack[0].ival;For example, to get the value of the second argument(1th) of long type, write as follows.
int64_t args1 = stack[1].lval;For example, to return a value of double type, write as follows.
stack[0].dval = 0.5;Getting Argument
Getting byte Type Argument
To get the SPVM byte argument, access the bval field. Assign to the C language int8_t type.
int8_t args0 = stack[0].bval;Getting short Type Argument
To get the short argument of SPVM, access the sval field. Assign it to the C language int16_t type.
int16_t args0 = stack[0].sval;Getting int Type Argument
To get the SPVM int type argument, access the ival field. Assign to the C language int32_t type.
int32_t args0 = stack[0].ival;Getting long Type Argument
To get the long argument of SPVM, access the lval field. Assign to the C language int64_t type.
int64_t args0 = stack[0].lval;Getting float Type Argument
To get the SPVM float type argument, access the fval field. Assign to float type of C language.
float args0 = stack[0].fval;Getting double Type Argument
To get the SPVM double argument, access the dval field. Assign to the C language double type.
double args0 = stack[0].dval;Getting Object Type Argument
To get the SPVM object type argument, access the oval field. Assign it to void* type in C language.
void* args0 = stack[0].oval;Getting byte Reference Type Argument
If you get SPVM byte Reference Type argument, use "bref" field. it can be assinged to the value of C language int8_t* type.
int8_t* args0 = stack[0].bref;Getting short Reference Type Argument
If you get SPVM short Reference Type argument, use "sref" field. it can be assinged to the value of C language int16_t* type.
int16_t* args0 = stack[0].sref;Getting int Reference Type Argument
If you get SPVM int Reference Type argument, use "iref" field. it can be assinged to the value of C language int32_t* type.
int32_t* args0 = stack[0].iref;Getting long Reference Type Argument
If you get SPVM long Reference Type argument, use "lref" field. it can be assinged to the value of C language int64_t* type.
int64_t* args0 = stack[0].lref;Getting float Reference Type Argument
If you get SPVM float Reference Type argument, use "fref" field. it can be assinged to the value of C language float* type.
float* args0 = stack[0].fref;Getting double Reference Type Argument
If you get SPVM double Reference Type Argument, use "dref" field. it can be assinged to the value of C language double* type.
double* args0 = stack[0].dref;Getting Multi-Numeric Type Arguments
In a Native Method, multiple numeric type arguments are assigned to the coresponding multiple arguments.
For example, In the case of the argument values of Complex_2d type, you can get them by the following way.
double args_re = stack[0].dval;
double args_im = stack[1].dval;Note that you cannot access the values by the field name of Complex_2d.
Return Value
Setting Return Value of byte Type
Use bval field of SPVM_VALUE to set a return value which type of SPVM is byte. This is corresponding to int8_t type of C language.
int8_t retval;
stack[0].bval = retval;Setting Return Value of short Type
Use sval field of SPVM_VALUE to set a return value which type of SPVM is short. This is corresponding to int16_t type of C language.
int16_t retval;
stack[0].sval = retval;Setting Return Value of int Type
Use ival field of SPVM_VALUE to set a return value which type of SPVM is int. This is corresponding to int32_t type of C language.
int32_t retval;
stack[0].ival = retval;Setting Return Value of long Type
Use lval field of SPVM_VALUE to set a return value which type of SPVM is long. This is corresponding to int64_t type of C language.
int64_t retval;
stack[0].lval = retval;Setting Return Value of float Type
Use fval field of SPVM_VALUE to set a return value which type of SPVM is float. This is corresponding to float type of C language.
float retval;
stack[0].fval = retval;Setting Return Value of double Type
Use dval field of SPVM_VALUE to set a return value which type of SPVM is double. This is corresponding to double type of C language.
double retval;
stack[0].dval = retval;Setting Return Value of Object Type
Use oval field of SPVM_VALUE to set a return value which type of SPVM is object. This is corresponding to void* type of C language.
void* retval;
stack[0].oval = retval;Setting Return Value of Multi-Numeric Type
If you set multiple numeric return value in native method, set multiple return values.
For example, in the case of Complex_2d, do the following.
double retval_x;
double retval_y;
stack[0].dval = retval_x;
stack[1].dval = retval_y;Calling Method
If you want to call a method, you get a method id using get_class_method_id or get_instance_method_id.
get_class_method_id get a method id of a class method.
get_instance_method_id get a method id of a instance method.
// Get method id of class method
int32_t method_id = env->get_class_method_id(env, "Foo", "sum", "int(int,int)");
// Get method id of instance method
int32_t method_id = env->get_instance_method_id(env, object, "sum", "int(int,int)");If method_id is less than 0, it means that the method was not found. It is safe to handle exceptions as follows.
if (method_id < 0) { return env->die(env, stack, "Can't find method id", "Foo/Bar.c", __LINE__); }Set the SPVM method argument to stack before calling the method.
stack[0].ival = 1;
stack[0].ival = 2;To call a SPVM method, use the <a href="#native-api-native-sub-api-call_spvm_method">call_spvm_method</a> function.
int32_t error = env->call_spvm_method(env, method_id, stack);Nonzero if the method raised an exception, 0 if no exception occurred.
The return value of the method is stored in the first element of the stack.
int32_t total = stack[0].ival;Scope
Native method are entirely enclosed in scope.
Objects added to the mortal stack will automatically have their reference count decremented by 1 when the Native Method ends. When the reference count reaches 0, it is released.
Use push_mortal to add objects to the mortal stack.
env->push_mortal(env, stack, object);Native APIs that normally create an object such as "new_object" will add the automatically created object to the mortal stack so you don't need to use this.
Use "enter_scope" to create a scope. The return value is the ID of that scope.
int32_t scope_id = env->enter_scope(env, stack);Use "leave_scope" to leave the scope. For the argument, it is necessary to specify the scope ID obtained in "enter_scope".
env->leave_scope(env, stack, scope_id);Use "remove_mortal" to remove the object from the mortal stack. For the argument, specify the scope ID obtained by "enter_scope" and the object you want to remove. The object is removed from the mortal stack and the reference count is automatically decremented by 1. When the reference count reaches 0, it is released.
env->remove_mortal(env, stack, scope_id, object);Information about the mortal stack is stored in env.
Exception
In the Native Method, it is the return value that indicates whether an exception has occurred.
return 0;
return 1;If no exception occurs, "0" is returned. This is defined as "0".
If an exception occurs, "1" is returned. It is defined as a value other than "0".
If you want to set the exception message yourself, you can create an exception message with "new_string_nolen" and set it with "set_exception".
env->set_exception(env, stack, env->new_string_nolen(env, stack, "Exception occur");
return 1;If no exception message is set, a default exception message will be set.
Usually, die is defined to make it easier to use, so it is better to use this.
return env->die("Error. Values must be %d and %d", 3, 5, "Foo/Bar.c", __LINE__);die can be used in the same way as the C language sprintf function. Be sure to include this file name in the second from the end, and the line number in the last argument. If the message exceeds 255 bytes, the excess is truncated.
The exception is stored in env.
Pointer Type
There is a type called pointer type in SPVM, but I will explain how to use it.
The pointer type definition specifies the pointer_t descriptor in the SPVM class definition. Pointer types cannot have field definitions. This example describes how to use the C standard "struct tm" as a pointer type.
# SPVM/MyTimeInfo.spvm
class MyTimeInfo : pointer_t {
# Constructor
native static method new : MyTimeInfo ();
# Get second
native method sec : int ();
# Destructor
native method DESTROY : ();
}It defines a new constructor, a method that takes seconds information called sec, and a destructor called DESTROY. These are Native Method.
Next is the definition on the C language side.
# SPVM/MyTimeInfo.c
int32_t SPVM__MyTimeInfo__new(SPVM_ENV* env, SPVM_VALUE* stack) {
// Alloc strcut tm
void* tm_ptr = env->alloc_memory_block_zero (sizeof (struct tm));
// Create strcut tm instance
void* tm_obj = env->new_pointer(env, stack, "MyTimeInfo", tm_ptr);
stack[0].oval = tm_obj;
return 0;
}
int32_t SPVM__MyTimeInfo__sec(SPVM_ENV* env, SPVM_VALUE* stack) {
void* tm_obj = stack[0].oval;
strcut tm* tm_ptr = (struct tm*) env->get_pointer(env, stack, tm_obj);
stack[0].ival = tm_ptr-> tm_sec;
return 0;
}
int32_t SPVM__MyTimeInfo__DESTROY(SPVM_ENV* env, SPVM_VALUE* stack) {
void* tm_obj = stack[0].oval;
strcut tm* tm_ptr = (struct tm*) env->get_pointer(env, stack, tm_obj);
env->free_memory_block (tm_ptr);
return 0;
}In the constructor new, the memory of "struct tm" is first allocated by the alloc_memory_block_zero function. This is a function that reserves one memory block in SPVM. Similar to malloc, this function increments the memory block count by one, making it easier to spot memory leaks.
// Alloc strcut tm
void* tm_ptr = env->alloc_memory_block_zero (sizeof (struct tm));Next, use the new_pointer function to create a new pointer type object with MyTimeInfo associated with it in the allocated memory.
// Create strcut tm instance
void* tm_obj = env->new_pointer(env, stack, "MyTimeInfo", tm_ptr);If you return this as a return value, the constructor is complete.
stack[0].ival = tm_ptr-> tm_sec;
return 0;Next, let's get the value of tm_sec. sec method. The get_pointer function can be used to get a pointer to the memory allocated as a "struct tm" from a pointer type object.
void* tm_obj = stack[0].oval;
strcut tm* tm_ptr = (struct tm*) env->get_pointer(env, stack, tm_obj);
stack[0].ival = tm_ptr-> tm_sec;The last is the destructor. Be sure to define a destructor, as the allocated memory will not be released automatically.
int32_t SPVM__MyTimeInfo__DESTROY(SPVM_ENV* env, SPVM_VALUE* stack) {
void* tm_obj = stack[0].oval;
strcut tm* tm_ptr = (struct tm*) env->get_pointer(env, stack, tm_obj);
env->free_memory_block (tm_ptr);
return 0;
}Execute the free_memory_block function to free the memory. Be sure to free the memory allocated by alloc_memory_block_zero with the free_memory_block function. Releases the memory and decrements the memory block count by one.
Calling Native API
Native API can be called from "SPVM_ENV* env" passed as an argument. Note that you have to pass env as the first argument.
int32_t basic_type_id = env->get_basic_type_id(env, "Int");Utilities
Utilities.
spvmdist
If you want to create SPVM module that have the native module, spvmdist is useful.