php-src/Zend
Ilija Tovilo ffc250d245
Add runtime type inference verification
Co-authored-by: Dmitry Stogov <dmitry@zend.com>

Closes GH-12930
2024-01-19 09:29:14 +01:00
..
asm Merge branch 'PHP-8.2' 2023-02-05 16:47:09 +00:00
Optimizer Add runtime type inference verification 2024-01-19 09:29:14 +01:00
tests Add runtime type inference verification 2024-01-19 09:29:14 +01:00
bench.php
LICENSE
Makefile.frag Sync YFLAGS in scripts/dev/genfiles with PHP_PROG_BISON macro defaults (#12709) 2023-11-22 22:54:09 +01:00
micro_bench.php
README.md [ci skip] Update README.md on ZE description 2022-02-08 10:38:33 +01:00
zend_alloc_sizes.h Fix GH-9361: Segmentation fault on script exit 2022-08-22 12:59:17 +02:00
zend_alloc.c Fix asan false positive for mmap 2023-12-05 12:18:09 +01:00
zend_alloc.h Zend: Remove dependency on zend.h for certain headers (#12166) 2023-09-11 12:27:21 +01:00
zend_API.c Merge branch 'PHP-8.3' 2023-11-03 17:18:40 +00:00
zend_API.h Introduce Z_PARAM_FUNC_EX2 to maintain compatibility (#12419) 2023-10-11 19:55:00 +02:00
zend_arena.h Use zend_error_noreturn for E_ERROR consistently 2023-09-14 11:44:55 +02:00
zend_ast.c More usage of known zend_str instead of C string (#11381) 2023-06-08 13:03:29 +01:00
zend_ast.h zend: introducing ZEND_ELEMENT_COUNT for struct's dynamic arrays. (#12650) 2023-11-13 12:42:45 +00:00
zend_atomic.c Fixed undefined macros warnings 2022-09-22 13:17:02 +02:00
zend_atomic.h Fixed undefined macros warnings 2022-09-22 13:17:02 +02:00
zend_attributes_arginfo.h Fix GH-9967 Add support for generating custom function, class const, and property attributes in stubs 2023-08-26 21:35:31 +02:00
zend_attributes.c RFC: Add #[Override] attribute (#9836) 2023-06-29 20:23:53 +02:00
zend_attributes.h zend: introducing ZEND_ELEMENT_COUNT for struct's dynamic arrays. (#12650) 2023-11-13 12:42:45 +00:00
zend_attributes.stub.php Add support for typed class constants in stubs 2023-07-01 11:50:04 +02:00
zend_bitset.h Add AVX2-accelerated UTF-16 decoding/encoding routines 2023-02-05 20:06:42 +02:00
zend_build.h Revert GH-10279 2023-01-16 12:25:59 +01:00
zend_builtin_functions_arginfo.h Make return type of trigger_error() and user_error() true (#13169) 2024-01-17 17:15:55 +01:00
zend_builtin_functions.c Merge branch 'PHP-8.3' 2024-01-16 21:06:29 +01:00
zend_builtin_functions.h Revert "Zend/zend_types.h: move zend_result to separate header (#10609)" 2023-04-04 22:48:26 +03:00
zend_builtin_functions.stub.php Make return type of trigger_error() and user_error() true (#13169) 2024-01-17 17:15:55 +01:00
zend_call_stack.c zend_call_stack support proposal for solaris/illumos. (#12862) 2023-12-09 14:19:07 +00:00
zend_call_stack.h zend_call_stack support proposal for solaris/illumos. (#12862) 2023-12-09 14:19:07 +00:00
zend_closures_arginfo.h Add ZEND_ACC_NOT_SERIALIZABLE flag 2021-07-19 15:59:11 +02:00
zend_closures.c Set func pointer to null in Closure __invoke (#12275) 2023-09-25 08:27:23 -06:00
zend_closures.h Revert GH-10300 2023-01-16 12:22:54 +01:00
zend_closures.stub.php Add ZEND_ACC_NOT_SERIALIZABLE flag 2021-07-19 15:59:11 +02:00
zend_compile.c Add runtime type inference verification 2024-01-19 09:29:14 +01:00
zend_compile.h Add runtime type inference verification 2024-01-19 09:29:14 +01:00
zend_config.w32.h Remove "inline" defines on Windows (#7071) 2021-05-31 10:05:18 +02:00
zend_constants_arginfo.h Improve detection of predefined constants 2023-09-07 10:00:55 +02:00
zend_constants.c Revert "Remove name field from the zend_constant struct (#10954)" 2023-07-17 22:32:41 +02:00
zend_constants.h Revert "Remove name field from the zend_constant struct (#10954)" 2023-07-17 22:32:41 +02:00
zend_constants.stub.php Improve detection of predefined constants 2023-09-07 10:00:55 +02:00
zend_cpuinfo.c Windows arm64 zend and standard extension support 2022-08-09 12:45:14 +02:00
zend_cpuinfo.h Cacheline demote to improve performance (#11101) 2023-05-15 10:28:43 +03:00
zend_default_classes.c Implement Fibers 2021-04-26 11:07:06 -05:00
zend_dtrace.c fix dtrace observer callback prototype 2021-06-04 16:03:09 +02:00
zend_dtrace.d
zend_dtrace.h fix dtrace observer callback prototype 2021-06-04 16:03:09 +02:00
zend_enum_arginfo.h Implement enums 2021-03-17 19:08:03 +01:00
zend_enum.c Merge branch 'PHP-8.2' into PHP-8.3 2023-10-11 11:52:11 +02:00
zend_enum.h zend_compiler, ...: use uint8_t instead of zend_uchar (#10621) 2023-02-23 14:56:54 +00:00
zend_enum.stub.php Implement enums 2021-03-17 19:08:03 +01:00
zend_errors.h
zend_exceptions_arginfo.h Fix GH-9967 Add support for generating custom function, class const, and property attributes in stubs 2023-08-26 21:35:31 +02:00
zend_exceptions.c Introduce %S modifier and use it (#13168) 2024-01-16 22:51:02 +01:00
zend_exceptions.h Revert "Zend/zend_types.h: move zend_result to separate header (#10609)" 2023-04-04 22:48:26 +03:00
zend_exceptions.stub.php Require zend_constants.stub.php from zend_exceptions.stubs.php 2022-07-12 10:35:03 +02:00
zend_execute_API.c Use zend_error_noreturn for E_ERROR consistently 2023-09-14 11:44:55 +02:00
zend_execute.c Add runtime type inference verification 2024-01-19 09:29:14 +01:00
zend_execute.h Assert ptr_ptr value of TMP|CONST isn't used (#11865) 2023-08-03 15:28:19 +02:00
zend_extensions.c Document zend_get_op_array_extension_handle 2023-03-30 17:45:34 -06:00
zend_extensions.h Prepare for PHP 8.4 2023-08-29 15:25:46 -04:00
zend_fibers_arginfo.h Add ZEND_ACC_NOT_SERIALIZABLE flag 2021-07-19 15:59:11 +02:00
zend_fibers.c Merge branch 'PHP-8.2' into PHP-8.3 2023-10-11 17:27:54 +02:00
zend_fibers.h Zend/zend_fibers: change return value to zend_result 2023-02-26 15:07:08 +00:00
zend_fibers.stub.php Add ZEND_ACC_NOT_SERIALIZABLE flag 2021-07-19 15:59:11 +02:00
zend_float.c Revert GH-10279 2023-01-16 12:25:59 +01:00
zend_float.h Revert GH-10279 2023-01-16 12:25:59 +01:00
zend_gc.c Merge branch 'PHP-8.2' into PHP-8.3 2023-10-30 23:36:50 +03:00
zend_gc.h Remove WeakMap entries whose key is only reachable through the entry value (#10932) 2023-07-16 13:39:08 +02:00
zend_gdb.c Merge branch 'PHP-8.2' 2023-07-13 12:40:59 +01:00
zend_gdb.h
zend_generators_arginfo.h Add ZEND_ACC_NOT_SERIALIZABLE flag 2021-07-19 15:59:11 +02:00
zend_generators.c general signatures discrepencies fixes (#13122) 2024-01-10 22:19:23 +00:00
zend_generators.h zend_compiler, ...: use uint8_t instead of zend_uchar (#10621) 2023-02-23 14:56:54 +00:00
zend_generators.stub.php Add ZEND_ACC_NOT_SERIALIZABLE flag 2021-07-19 15:59:11 +02:00
zend_globals_macros.h Revert GH-10300 2023-01-16 12:22:54 +01:00
zend_globals.h Shrink some commonly used structs by reordering members (#10880) 2023-03-22 19:26:42 +01:00
zend_hash.c Fix GH-12826: Weird pointers issue in nested loops 2023-12-01 17:12:18 +01:00
zend_hash.h Add some const qualifiers in HashTable foreach macros (#8671) 2023-10-09 17:20:09 +01:00
zend_highlight.c Align highlight_string|file with HTML standard and modern browsers 2023-08-12 15:08:28 +01:00
zend_highlight.h Revert "Zend/zend_types.h: move zend_result to separate header (#10609)" 2023-04-04 22:48:26 +03:00
zend_hrtime.c Expose time spent collecting cycles in gc_status() (#11523) 2023-07-16 12:34:28 +02:00
zend_hrtime.h Remove check for time.h and HAVE_TIME_H (#11726) 2023-07-20 09:38:53 +02:00
zend_inheritance.c Merge branch 'PHP-8.3' 2023-12-05 21:49:42 +01:00
zend_inheritance.h RFC: Add #[Override] attribute (#9836) 2023-06-29 20:23:53 +02:00
zend_ini_parser.y Use :- as ini interpolation fallback separator 2023-07-18 08:31:02 +01:00
zend_ini_scanner.h Zend/zend_ini_scanner: parse const strings 2023-01-04 12:49:48 +00:00
zend_ini_scanner.l small fixes 2023-07-18 08:31:02 +01:00
zend_ini.c Merge branch 'PHP-8.2' into PHP-8.3 2023-10-14 18:44:26 +01:00
zend_ini.h Fix -Wenum-int-mismatch warnings on gcc 13 2023-04-20 16:04:59 +02:00
zend_interfaces_arginfo.h Drop serial denier functions 2021-07-20 13:11:11 +02:00
zend_interfaces.c general signatures discrepencies fixes (#13122) 2024-01-10 22:19:23 +00:00
zend_interfaces.h Revert GH-10300 2023-01-16 12:22:54 +01:00
zend_interfaces.stub.php Drop serial denier functions 2021-07-20 13:11:11 +02:00
zend_istdiostream.h
zend_iterators.c Revert GH-10300 2023-01-16 12:22:54 +01:00
zend_iterators.h general signatures discrepencies fixes (#13122) 2024-01-10 22:19:23 +00:00
zend_language_parser.y Correctly handle multiple constants in typed declaration 2023-05-21 14:17:01 +01:00
zend_language_scanner.h Revert GH-10300 2023-01-16 12:22:54 +01:00
zend_language_scanner.l Fix GH-10634: Lexing memory corruption (#10866) 2023-03-17 17:09:14 +01:00
zend_list.c Merge branch 'PHP-8.1' into PHP-8.2 2023-10-29 21:47:23 +01:00
zend_list.h Fix -Wenum-int-mismatch warnings on gcc 13 2023-04-20 16:04:59 +02:00
zend_llist.c Revert GH-10300 2023-01-16 12:22:54 +01:00
zend_llist.h Revert GH-10300 2023-01-16 12:22:54 +01:00
zend_long.h Revert GH-10279 2023-01-16 12:25:59 +01:00
zend_map_ptr.h Revert GH-10279 2023-01-16 12:25:59 +01:00
zend_max_execution_timer.c Fix timer leak (#13027) 2024-01-05 19:36:19 +01:00
zend_max_execution_timer.h fix: support for timeouts with ZTS on Linux (#10141) 2023-03-03 11:35:06 +01:00
zend_mmap.h Use PDEATHSIG to kill cli-server workers if parent exists 2022-09-08 10:48:20 +02:00
zend_modules.h Prepare for PHP 8.4 2023-08-29 15:25:46 -04:00
zend_multibyte.c general signatures discrepencies fixes (#13122) 2024-01-10 22:19:23 +00:00
zend_multibyte.h Fix -Wenum-int-mismatch warnings on gcc 13 2023-04-20 16:04:59 +02:00
zend_multiply.h Revert GH-10279 2023-01-16 12:25:59 +01:00
zend_object_handlers.c Fix OSS Fuzz #61865: Undef variable in ++/-- for declared property that is unset in error handler 2023-09-05 10:40:02 +01:00
zend_object_handlers.h Introduce Zend guard recursion protection 2023-08-24 13:03:14 +01:00
zend_objects_API.c Revert GH-10300 2023-01-16 12:22:54 +01:00
zend_objects_API.h Zend: Remove dependency on zend.h for certain headers (#12166) 2023-09-11 12:27:21 +01:00
zend_objects.c Introduce Zend guard recursion protection 2023-08-24 13:03:14 +01:00
zend_objects.h Revert GH-10300 2023-01-16 12:22:54 +01:00
zend_observer.c Fix add/remove observer API with multiple observers installed 2023-06-09 14:00:53 +02:00
zend_observer.h Revert GH-10300 2023-01-16 12:22:54 +01:00
zend_opcode.c Merge branch 'PHP-8.2' into PHP-8.3 2023-12-25 13:22:39 +03:00
zend_operators.c Fixed oss-fuzz #62294: Unsetting variable after ++/-- on string variable warning 2023-09-17 15:49:46 +01:00
zend_operators.h Merge branch 'PHP-8.3' 2023-12-22 14:01:05 +00:00
zend_portability.h Use __attribute__((assume())) in ZEND_ASSUME when available 2024-01-19 09:25:55 +01:00
zend_ptr_stack.c Revert GH-10220 2023-01-16 12:27:33 +01:00
zend_ptr_stack.h Revert GH-10220 2023-01-16 12:27:33 +01:00
zend_range_check.h
zend_signal.c Fix -Wenum-int-mismatch warnings on gcc 13 2023-04-20 16:04:59 +02:00
zend_signal.h Revert GH-10220 2023-01-16 12:27:33 +01:00
zend_smart_str_public.h Revert GH-10220 2023-01-16 12:27:33 +01:00
zend_smart_str.c Use zend_error_noreturn for E_ERROR consistently 2023-09-14 11:44:55 +02:00
zend_smart_str.h Revert GH-10220 2023-01-16 12:27:33 +01:00
zend_smart_string_public.h Revert GH-10220 2023-01-16 12:27:33 +01:00
zend_smart_string.h Revert GH-10220 2023-01-16 12:27:33 +01:00
zend_sort.c Revert "#include cleanup (#10216)" 2023-01-16 12:29:41 +01:00
zend_sort.h Revert "#include cleanup (#10216)" 2023-01-16 12:29:41 +01:00
zend_stack.c Two enums instead of preprocessor macros (#10617) 2023-02-21 15:34:33 +01:00
zend_stack.h Two enums instead of preprocessor macros (#10617) 2023-02-21 15:34:33 +01:00
zend_stream.c Revert GH-10279 2023-01-16 12:25:59 +01:00
zend_stream.h Revert "Zend/zend_types.h: move zend_result to separate header (#10609)" 2023-04-04 22:48:26 +03:00
zend_string.c Merge branch 'PHP-8.3' 2024-01-09 20:06:15 +03:00
zend_string.h Zend: Remove dependency on zend.h for certain headers (#12166) 2023-09-11 12:27:21 +01:00
zend_strtod_int.h build/php.m4: remove test for integer types (#10304) 2023-01-13 11:51:15 +00:00
zend_strtod.c Mark constant static arrays in function bodies actually as const (#10325) 2023-01-15 14:51:31 +00:00
zend_strtod.h Move php_gcvt to zend_gcvt 2021-08-02 14:51:46 +02:00
zend_system_id.c zend_compiler, ...: use uint8_t instead of zend_uchar (#10621) 2023-02-23 14:56:54 +00:00
zend_system_id.h Revert "Zend/zend_types.h: move zend_result to separate header (#10609)" 2023-04-04 22:48:26 +03:00
zend_type_info.h Backport fix for HASH/PACKED array inference through MAY_BE_ARRAY_EMPTY flag (#12591) 2023-11-03 10:54:57 +03:00
zend_types.h zend: introducing ZEND_ELEMENT_COUNT for struct's dynamic arrays. (#12650) 2023-11-13 12:42:45 +00:00
zend_variables.c Revert "Zend/zend_type_code: remove hard-coded integer values and" 2023-03-03 21:19:58 +00:00
zend_variables.h Zend: Remove dependency on zend.h for certain headers (#12166) 2023-09-11 12:27:21 +01:00
zend_verify_type_inference.h Add runtime type inference verification 2024-01-19 09:29:14 +01:00
zend_virtual_cwd.c Use a single version of mempcpy(3) (#12257) 2023-12-20 15:16:32 +00:00
zend_virtual_cwd.h Cache d_type in directory entry 2023-07-07 18:02:32 +02:00
zend_vm_def.h Merge branch 'PHP-8.2' into PHP-8.3 2023-12-01 16:50:49 +01:00
zend_vm_execute.h Add runtime type inference verification 2024-01-19 09:29:14 +01:00
zend_vm_execute.skl Fixed GH-12596: Segmentation fault on AArch64 release build with opcache.jit=1112 (#12813) 2023-12-05 12:04:00 +03:00
zend_vm_gen.php Add runtime type inference verification 2024-01-19 09:29:14 +01:00
zend_vm_handlers.h Add typed specialization for ZEND_COUNT (#11825) 2023-08-03 12:33:32 +02:00
zend_vm_opcodes.c Allow arbitrary expressions in static variable initializer 2023-05-24 20:17:31 +02:00
zend_vm_opcodes.h A new PHP JIT implementation based on IR JIT framework (#12079) 2023-10-23 10:15:52 +03:00
zend_vm_trace_handlers.h Use more compact representation for packed arrays. 2021-11-03 15:18:26 +03:00
zend_vm_trace_lines.h
zend_vm_trace_map.h Use more compact representation for packed arrays. 2021-11-03 15:18:26 +03:00
zend_vm.h Add function exposing HAVE_GCC_GLOBAL_REGS (#8359) 2022-06-08 12:32:30 +01:00
zend_weakrefs_arginfo.h Not serializable flag permeation 2021-07-20 12:28:35 +02:00
zend_weakrefs.c general signatures discrepencies fixes (#13122) 2024-01-10 22:19:23 +00:00
zend_weakrefs.h Remove WeakMap entries whose key is only reachable through the entry value (#10932) 2023-07-16 13:39:08 +02:00
zend_weakrefs.stub.php Not serializable flag permeation 2021-07-20 12:28:35 +02:00
zend.c Merge branch 'PHP-8.3' 2023-11-01 16:28:50 +03:00
zend.h PHP-8.3 is now for PHP-8.3.3-dev 2024-01-02 15:50:36 +00:00
Zend.m4 build: Fix check for sigsetjmp (#12606) 2023-11-04 15:13:01 +00:00

Zend Engine

Zend memory manager

General

The goal of the new memory manager (available since PHP 5.2) is to reduce memory allocation overhead and speedup memory management.

Debugging

Normal:

sapi/cli/php -r 'leak();'

Zend MM disabled:

USE_ZEND_ALLOC=0 valgrind --leak-check=full sapi/cli/php -r 'leak();'

Shared extensions

Since PHP 5.3.11 it is possible to prevent shared extensions from unloading so that valgrind can correctly track the memory leaks in shared extensions. For this there is the ZEND_DONT_UNLOAD_MODULES environment variable. If set, then DL_UNLOAD() is skipped during the shutdown of shared extensions.

ZEND_VM

ZEND_VM architecture allows specializing opcode handlers according to op_type fields and using different execution methods (call threading, switch threading and direct threading). As a result ZE2 got more than 20% speedup on raw PHP code execution (with specialized executor and direct threading execution method). As in most PHP applications raw execution speed isn't the limiting factor but system calls and database calls are, your mileage with this patch will vary.

Most parts of the old zend_execute.c go into zend_vm_def.h. Here you can find opcode handlers and helpers. The typical opcode handler template looks like this:

ZEND_VM_HANDLER(<OPCODE-NUMBER>, <OPCODE>, <OP1_TYPES>, <OP2_TYPES>)
{
    <HANDLER'S CODE>
}

<OPCODE-NUMBER> is a opcode number (0, 1, ...) <OPCODE> is an opcode name (ZEN_NOP, ZEND_ADD, :) <OP1_TYPES> and <OP2_TYPES> are masks for allowed operand op_types. Specializer will generate code only for defined combination of types. You can use any combination of the following op_types UNUSED, CONST, VAR, TMP and CV also you can use ANY mask to disable specialization according operand's op_type. <HANDLER'S CODE> is a handler's code itself. For most handlers it stills the same as in old zend_execute.c, but now it uses macros to access opcode operands and some internal executor data.

You can see the conformity of new macros to old code in the following list:

EXECUTE_DATA
    execute_data
ZEND_VM_DISPATCH_TO_HANDLER(<OP>)
    return <OP>_helper(ZEND_OPCODE_HANDLER_ARGS_PASSTHRU)
ZEND_VM_DISPATCH_TO_HELPER(<NAME>)
    return <NAME>(ZEND_OPCODE_HANDLER_ARGS_PASSTHRU)
ZEND_VM_DISPATCH_TO_HELPER_EX(<NAME>,<PARAM>,<VAL>)
    return <NAME>(<VAL>, ZEND_OPCODE_HANDLER_ARGS_PASSTHRU)
ZEND_VM_CONTINUE()
    return 0
ZEND_VM_NEXT_OPCODE()
    NEXT_OPCODE()
ZEND_VM_SET_OPCODE(<TARGET>
    SET_OPCODE(<TARGET>
ZEND_VM_INC_OPCODE()
    INC_OPCOD()
ZEND_VM_RETURN_FROM_EXECUTE_LOOP()
    RETURN_FROM_EXECUTE_LOOP()
ZEND_VM_C_LABEL(<LABEL>):
    <LABEL>:
ZEND_VM_C_GOTO(<LABEL>)
    goto <LABEL>
OP<X>_TYPE
    opline->op<X>.op_type
GET_OP<X>_ZVAL_PTR(<TYPE>)
    get_zval_ptr(&opline->op<X>, EX(Ts), &free_op<X>, <TYPE>)
GET_OP<X>_ZVAL_PTR_PTR(<TYPE>)
    get_zval_ptr_ptr(&opline->op<X>, EX(Ts), &free_op<X>, <TYPE>)
GET_OP<X>_OBJ_ZVAL_PTR(<TYPE>)
    get_obj_zval_ptr(&opline->op<X>, EX(Ts), &free_op<X>, <TYPE>)
GET_OP<X>_OBJ_ZVAL_PTR_PTR(<TYPE>)
    get_obj_zval_ptr_ptr(&opline->op<X>, EX(Ts), &free_op<X>, <TYPE>)
IS_OP<X>_TMP_FREE()
    IS_TMP_FREE(free_op<X>)
FREE_OP<X>()
    FREE_OP(free_op<X>)
FREE_OP<X>_IF_VAR()
    FREE_VAR(free_op<X>)
FREE_OP<X>_VAR_PTR()
    FREE_VAR_PTR(free_op<X>)

Executor's helpers can be defined without parameters or with one parameter. This is done with the following constructs:

ZEND_VM_HELPER(<HELPER-NAME>, <OP1_TYPES>, <OP2_TYPES>)
{
    <HELPER'S CODE>
}

ZEND_VM_HELPER_EX(<HELPER-NAME>, <OP1_TYPES>, <OP2_TYPES>, <PARAM_SPEC>)
{
    <HELPER'S CODE>
}

The executors code is generated by the PHP script zend_vm_gen.php. It uses zend_vm_def.h and zend_vm_execute.skl as input and produces zend_vm_opcodes.h and zend_vm_execute.h. The first file is a list of opcode definitions. It is included from zend_compile.h. The second one is an executor code itself. It is included from zend_execute.c.

zend_vm_gen.php can produce different kind of executors. You can select a different opcode threading model using --with-vm-kind=CALL|SWITCH|GOTO|HYBRID. You can disable opcode specialization using --without-specializer. At last you can debug the executor using the original zend_vm_def.h or the generated zend_vm_execute.h file. Debugging with the original file requires the --with-lines option. By default, Zend Engine uses the following command to generate the executor:

# Default VM kind is HYBRID
php zend_vm_gen.php --with-vm-kind=HYBRID