Daniel Micay
684e63a878
handle pthread_atfork calling into malloc
...
This results in compatibility with the malloc replacement support added
in musl 1.1.20.
2018-09-06 19:48:00 -04:00
Daniel Micay
1be74ec40d
add initial guard slabs implementation
2018-09-06 18:55:24 -04:00
Daniel Micay
cc1e79fdba
abstract metadata allocation to allow guard slabs
2018-09-06 18:45:41 -04:00
Daniel Micay
d8e18e0011
aligned_alloc is now the same as BSD memalign
...
The resolution to DR 460 (which is explicitly included in C17) removed
the requirement for the size to be a multiple of the alignment.
2018-09-06 16:30:22 -04:00
Daniel Micay
0d3c2e1988
no need for a dedicated init rng
2018-09-06 16:02:25 -04:00
Daniel Micay
8624201f06
refresh canary value when allocating free slabs
2018-09-06 15:07:01 -04:00
Daniel Micay
a875951e82
fix build with musl
2018-09-06 14:35:08 -04:00
Daniel Micay
e891b40588
implement Android malloc_disable/malloc_enable API
2018-09-06 14:17:23 -04:00
Daniel Micay
3a532b17dc
implement in-place shrinking for large allocations
2018-09-05 07:37:26 -04:00
Daniel Micay
645209dcbf
remove unnecessary debugging code
2018-09-05 03:42:05 -04:00
Daniel Micay
9ddd53d56c
implement initial slab allocation canaries
2018-09-04 09:29:35 -04:00
Daniel Micay
1a7b8079d0
reuse is_init when possible
2018-09-02 19:58:57 -04:00
Daniel Micay
7733047c7b
trigger early initialization in a conservative way
2018-09-02 19:52:12 -04:00
Daniel Micay
7e088dc870
add stubs for Android extensions
2018-09-02 05:08:45 -04:00
Daniel Micay
e4648192c0
split out code for managing page spans
2018-09-02 02:03:39 -04:00
Daniel Micay
e93d039214
only use reserved memory for regions hash table
2018-09-01 10:23:06 -04:00
Daniel Micay
c3a4829d77
remove unnecessary special case from realloc
2018-09-01 02:42:33 -04:00
Daniel Micay
f441dfe2e3
align size class metadata to cacheline size
2018-08-31 23:10:26 -04:00
Daniel Micay
fad10ce943
use FIFO queue for free slabs
2018-08-31 22:55:49 -04:00
Daniel Micay
3f80895822
ignore pad argument to malloc_trim per glibc
...
The pad argument is only used by the main arena for sbrk in glibc, with
every other page size gap purged with MADV_DONTNEED. It makes more sense
to simply treat it as an ignored legacy parameter rather than trying to
come up with a sensible way to use it for keeping cached free slabs.
2018-08-30 09:36:46 -04:00
Daniel Micay
1ea997b887
add missing headers to malloc.h
2018-08-30 08:48:43 -04:00
Daniel Micay
2b0f7aa985
use a consistent name for size class integer index
2018-08-30 07:13:28 -04:00
Daniel Micay
0f5f2bf6c9
add basic initial heuristic for freeing slabs
2018-08-30 06:56:00 -04:00
Daniel Micay
456dfe4154
add support for purging and protecting empty slabs
2018-08-30 05:59:44 -04:00
Daniel Micay
bb176e09bc
remove useless code in the empty_slabs path
2018-08-30 05:45:03 -04:00
Daniel Micay
29df2429c2
empty_slabs will remain a singly-linked list
2018-08-30 05:27:51 -04:00
Daniel Micay
f94068ea63
rename free_slabs to empty_slabs
2018-08-30 04:55:39 -04:00
Daniel Micay
b6d4af872f
move libdivide.h to third_party/libdivide.h
2018-08-30 03:03:19 -04:00
Daniel Micay
6f9de3e667
add inline hint to get_size_info
2018-08-29 15:13:53 -04:00
Daniel Micay
e85c69a0a4
fix builds with prefix
2018-08-29 15:07:36 -04:00
Daniel Micay
becadc57a5
get rid of unused MIN_ALIGN definition
2018-08-29 14:18:45 -04:00
Daniel Micay
2684a98eab
add initial malloc_object_size extensions
2018-08-29 14:18:42 -04:00
Daniel Micay
0e2f3d1015
sanity check page size at runtime
2018-08-29 11:00:18 -04:00
Daniel Micay
d779d41721
wrap more memory mapping implementation details
2018-08-29 10:57:42 -04:00
Daniel Micay
1cb28531a8
add wrapper for mremap with sanity check
2018-08-29 10:43:54 -04:00
Daniel Micay
5bc6820c24
rely on mmap rounding to page size when possible
2018-08-29 03:25:00 -04:00
Daniel Micay
58d929c0f0
split out low-level memory mapping wrappers
2018-08-29 00:53:38 -04:00
Daniel Micay
8b42e8c3d6
make sure errno is always set on failure
2018-08-28 22:49:11 -04:00
Daniel Micay
66aa98dbd9
sanity-check mmap errno on failure too
2018-08-28 22:41:18 -04:00
Daniel Micay
705b6a4f8d
make non-out-of-memory mprotect errors fatal
2018-08-28 22:22:57 -04:00
Daniel Micay
19c46d16f1
check pthread_atfork return value
2018-08-28 21:31:20 -04:00
Daniel Micay
803811a6ac
add support for using mremap
2018-08-28 10:44:04 -04:00
Daniel Micay
718bf82f96
add inline hints for slab_allocate and slab_free
2018-08-27 09:29:30 -04:00
Daniel Micay
33f862ec19
add inline hints for init and enforce_init
2018-08-27 09:29:27 -04:00
Daniel Micay
67b9608ccf
avoid duplicated init code calculating slab size
2018-08-27 09:22:04 -04:00
Daniel Micay
c7b24f63f1
use libdivide for substantially faster division
2018-08-27 07:07:48 -04:00
Daniel Micay
63b0c39343
reorder size_class struct for better performance
2018-08-27 05:21:58 -04:00
Daniel Micay
14ca7d7c3f
randomize large allocation guard size
2018-08-26 04:46:12 -04:00
Daniel Micay
a13a45a17d
hold regions_lock in alloc_aligned
2018-08-26 04:37:43 -04:00
Daniel Micay
2b7c9362bb
consume fewer random bytes for slab randomization
2018-08-25 18:32:44 -04:00