Daniel Micay
3dc49f8f73
slightly improve sized deallocation error messages
2018-10-05 01:06:12 -04:00
Daniel Micay
dcd969ae04
use a consistent style for fixed-size int types
...
The stdint.h types don't cover 128-bit integers and the underscore makes
them ill suited to usage in function suffixes. Instead, use the common
naming style in the Linux kernel and elsewhere including the ChaCha8
implementation included here.
2018-10-04 15:17:11 -04:00
Daniel Micay
642eed81c0
allow using larger guards on large allocations
2018-10-04 02:58:24 -04:00
Daniel Micay
5811bd184c
avoid unnecessary preprocessor use for canary mask
2018-10-03 17:17:20 -04:00
Daniel Micay
b24569b6ca
zero leading byte of canaries
2018-10-03 17:09:57 -04:00
Daniel Micay
cf449b3df4
add sized deallocation support
2018-09-19 13:05:12 -04:00
Daniel Micay
82314f4471
make get_size_info straightforward for zero size
2018-09-11 14:51:36 -04:00
Daniel Micay
7a404ddbf2
optimize size calculation for 16 byte spaced sizes
2018-09-11 14:46:44 -04:00
Daniel Micay
2d6ad18aa4
make function naming a bit more consistent
2018-09-11 14:18:13 -04:00
Daniel Micay
684291bf6a
avoid overhead of init check for slab deallocation
2018-09-11 14:13:43 -04:00
Daniel Micay
ef098fea06
simplify init function
2018-09-11 14:12:27 -04:00
Daniel Micay
61684925e8
fix overly naive slab allocation alignment support
2018-09-10 19:01:11 -04:00
Daniel Micay
9a1acce5eb
optimize calloc when zero on free is disabled
2018-09-07 16:33:28 -04:00
Daniel Micay
7ae7abedea
mark more unlikely code paths
2018-09-07 02:53:15 -04:00
Daniel Micay
49af83a817
wrap mutex type to enable future optimization
2018-09-07 01:13:08 -04:00
Daniel Micay
fc2473e7ee
add configuration for canaries
2018-09-07 00:35:08 -04:00
Daniel Micay
96c538d90f
add configuration for zero on free
2018-09-07 00:33:51 -04:00
Daniel Micay
ba3a8b0058
add slot randomization to configuration header
2018-09-07 00:25:02 -04:00
Daniel Micay
bed303a76f
remove unnecessary else branch
2018-09-07 00:22:51 -04:00
Daniel Micay
d398384b90
add header for configuration
2018-09-07 00:17:31 -04:00
Daniel Micay
99d68238d2
implement slab allocation write-after-free check
2018-09-07 00:00:32 -04:00
Daniel Micay
684e63a878
handle pthread_atfork calling into malloc
...
This results in compatibility with the malloc replacement support added
in musl 1.1.20.
2018-09-06 19:48:00 -04:00
Daniel Micay
1be74ec40d
add initial guard slabs implementation
2018-09-06 18:55:24 -04:00
Daniel Micay
cc1e79fdba
abstract metadata allocation to allow guard slabs
2018-09-06 18:45:41 -04:00
Daniel Micay
d8e18e0011
aligned_alloc is now the same as BSD memalign
...
The resolution to DR 460 (which is explicitly included in C17) removed
the requirement for the size to be a multiple of the alignment.
2018-09-06 16:30:22 -04:00
Daniel Micay
0d3c2e1988
no need for a dedicated init rng
2018-09-06 16:02:25 -04:00
Daniel Micay
8624201f06
refresh canary value when allocating free slabs
2018-09-06 15:07:01 -04:00
Daniel Micay
a875951e82
fix build with musl
2018-09-06 14:35:08 -04:00
Daniel Micay
e891b40588
implement Android malloc_disable/malloc_enable API
2018-09-06 14:17:23 -04:00
Daniel Micay
3a532b17dc
implement in-place shrinking for large allocations
2018-09-05 07:37:26 -04:00
Daniel Micay
645209dcbf
remove unnecessary debugging code
2018-09-05 03:42:05 -04:00
Daniel Micay
9ddd53d56c
implement initial slab allocation canaries
2018-09-04 09:29:35 -04:00
Daniel Micay
1a7b8079d0
reuse is_init when possible
2018-09-02 19:58:57 -04:00
Daniel Micay
7733047c7b
trigger early initialization in a conservative way
2018-09-02 19:52:12 -04:00
Daniel Micay
7e088dc870
add stubs for Android extensions
2018-09-02 05:08:45 -04:00
Daniel Micay
e4648192c0
split out code for managing page spans
2018-09-02 02:03:39 -04:00
Daniel Micay
e93d039214
only use reserved memory for regions hash table
2018-09-01 10:23:06 -04:00
Daniel Micay
c3a4829d77
remove unnecessary special case from realloc
2018-09-01 02:42:33 -04:00
Daniel Micay
f441dfe2e3
align size class metadata to cacheline size
2018-08-31 23:10:26 -04:00
Daniel Micay
fad10ce943
use FIFO queue for free slabs
2018-08-31 22:55:49 -04:00
Daniel Micay
3f80895822
ignore pad argument to malloc_trim per glibc
...
The pad argument is only used by the main arena for sbrk in glibc, with
every other page size gap purged with MADV_DONTNEED. It makes more sense
to simply treat it as an ignored legacy parameter rather than trying to
come up with a sensible way to use it for keeping cached free slabs.
2018-08-30 09:36:46 -04:00
Daniel Micay
1ea997b887
add missing headers to malloc.h
2018-08-30 08:48:43 -04:00
Daniel Micay
2b0f7aa985
use a consistent name for size class integer index
2018-08-30 07:13:28 -04:00
Daniel Micay
0f5f2bf6c9
add basic initial heuristic for freeing slabs
2018-08-30 06:56:00 -04:00
Daniel Micay
456dfe4154
add support for purging and protecting empty slabs
2018-08-30 05:59:44 -04:00
Daniel Micay
bb176e09bc
remove useless code in the empty_slabs path
2018-08-30 05:45:03 -04:00
Daniel Micay
29df2429c2
empty_slabs will remain a singly-linked list
2018-08-30 05:27:51 -04:00
Daniel Micay
f94068ea63
rename free_slabs to empty_slabs
2018-08-30 04:55:39 -04:00
Daniel Micay
b6d4af872f
move libdivide.h to third_party/libdivide.h
2018-08-30 03:03:19 -04:00
Daniel Micay
6f9de3e667
add inline hint to get_size_info
2018-08-29 15:13:53 -04:00
Daniel Micay
e85c69a0a4
fix builds with prefix
2018-08-29 15:07:36 -04:00
Daniel Micay
becadc57a5
get rid of unused MIN_ALIGN definition
2018-08-29 14:18:45 -04:00
Daniel Micay
2684a98eab
add initial malloc_object_size extensions
2018-08-29 14:18:42 -04:00
Daniel Micay
0e2f3d1015
sanity check page size at runtime
2018-08-29 11:00:18 -04:00
Daniel Micay
d779d41721
wrap more memory mapping implementation details
2018-08-29 10:57:42 -04:00
Daniel Micay
1cb28531a8
add wrapper for mremap with sanity check
2018-08-29 10:43:54 -04:00
Daniel Micay
5bc6820c24
rely on mmap rounding to page size when possible
2018-08-29 03:25:00 -04:00
Daniel Micay
58d929c0f0
split out low-level memory mapping wrappers
2018-08-29 00:53:38 -04:00
Daniel Micay
8b42e8c3d6
make sure errno is always set on failure
2018-08-28 22:49:11 -04:00
Daniel Micay
66aa98dbd9
sanity-check mmap errno on failure too
2018-08-28 22:41:18 -04:00
Daniel Micay
705b6a4f8d
make non-out-of-memory mprotect errors fatal
2018-08-28 22:22:57 -04:00
Daniel Micay
19c46d16f1
check pthread_atfork return value
2018-08-28 21:31:20 -04:00
Daniel Micay
803811a6ac
add support for using mremap
2018-08-28 10:44:04 -04:00
Daniel Micay
718bf82f96
add inline hints for slab_allocate and slab_free
2018-08-27 09:29:30 -04:00
Daniel Micay
33f862ec19
add inline hints for init and enforce_init
2018-08-27 09:29:27 -04:00
Daniel Micay
67b9608ccf
avoid duplicated init code calculating slab size
2018-08-27 09:22:04 -04:00
Daniel Micay
c7b24f63f1
use libdivide for substantially faster division
2018-08-27 07:07:48 -04:00
Daniel Micay
63b0c39343
reorder size_class struct for better performance
2018-08-27 05:21:58 -04:00
Daniel Micay
14ca7d7c3f
randomize large allocation guard size
2018-08-26 04:46:12 -04:00
Daniel Micay
a13a45a17d
hold regions_lock in alloc_aligned
2018-08-26 04:37:43 -04:00
Daniel Micay
2b7c9362bb
consume fewer random bytes for slab randomization
2018-08-25 18:32:44 -04:00
Daniel Micay
c5d76179a5
improve interaction of slot rand with slot mask
2018-08-25 18:04:55 -04:00
Daniel Micay
173dd6e7a5
randomize slot selection for empty slabs too
2018-08-25 18:02:13 -04:00
Daniel Micay
c335c43dd7
simplify slab out-of-memory error handling
2018-08-25 16:41:07 -04:00
Daniel Micay
7bcfa3f08b
tune slab metadata allocation
2018-08-25 15:46:22 -04:00
Daniel Micay
4777ee0c85
special case division for page size slabs
2018-08-25 15:21:50 -04:00
Daniel Micay
ec78add6ab
define ffzl utility function
2018-08-25 03:14:07 -04:00
Daniel Micay
f08d4d31db
randomize slab slot choice
2018-08-25 03:02:39 -04:00
Daniel Micay
965c3202b4
finish implementation of zero byte size class
2018-08-25 02:48:47 -04:00
Daniel Micay
f97a0ef8b1
use a more appropriate type for masked bitmaps
2018-08-25 01:09:15 -04:00
Daniel Micay
f3c8502509
add CSPRNGs for regions and slabs
2018-08-25 00:25:33 -04:00
Daniel Micay
805bdc6087
add an extra sanity check for unallocated metadata
2018-08-24 05:22:38 -04:00
Daniel Micay
2d168b0516
check for double free slightly earlier
2018-08-24 04:51:52 -04:00
Daniel Micay
97b693d862
stop treating guard size as a constant
2018-08-24 04:07:46 -04:00
Daniel Micay
83dabbd8fa
fix handling of random bases for class regions
2018-08-24 03:52:01 -04:00
Daniel Micay
0d51459dc9
add a special memory protected 0 byte size class
2018-08-24 03:24:23 -04:00
Daniel Micay
7a86b67778
add unaligned free check for small allocations
2018-08-24 02:55:53 -04:00
Daniel Micay
2aee424b7b
fix inconsistent whitespace
2018-08-24 02:09:20 -04:00
Daniel Micay
a874a61099
adjust slot count for 12288 byte size class
2018-08-23 18:00:13 -04:00
Daniel Micay
127f110126
adjust slot count for 10240 byte size class
2018-08-23 17:56:17 -04:00
Daniel Micay
c59c97c65b
adjust slot count for 48 byte size class
2018-08-23 17:53:10 -04:00
Daniel Micay
56e4c7e042
adjust slot count for 224 byte size class
2018-08-23 17:42:51 -04:00
Daniel Micay
4aa0fab4f4
avoid deadlocks after forking threaded processes
2018-08-23 17:22:12 -04:00
Daniel Micay
70d61b6662
initial commit
2018-08-23 15:42:41 -04:00