Commit Graph

138 Commits

Author SHA1 Message Date
Daniel Micay
82314f4471 make get_size_info straightforward for zero size 2018-09-11 14:51:36 -04:00
Daniel Micay
7a404ddbf2 optimize size calculation for 16 byte spaced sizes 2018-09-11 14:46:44 -04:00
Daniel Micay
2d6ad18aa4 make function naming a bit more consistent 2018-09-11 14:18:13 -04:00
Daniel Micay
684291bf6a avoid overhead of init check for slab deallocation 2018-09-11 14:13:43 -04:00
Daniel Micay
ef098fea06 simplify init function 2018-09-11 14:12:27 -04:00
Daniel Micay
61684925e8 fix overly naive slab allocation alignment support 2018-09-10 19:01:11 -04:00
Daniel Micay
9a1acce5eb optimize calloc when zero on free is disabled 2018-09-07 16:33:28 -04:00
Daniel Micay
7ae7abedea mark more unlikely code paths 2018-09-07 02:53:15 -04:00
Daniel Micay
49af83a817 wrap mutex type to enable future optimization 2018-09-07 01:13:08 -04:00
Daniel Micay
fc2473e7ee add configuration for canaries 2018-09-07 00:35:08 -04:00
Daniel Micay
96c538d90f add configuration for zero on free 2018-09-07 00:33:51 -04:00
Daniel Micay
ba3a8b0058 add slot randomization to configuration header 2018-09-07 00:25:02 -04:00
Daniel Micay
bed303a76f remove unnecessary else branch 2018-09-07 00:22:51 -04:00
Daniel Micay
d398384b90 add header for configuration 2018-09-07 00:17:31 -04:00
Daniel Micay
99d68238d2 implement slab allocation write-after-free check 2018-09-07 00:00:32 -04:00
Daniel Micay
684e63a878 handle pthread_atfork calling into malloc
This results in compatibility with the malloc replacement support added
in musl 1.1.20.
2018-09-06 19:48:00 -04:00
Daniel Micay
1be74ec40d add initial guard slabs implementation 2018-09-06 18:55:24 -04:00
Daniel Micay
cc1e79fdba abstract metadata allocation to allow guard slabs 2018-09-06 18:45:41 -04:00
Daniel Micay
d8e18e0011 aligned_alloc is now the same as BSD memalign
The resolution to DR 460 (which is explicitly included in C17) removed
the requirement for the size to be a multiple of the alignment.
2018-09-06 16:30:22 -04:00
Daniel Micay
0d3c2e1988 no need for a dedicated init rng 2018-09-06 16:02:25 -04:00
Daniel Micay
8624201f06 refresh canary value when allocating free slabs 2018-09-06 15:07:01 -04:00
Daniel Micay
a875951e82 fix build with musl 2018-09-06 14:35:08 -04:00
Daniel Micay
e891b40588 implement Android malloc_disable/malloc_enable API 2018-09-06 14:17:23 -04:00
Daniel Micay
3a532b17dc implement in-place shrinking for large allocations 2018-09-05 07:37:26 -04:00
Daniel Micay
645209dcbf remove unnecessary debugging code 2018-09-05 03:42:05 -04:00
Daniel Micay
9ddd53d56c implement initial slab allocation canaries 2018-09-04 09:29:35 -04:00
Daniel Micay
1a7b8079d0 reuse is_init when possible 2018-09-02 19:58:57 -04:00
Daniel Micay
7733047c7b trigger early initialization in a conservative way 2018-09-02 19:52:12 -04:00
Daniel Micay
7e088dc870 add stubs for Android extensions 2018-09-02 05:08:45 -04:00
Daniel Micay
e4648192c0 split out code for managing page spans 2018-09-02 02:03:39 -04:00
Daniel Micay
e93d039214 only use reserved memory for regions hash table 2018-09-01 10:23:06 -04:00
Daniel Micay
c3a4829d77 remove unnecessary special case from realloc 2018-09-01 02:42:33 -04:00
Daniel Micay
f441dfe2e3 align size class metadata to cacheline size 2018-08-31 23:10:26 -04:00
Daniel Micay
fad10ce943 use FIFO queue for free slabs 2018-08-31 22:55:49 -04:00
Daniel Micay
3f80895822 ignore pad argument to malloc_trim per glibc
The pad argument is only used by the main arena for sbrk in glibc, with
every other page size gap purged with MADV_DONTNEED. It makes more sense
to simply treat it as an ignored legacy parameter rather than trying to
come up with a sensible way to use it for keeping cached free slabs.
2018-08-30 09:36:46 -04:00
Daniel Micay
1ea997b887 add missing headers to malloc.h 2018-08-30 08:48:43 -04:00
Daniel Micay
2b0f7aa985 use a consistent name for size class integer index 2018-08-30 07:13:28 -04:00
Daniel Micay
0f5f2bf6c9 add basic initial heuristic for freeing slabs 2018-08-30 06:56:00 -04:00
Daniel Micay
456dfe4154 add support for purging and protecting empty slabs 2018-08-30 05:59:44 -04:00
Daniel Micay
bb176e09bc remove useless code in the empty_slabs path 2018-08-30 05:45:03 -04:00
Daniel Micay
29df2429c2 empty_slabs will remain a singly-linked list 2018-08-30 05:27:51 -04:00
Daniel Micay
f94068ea63 rename free_slabs to empty_slabs 2018-08-30 04:55:39 -04:00
Daniel Micay
b6d4af872f move libdivide.h to third_party/libdivide.h 2018-08-30 03:03:19 -04:00
Daniel Micay
6f9de3e667 add inline hint to get_size_info 2018-08-29 15:13:53 -04:00
Daniel Micay
e85c69a0a4 fix builds with prefix 2018-08-29 15:07:36 -04:00
Daniel Micay
becadc57a5 get rid of unused MIN_ALIGN definition 2018-08-29 14:18:45 -04:00
Daniel Micay
2684a98eab add initial malloc_object_size extensions 2018-08-29 14:18:42 -04:00
Daniel Micay
0e2f3d1015 sanity check page size at runtime 2018-08-29 11:00:18 -04:00
Daniel Micay
d779d41721 wrap more memory mapping implementation details 2018-08-29 10:57:42 -04:00
Daniel Micay
1cb28531a8 add wrapper for mremap with sanity check 2018-08-29 10:43:54 -04:00
Daniel Micay
5bc6820c24 rely on mmap rounding to page size when possible 2018-08-29 03:25:00 -04:00
Daniel Micay
58d929c0f0 split out low-level memory mapping wrappers 2018-08-29 00:53:38 -04:00
Daniel Micay
8b42e8c3d6 make sure errno is always set on failure 2018-08-28 22:49:11 -04:00
Daniel Micay
66aa98dbd9 sanity-check mmap errno on failure too 2018-08-28 22:41:18 -04:00
Daniel Micay
705b6a4f8d make non-out-of-memory mprotect errors fatal 2018-08-28 22:22:57 -04:00
Daniel Micay
19c46d16f1 check pthread_atfork return value 2018-08-28 21:31:20 -04:00
Daniel Micay
803811a6ac add support for using mremap 2018-08-28 10:44:04 -04:00
Daniel Micay
718bf82f96 add inline hints for slab_allocate and slab_free 2018-08-27 09:29:30 -04:00
Daniel Micay
33f862ec19 add inline hints for init and enforce_init 2018-08-27 09:29:27 -04:00
Daniel Micay
67b9608ccf avoid duplicated init code calculating slab size 2018-08-27 09:22:04 -04:00
Daniel Micay
c7b24f63f1 use libdivide for substantially faster division 2018-08-27 07:07:48 -04:00
Daniel Micay
63b0c39343 reorder size_class struct for better performance 2018-08-27 05:21:58 -04:00
Daniel Micay
14ca7d7c3f randomize large allocation guard size 2018-08-26 04:46:12 -04:00
Daniel Micay
a13a45a17d hold regions_lock in alloc_aligned 2018-08-26 04:37:43 -04:00
Daniel Micay
2b7c9362bb consume fewer random bytes for slab randomization 2018-08-25 18:32:44 -04:00
Daniel Micay
c5d76179a5 improve interaction of slot rand with slot mask 2018-08-25 18:04:55 -04:00
Daniel Micay
173dd6e7a5 randomize slot selection for empty slabs too 2018-08-25 18:02:13 -04:00
Daniel Micay
c335c43dd7 simplify slab out-of-memory error handling 2018-08-25 16:41:07 -04:00
Daniel Micay
7bcfa3f08b tune slab metadata allocation 2018-08-25 15:46:22 -04:00
Daniel Micay
4777ee0c85 special case division for page size slabs 2018-08-25 15:21:50 -04:00
Daniel Micay
ec78add6ab define ffzl utility function 2018-08-25 03:14:07 -04:00
Daniel Micay
f08d4d31db randomize slab slot choice 2018-08-25 03:02:39 -04:00
Daniel Micay
965c3202b4 finish implementation of zero byte size class 2018-08-25 02:48:47 -04:00
Daniel Micay
f97a0ef8b1 use a more appropriate type for masked bitmaps 2018-08-25 01:09:15 -04:00
Daniel Micay
f3c8502509 add CSPRNGs for regions and slabs 2018-08-25 00:25:33 -04:00
Daniel Micay
805bdc6087 add an extra sanity check for unallocated metadata 2018-08-24 05:22:38 -04:00
Daniel Micay
2d168b0516 check for double free slightly earlier 2018-08-24 04:51:52 -04:00
Daniel Micay
97b693d862 stop treating guard size as a constant 2018-08-24 04:07:46 -04:00
Daniel Micay
83dabbd8fa fix handling of random bases for class regions 2018-08-24 03:52:01 -04:00
Daniel Micay
0d51459dc9 add a special memory protected 0 byte size class 2018-08-24 03:24:23 -04:00
Daniel Micay
7a86b67778 add unaligned free check for small allocations 2018-08-24 02:55:53 -04:00
Daniel Micay
2aee424b7b fix inconsistent whitespace 2018-08-24 02:09:20 -04:00
Daniel Micay
a874a61099 adjust slot count for 12288 byte size class 2018-08-23 18:00:13 -04:00
Daniel Micay
127f110126 adjust slot count for 10240 byte size class 2018-08-23 17:56:17 -04:00
Daniel Micay
c59c97c65b adjust slot count for 48 byte size class 2018-08-23 17:53:10 -04:00
Daniel Micay
56e4c7e042 adjust slot count for 224 byte size class 2018-08-23 17:42:51 -04:00
Daniel Micay
4aa0fab4f4 avoid deadlocks after forking threaded processes 2018-08-23 17:22:12 -04:00
Daniel Micay
70d61b6662 initial commit 2018-08-23 15:42:41 -04:00