ca30b5db2b
Introduce hpdata_t.
...
Using an edata_t both for hugepages and the allocations within those hugepages
was convenient at first, but has outlived its usefulness. Representing
hugepages explicitly, with their own data structure, will make future
development easier.
2020-12-07 06:21:08 -08:00
43af63fff4
HPA: Manage whole hugepages at a time.
...
This redesigns the HPA implementation to allow us to manage hugepages all at
once, locally, without relying on a global fallback.
2020-12-07 06:21:08 -08:00
cf2549a149
Add a per-arena oversize_threshold.
...
This can let manual arenas trade off memory and CPU the way auto arenas do.
2020-11-13 13:45:35 -08:00
589638182a
Use the edata_cache_small_t in the HPA.
2020-11-05 12:34:43 -08:00
c9757d9e3b
HPA: Don't disable shards that were never started.
2020-11-05 12:34:43 -08:00
6599651aee
PA: Use an SEC in fron of the HPA shard.
2020-10-23 11:14:34 -07:00
534504d4a7
HPA: add size-exclusion functionality.
...
I.e. only allowing allocations under or over certain sizes.
2020-10-23 11:14:34 -07:00
bf025d2ec8
HPA: Make slab sizes and maxes configurable.
...
This allows easy experimentation with them as tuning parameters.
2020-10-23 11:14:34 -07:00
1c7da33317
HPA: Tie components into a PAI implementation.
2020-10-23 11:14:34 -07:00
6107857b7b
PA->PAC: Move in PAI implementation.
2020-07-09 13:41:04 -07:00
6041aaba97
PA -> PAC: Move in destruction functions.
2020-07-09 13:41:04 -07:00
471eb5913c
PAC: Move in decay rate setting.
2020-07-09 13:41:04 -07:00
6a2774719f
PA->PAC: Move in decay functions.
2020-07-09 13:41:04 -07:00
4ee75be3a3
PA -> PAC: Move in decay_purge enum.
2020-07-09 13:41:04 -07:00
72435b0aba
PA->PAC: Make extent.c forget about PA.
2020-07-09 13:41:04 -07:00
dee5d1c42d
PA->PAC: Move in extent_sn.
2020-07-09 13:41:04 -07:00
7391382349
PA->PAC: Move in stats.
2020-07-09 13:41:04 -07:00
db211eefbf
PAC: Move in decay.
2020-07-09 13:41:04 -07:00
c81e389996
PAC: Move in ecache_grow.
2020-07-09 13:41:04 -07:00
65803171a7
PAC: move in emap
2020-07-09 13:41:04 -07:00
7efcb946c4
PAC: Add an init function.
2020-07-09 13:41:04 -07:00
722652222a
PAC: Move in edata_cache accesses.
2020-07-09 13:41:04 -07:00
777b0ba965
Add PAC: Page allocator classic.
...
For now, this is just a stub containing the ecaches, with no surrounding code
changed. Eventually all the core allocator bits will be moved in, in the
subsequent stack of commits.
2020-07-09 13:41:04 -07:00
1b5f632e0f
Introduce PAI: Page allocator interface
2020-07-09 13:41:04 -07:00
392f645f4d
Edata: split up different list linkage uses.
2020-07-08 13:20:59 -07:00
50289750b3
Extent: Remove szind/slab knowledge.
2020-04-10 13:12:47 -07:00
93b99dd140
Extent: Stop passing an edata_cache everywhere.
...
We already pass the pa_shard_t around everywhere; we can just use that.
2020-04-10 13:12:47 -07:00
11c47cb133
Extent: Take "bool zero" over "bool *zero".
2020-04-10 13:12:47 -07:00
1a1124462e
PA: Take zero as a bool rather than as a bool *.
...
Now that we've moved junking to a higher level of the allocation stack, we don't
care about this performance optimization (which only occurred in debug modes).
2020-04-10 13:12:47 -07:00
294b276fc7
PA: Parameterize emap. Move emap_global to arena.
...
This lets us test the PA module without interfering with the global emap used by
the real allocator (the one not under test).
2020-04-10 13:12:47 -07:00
dfef0df71a
Emap: Move edata modification out of emap_remap.
2020-04-10 13:12:47 -07:00
faec7219b2
PA: Move in decay initialization.
2020-04-10 13:12:47 -07:00
45671e4a27
PA: Move in retain growth limit setting.
2020-04-10 13:12:47 -07:00
07675840a5
PA: Move in some more internals accesses.
2020-04-10 13:12:47 -07:00
81c6027592
Arena stats: Give it its own "mapped".
...
This distinguishes it from the PA mapped stat, which is now named "pa_mapped" to
avoid confusion. The (derived) arena stat includes base memory, and the PA stat
is no longer partially derived.
2020-04-10 13:12:47 -07:00
e2cf3fb1a3
PA: Move in all modifications of mapped.
2020-04-10 13:12:47 -07:00
436789ad96
PA: Make mapped stat atomic.
...
We always have atomic_zu_t, and mapped/unmapped transitions are always expensive
enough that trying to piggyback on a lock is a waste of time.
2020-04-10 13:12:47 -07:00
3c28aa6f17
PA: Move edata_avail stat in, make it non-atomic.
2020-04-10 13:12:47 -07:00
527dd4cdb8
PA: Move in nactive counter.
2020-04-10 13:12:47 -07:00
c075fd0bcb
PA: Minor cleanups and comment fixes.
2020-04-10 13:12:47 -07:00
46a9d7fc0b
PA: Move in rest of purging.
2020-04-10 13:12:47 -07:00
2d6eec7b5c
PA: Move in decay-all pathway.
2020-04-10 13:12:47 -07:00
65698b7f2e
PA: Remove public visibility of some internals.
2020-04-10 13:12:47 -07:00
f012c43be0
PA: Move in decay_to_limit
2020-04-10 13:12:47 -07:00
3034f4a508
PA: Move in decay_stashed.
2020-04-10 13:12:47 -07:00
aef28b2f8f
PA: Move in stash_decayed.
2020-04-10 13:12:47 -07:00
71fc0dc968
PA: Move in remaining page allocation functions.
2020-04-10 13:12:47 -07:00
74958567a4
PA: have expand take sizes instead of new usize.
...
This avoids involving usize, which makes some of the stats modifications more
intuitively correct.
2020-04-10 13:12:47 -07:00
5bcc2c2ab9
PA: Have expand take szind and slab.
...
This isn't really necessary, but having a uniform API will help us later.
2020-04-10 13:12:47 -07:00
0880c2ab97
PA: Have large expands use it.
2020-04-10 13:12:47 -07:00
David Goldblatt