korg/linux
0
0
Fork 0
mirror of https://mirrors.bfsu.edu.cn/git/linux.git synced 2024-11-16 16:54:20 +08:00
Code Issues Packages Projects Releases Wiki Activity
1,215,407 Commits 112 Branches 5,274 Tags 4.8 GiB
4881fdb756
Commit Graph

47 Commits

Author SHA1 Message Date
Kent Overstreet
4881fdb756 bcachefs: initial gc no longer needs to touch every node 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:20 -04:00
Kent Overstreet
a1d58243f9 bcachefs: add ability to run gc on metadata only 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:20 -04:00
Kent Overstreet
cccf4e6df3 bcachefs: Convert gc errors to fsck errors 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:20 -04:00
Kent Overstreet
36e916e13b bcachefs: Caller now responsible for calling mark_key for gc 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:19 -04:00
Kent Overstreet
3a0e06db71 bcachefs: Assorted preemption fixes 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:19 -04:00
Kent Overstreet
ccaa61c9f6 bcachefs: fix initial gc 
Buckets weren't being marked as dirty

Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:19 -04:00
Kent Overstreet
05b3d5ac1f bcachefs: simplify gc locking a bit 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:19 -04:00
Kent Overstreet
424eb88130 bcachefs: Only get btree iters from btree transactions 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:18 -04:00
Kent Overstreet
8b2b9d11b9 bcachefs: Fix error handling in gc 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:18 -04:00
Kent Overstreet
6122ab639c bcachefs: More debug params for testing of recovery paths 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:18 -04:00
Kent Overstreet
28062d320b bcachefs: Fix gc handling of bucket gens 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:16 -04:00
Kent Overstreet
ecf37a4a80 bcachefs: fs_usage_u64s() 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:16 -04:00
Kent Overstreet
768ac63924 bcachefs: Add a mechanism for blocking the journal 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:16 -04:00
Kent Overstreet
8777210b92 bcachefs: refactor key marking code a bit 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:16 -04:00
Kent Overstreet
39fbc5a49f bcachefs: gc lock no longer needed for disk reservations 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:16 -04:00
Kent Overstreet
76f4c7b0c3 bcachefs: Fix oldest_gen handling 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:15 -04:00
Kent Overstreet
1df42b5715 bcachefs: don't do initial gc if have alloc info feature 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:15 -04:00
Kent Overstreet
42b72e0ba2 bcachefs: journal_replay_early() 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:15 -04:00
Kent Overstreet
61c8d7c8eb bcachefs: Persist stripe blocks_used 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:15 -04:00
Kent Overstreet
7ef2a73a58 bcachefs: Fix check for if extent update is allocating 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:14 -04:00
Kent Overstreet
23f80d2b3b bcachefs: Factor out acc_u64s() 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:14 -04:00
Kent Overstreet
06b7345cc2 bcachefs: Include summarized counts in fs_usage 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:13 -04:00
Kent Overstreet
9166b41db1 bcachefs: s/usage_lock/mark_lock 
better describes what it's for, and we're going to call a new lock
usage_lock

Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:13 -04:00
Kent Overstreet
8eb7f3ee46 bcachefs: move dirty into bucket_mark 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:12 -04:00
Kent Overstreet
90541a741d bcachefs: Add new alloc fields 
prep work for persistent alloc info

Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:12 -04:00
Kent Overstreet
f0cfb963ec bcachefs: Track nr_inodes with the key marking machinery 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:12 -04:00
Kent Overstreet
26609b619f bcachefs: Make bkey types globally unique 
this lets us get rid of a lot of extra switch statements - in a lot of
places we dispatch on the btree node type, and then the key type, so
this is a nice cleanup across a lot of code.

Also improve the on disk format versioning stuff.

Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:12 -04:00
Kent Overstreet
d034c09b26 bcachefs: return errors correctly from gc 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:12 -04:00
Kent Overstreet
eeb83e25bb bcachefs: Hold usage_lock over mark_key and fs_usage_apply 
Fixes an inconsistency at the end of gc

Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:12 -04:00
Kent Overstreet
dfe9bfb32e bcachefs: Stripes now properly subject to gc 
gc now verifies the contents of the stripes radix tree, important for
persistent alloc info

Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:12 -04:00
Kent Overstreet
ad7ae8d63f bcachefs: Btree locking fix, refactoring 
Hit an assertion, probably spurious, indicating an iterator was unlocked
when it shouldn't have been (spurious because it wasn't locked at all
when the caller called btree_insert_at()).

Add a flag, BTREE_ITER_NOUNLOCK, and tighten up the assertions

Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:12 -04:00
Kent Overstreet
9ca53b55f7 bcachefs: gc now operates on second set of bucket marks 
This means we can now use gc to verify the allocation information -
important for testing persistant alloc info

Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:12 -04:00
Kent Overstreet
cd575ddf57 bcachefs: Erasure coding 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:11 -04:00
Kent Overstreet
91f8b5677b bcachefs: More btree gc refactorings 
more prep work for erasure coding

Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:11 -04:00
Kent Overstreet
1d25849c2c bcachefs: Centralize marking of replicas in btree update path 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:11 -04:00
Kent Overstreet
47799326bc bcachefs: more key marking refactoring 
prep work for erasure coding

Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:10 -04:00
Kent Overstreet
103e212785 bcachefs: replicas: prep work for stripes 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:10 -04:00
Kent Overstreet
2252aa271c bcachefs: btree gc refactoring 
prep work for erasure coding

Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:10 -04:00
Kent Overstreet
ef337c54c6 bcachefs: Allocation code refactoring 
bch2_alloc_sectors_start() was a nightmare to work with - it's got some
tricky stuff to do, since it wants to use the buckets the writepoint
already has, unless they're not in the target it wants to write to,
unless it can't allocate from any other devices in which case it will
use those buckets if it has to - et cetera.

This restructures the code to start with a new empty list of open
buckets we're going to use for the new allocation, pulling buckets from
the write point's list as we decide that we really are going to use
them - making the code somewhat more functional and drastically easier
to understand.

Also fixes a bug where we could end up waiting on c->freelist_wait
(because allocating from one device failed) but return success from
bch2_bucket_alloc(), because allocating from a different device
succeeded.

Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:10 -04:00
Kent Overstreet
7b3f84ea7d bcachefs: Split out alloc_background.c 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:10 -04:00
Kent Overstreet
216c9facfd bcachefs: Pass around bset_tree less 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:09 -04:00
Kent Overstreet
271a3d3a4b bcachefs: lift ordering restriction on 0 size extents 
This lifts the restriction that 0 size extents must not overlap with
other extents, which means we can now sort extents and non extents the
same way, and will let us simplify a bunch of other stuff as well.

Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:09 -04:00
Kent Overstreet
5b650fd11a bcachefs: Account for internal fragmentation better 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:08 -04:00
Kent Overstreet
a7c7a3092e bcachefs: bch2_mark_key() now takes bch_data_type 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:08 -04:00
Kent Overstreet
b2be7c8b73 bcachefs: kill bucket mark sector count saturation 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:08 -04:00
Kent Overstreet
97446a242a bcachefs: Fix device add 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:07 -04:00
Kent Overstreet
1c6fdbd8f2 bcachefs: Initial commit 
Initially forked from drivers/md/bcache, bcachefs is a new copy-on-write
filesystem with every feature you could possibly want.

Website: https://bcachefs.org

Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:07 -04:00