Btrfs: Difference between revisions
replace manual bees with NixOS module |
m Polish text in →Top-level vs nested subvolumes |
||
(12 intermediate revisions by 7 users not shown) | |||
Line 3: | Line 3: | ||
{{note| Use [https://github.com/nix-community/disko/ disko] to manage your NixOS storage layout declaratively. The following shows a manual approach as seen in traditional Linux distributions.}} | {{note| Use [https://github.com/nix-community/disko/ disko] to manage your NixOS storage layout declaratively. The following shows a manual approach as seen in traditional Linux distributions.}} | ||
= Installation of NixOS on btrfs = | |||
{{note|The following example is for EFI enabled systems. Adjust commands accordingly for a BIOS installation.}} | {{note|The following example is for EFI enabled systems. Adjust commands accordingly for a BIOS installation.}} | ||
== Partition the disk == | |||
<syntaxhighlight lang="console"> | <syntaxhighlight lang="console"> | ||
# printf "label: gpt\n,550M,U\n,,L\n" | sfdisk /dev/sdX | # printf "label: gpt\n,550M,U\n,,L\n" | sfdisk /dev/sdX | ||
</syntaxhighlight> | </syntaxhighlight> | ||
== Format partitions and create subvolumes == | |||
<syntaxhighlight lang="console"> | <syntaxhighlight lang="console"> | ||
# nix-shell -p btrfs-progs | # nix-shell -p btrfs-progs | ||
Line 26: | Line 26: | ||
</syntaxhighlight> | </syntaxhighlight> | ||
== Mount the partitions and subvolumes == | |||
<syntaxhighlight lang="console"> | <syntaxhighlight lang="console"> | ||
# mount -o compress=zstd,subvol=root /dev/sdX2 /mnt | # mount -o compress=zstd,subvol=root /dev/sdX2 /mnt | ||
Line 37: | Line 37: | ||
</syntaxhighlight> | </syntaxhighlight> | ||
== Install NixOS == | |||
<syntaxhighlight lang="console"> | <syntaxhighlight lang="console"> | ||
# nixos-generate-config --root /mnt | # nixos-generate-config --root /mnt | ||
Line 44: | Line 44: | ||
</syntaxhighlight> | </syntaxhighlight> | ||
= Configuration = | |||
== Compression == | |||
<code>nixos-generate | <code>nixos-generate-config</code> doesn't detect mount options automatically. To enable compression, you must specify them manually and other mount options in your <code>configuration.nix</code>: | ||
< | {{file|/etc/nixos/configuration.nix|nix| | ||
<nowiki> | |||
fileSystems = { | fileSystems = { | ||
"/".options = [ "compress=zstd" ]; | "/".options = [ "compress=zstd" ]; | ||
Line 57: | Line 58: | ||
"/swap".options = [ "noatime" ]; | "/swap".options = [ "noatime" ]; | ||
}; | }; | ||
</ | </nowiki> | ||
}} | |||
Btrfs supports a few compression algorithms, each with different trade-offs: | |||
* <code>zstd</code>: Good compression ratio and performance, especially for general-purpose workloads. You can specify compression levels, as example <code>compress=zstd:3</code>. | |||
* <code>lzo</code>: Faster but provides lower compression ratios. Good for low powered systems or where performance is important. | |||
* <code>zlib</code>: Higher compression ratio but slower performance. Less commonly used nowadays in favor of zstd. | |||
You can find more details on the official [https://btrfs.readthedocs.io/en/latest/Compression.html Btrfs Compression Documentation]. | |||
{{note| Compression is applied only to newly written data. Existing data won't be compressed unless rewritten. (e.g., <code>btrfs filesystem defrag -r -v -czstd /path</code>)}} | |||
== Swap file == | |||
Creating a separate subvolume for the swap file is optional. It is not required for functionality but can help with organization or snapshot management. Be sure to regenerate your <code>hardware-configuration.nix</code> if you choose to do this. | |||
<syntaxhighlight lang="console"> | <syntaxhighlight lang="console"> | ||
# mkdir -p /mnt | # mkdir -p /mnt | ||
Line 69: | Line 84: | ||
# mkdir /swap | # mkdir /swap | ||
# mount -o noatime,subvol=swap /dev/sdXY /swap | # mount -o noatime,subvol=swap /dev/sdXY /swap | ||
# nixos-generate-config | |||
</syntaxhighlight> | </syntaxhighlight> | ||
Finally, define a swap file in your configuration and run <code>nixos-rebuild switch</code>: | |||
{{file|/etc/nixos/configuration.nix|nix| | |||
<nowiki> | |||
swapDevices = [{ | |||
device = "/swap/swapfile"; | |||
size = 8*1024; # Creates an 8GB swap file | |||
}]; | |||
</nowiki> | |||
}} | |||
< | NixOS will automatically create the swap file with the appropriate attributes for Btrfs including disabling copy on write. | ||
# btrfs filesystem mkswapfile | |||
</ | {{note| On systems where you do need to manually prepare a swap file on Btrfs, you can use <code>btrfs filesystem mkswapfile</code> utility, e.g.: <br><code># btrfs filesystem mkswapfile --uuid clear /swap/swapfile</code>}} | ||
For more NixOS swap configuration options, see [[Swap]]. Additonal Btrfs swapfile usage can be found at [https://btrfs.readthedocs.io/en/latest/Swapfile.html the Btrfs docs]. | |||
== Scrubbing == | |||
Btrfs | Btrfs filesystems by default keep checksums for all files, to monitor if the file has changed due to hardware malfunctions or other external effects. | ||
Scrubbing | Scrubbing is the process of checking file consistency, which may use checksums and/or duplicated copies of data, from raid for example. Scrubbing may be done "online", meaning you don't need to unmount a subvolume to scrub it. | ||
You can enable automatic scrubbing | You can enable automatic scrubbing withː | ||
<syntaxhighlight lang="nix"> | <syntaxhighlight lang="nix"> | ||
services.btrfs.autoScrub.enable = true; | services.btrfs.autoScrub.enable = true; | ||
</syntaxhighlight> | </syntaxhighlight> | ||
Automatic scrubbing by default is performed once a month, but you can change that | Automatic scrubbing by default is performed once a month, but you can change that withː | ||
<syntaxhighlight lang="nix"> | <syntaxhighlight lang="nix"> | ||
services.btrfs.autoScrub.interval = "weekly"; | services.btrfs.autoScrub.interval = "weekly"; | ||
Line 99: | Line 121: | ||
<code>interval</code> syntax is defined by [https://www.freedesktop.org/software/systemd/man/systemd.time.html#Calendar%20Events systemd.timer's Calendar Events] | <code>interval</code> syntax is defined by [https://www.freedesktop.org/software/systemd/man/systemd.time.html#Calendar%20Events systemd.timer's Calendar Events] | ||
By default, autoscrub will scrub all detected btrfs mount points. However, in case of mounted nested subvolumes ( | By default, autoscrub will scrub all detected btrfs mount points. However, in case of mounted nested subvolumes (e.g. the example above where <code>/nix</code> and <code>/home</code> are nested subvolumes under <code>/</code>), you only need to scrub the topmost one. So an example configuration may look like this: | ||
<syntaxhighlight lang="nix"> | <syntaxhighlight lang="nix"> | ||
services.btrfs.autoScrub = { | services.btrfs.autoScrub = { | ||
Line 108: | Line 130: | ||
</syntaxhighlight> | </syntaxhighlight> | ||
The result of periodic auto scrub will be | The result of the periodic auto scrub will be saved to the system journal, and you can check the status of the last scrubː | ||
<syntaxhighlight lang="bash"> | <syntaxhighlight lang="bash"> | ||
btrfs scrub status / | btrfs scrub status / | ||
</syntaxhighlight> | </syntaxhighlight> | ||
You can also start a | You can also start a scrub in the background manuallyː | ||
<syntaxhighlight lang="bash"> | <syntaxhighlight lang="bash"> | ||
btrfs scrub start / | btrfs scrub start / | ||
</syntaxhighlight> | </syntaxhighlight> | ||
You can check the status of the ongoing scrubbing process with the same <code>status</code> command | You can check the status of the ongoing scrubbing process with the same <code>status</code> command as above. | ||
== Deduplication == | |||
Files with (partially) equal contents can be deduplicated using [https://github.com/Zygo/bees bees] or [https://github.com/markfasheh/duperemove duperemove]. The [https://btrfs.readthedocs.io/en/latest/Deduplication.html upstream wiki entry] on deduplication provides an overview of available features of these programs. | |||
bees can be configured in <code>configuration.nix</code>: | bees can be configured in <code>configuration.nix</code>: | ||
Line 137: | Line 159: | ||
This will run the daemon in the background. To disable auto-start, use <code>systemd.services."beesd@root".wantedBy = lib.mkForce [ ];</code> for each filesystem. | This will run the daemon in the background. To disable auto-start, use <code>systemd.services."beesd@root".wantedBy = lib.mkForce [ ];</code> for each filesystem. | ||
== | = Usage = | ||
== Subvolumes == | |||
To display all subvolumes within a mounted btrfs filesystem: | |||
= | <syntaxhighlight lang="bash"> | ||
btrfs subvolume list -t /mnt | |||
</syntaxhighlight> | |||
To create a new subvolume at a specified location: | |||
<syntaxhighlight lang="bash"> | <syntaxhighlight lang="bash"> | ||
Line 147: | Line 175: | ||
</syntaxhighlight> | </syntaxhighlight> | ||
To remove an existing subvolume: | |||
<syntaxhighlight lang="bash"> | <syntaxhighlight lang="bash"> | ||
Line 153: | Line 181: | ||
</syntaxhighlight> | </syntaxhighlight> | ||
=== | === Top-level vs nested subvolumes === | ||
In btrfs, subvolumes can be created either at the top level of the filesystem or within other subvolumes. | |||
* Top-level subvolumes are created directly under the filesystem's root. By default, the root volume ID is 5. Top-level subvolumes are easier to snapshot, roll back or destroy independently. This is good for things such as <code>/home</code> or <code>/nix</code>. | |||
For | * Nested subvolumes are created inside an existing subvolume or directory within the filesystem. All nested subvolumes inherit the mount status of their parent unless mounted separately. This layout is useful for organizing related subvolumes under a common namespace. For example, a top-level subvolume such as <code>/srv/nfs</code> can contain multiple nested subvolumes like <code>/srv/nfs/export1</code> and <code>/srv/nfs/export2</code>. | ||
== Snapshots == | |||
A snapshot in btrfs is simply a subvolume that shares its data (and metadata) with some other subvolume, using btrfs's CoW capabilities. Because of that, there is no special location for snapshots and you can decide where you want to store them. It can be a simple directory inside the root subvolume, or a directory inside a dedicated "snapshots" subvolume. | |||
For this example we are going to store snapshots in a directory <code>/snapshots</code>, that has to be created beforehand with <code>sudo mkdir /snapshots</code> | |||
To take a read-only (<code>-r</code>) snapshot called <code>home_snapshot_202302</code> of the subvolume mounted at <code>/home</code> | |||
<syntaxhighlight lang="bash"> | <syntaxhighlight lang="bash"> | ||
Line 167: | Line 203: | ||
</syntaxhighlight> | </syntaxhighlight> | ||
You can also snapshot the root subvolume. But keep in mind | You can also snapshot the root subvolume. But keep in mind that nested subvolumes are '''not''' part of a snapshot. So if you have subvolumes <code>/nix /home</code>, taking a snapshot of <code>/</code> will not include them. | ||
<syntaxhighlight lang="bash"> | <syntaxhighlight lang="bash"> | ||
Line 173: | Line 209: | ||
</syntaxhighlight> | </syntaxhighlight> | ||
Make snapshot read-write | Make snapshot read-write againː | ||
<syntaxhighlight lang="bash"> | <syntaxhighlight lang="bash"> | ||
Line 179: | Line 215: | ||
</syntaxhighlight> | </syntaxhighlight> | ||
However, changing read-only property of a snapshot in-place may [//lore.kernel.org/linux-btrfs/06e92a0b-e71b-eb21-edb5-9d2a5513b718@gmail.com/ causes issues] with any future incremental send/receive. | However, changing read-only property of a snapshot in-place may [//lore.kernel.org/linux-btrfs/06e92a0b-e71b-eb21-edb5-9d2a5513b718@gmail.com/ causes issues] with any future incremental send/receive. Instead, a read-only snapshot itself (being a simple subvolume) can be snapshotted again as a read-write snapshot like this:<syntaxhighlight lang="bash"> | ||
Instead, a read-only snapshot itself (being a simple subvolume) can be | |||
<syntaxhighlight lang="bash"> | |||
btrfs subvolume snapshot /snapshots/home_snapshot_202302 /snapshots/home_snapshot_202302_rw | btrfs subvolume snapshot /snapshots/home_snapshot_202302 /snapshots/home_snapshot_202302_rw | ||
</syntaxhighlight> | </syntaxhighlight> | ||
Or it can be restored directly to <code>/home</code> straight away like this: | Or it can be restored directly to <code>/home</code> straight away like this: | ||
{{warning|1=this will delete current <code>/home</code> and restore the snapshot! <code>/home</code> must be unmounted for this operation}} | {{warning|1=this will delete the current <code>/home</code> and restore the snapshot! <code>/home</code> must be unmounted for this operation}} | ||
<syntaxhighlight lang="bash"> | <syntaxhighlight lang="bash"> | ||
Line 193: | Line 226: | ||
btrfs subvolume snapshot /snapshots/home_snapshot_202302 /home | btrfs subvolume snapshot /snapshots/home_snapshot_202302 /home | ||
</syntaxhighlight> | </syntaxhighlight> | ||
After this you can mount <code>/home</code> again. | After this you can mount <code>/home</code> again. | ||
== Transfer snapshot == | |||
Sending the snapshot <code>/snapshots/nixos_snapshot_202302</code> compressed to a remote host via ssh at <code>root@192.168.178.110</code> and saving it to a subvolume mounted | Sending the snapshot <code>/snapshots/nixos_snapshot_202302</code> compressed to a remote host via ssh at <code>root@192.168.178.110</code> and saving it to a subvolume mounted on a directory at <code>/mnt/nixos</code> | ||
<syntaxhighlight lang="bash"> | <syntaxhighlight lang="bash"> | ||
Line 204: | Line 236: | ||
</syntaxhighlight> | </syntaxhighlight> | ||
If both the sender and receiver side have Btrfs with the same compression algorithm and level, you can instead use <code>send --compressed-data</code> to avoid decompressing and recompressing the data. | |||
= Tips and tricks = | |||
== Backup == | |||
[[Btrbk]] is a tool for creating snapshots and remote backups of btrfs subvolumes. | |||
== Installation with encryption == | |||
Using [https://en.wikipedia.org/wiki/Linux_Unified_Key_Setup Luks2]: | Using [https://en.wikipedia.org/wiki/Linux_Unified_Key_Setup Luks2]: | ||
<syntaxhighlight lang="bash"> | <syntaxhighlight lang="bash"> | ||
Line 214: | Line 253: | ||
</syntaxhighlight> | </syntaxhighlight> | ||
You can use any device | You can use any device partition for your bootloader. Note that this bootloader is unencrypted by default: | ||
<code> | <code>mkfs.vfat -n BOOT "$DISK"p1</code> | ||
mkfs.vfat -n BOOT "$DISK"p1 | |||
</code> | |||
=== Creating subvolumes === | |||
<syntaxhighlight lang="bash"> | <syntaxhighlight lang="bash"> | ||
Line 240: | Line 277: | ||
Unmount to mount on the subvolumes for the next steps: | Unmount to mount on the subvolumes for the next steps: | ||
<code> | <code>umount /mnt</code> | ||
umount /mnt | |||
</code> | |||
Once the subvolumes | Once the subvolumes have been created, mount them with the desired options. | ||
Example with [https://facebook.github.io/zstd/ | |||
Example with [https://facebook.github.io/zstd/ Zstandard compression] and noatime: | |||
<syntaxhighlight lang="bash"> | <syntaxhighlight lang="bash"> | ||
mount -o subvol=root,compress=zstd,noatime /dev/mapper/enc /mnt | mount -o subvol=root,compress=zstd,noatime /dev/mapper/enc /mnt | ||
Line 287: | Line 323: | ||
</syntaxhighlight > | </syntaxhighlight > | ||
== Convert Ext3/Ext4 system partition to Btrfs == | |||
{{Warning|Note that migrating your existing root filesystem can cause data loss or make your system unbootable. Make sure to backup the partition or your files. Proceed only if you know what you're doing!}} | |||
To convert the existing filesystem (Ext3/4) to Btrfs, boot into a NixOS live system and run following | To convert the existing filesystem (Ext3/4) to Btrfs, boot into a NixOS live system and run the following commandː<syntaxhighlight lang="sh"> | ||
fsck -f /dev/sdXY | fsck -f /dev/sdXY | ||
btrfs-convert /dev/sdXY | btrfs-convert /dev/sdXY | ||
</syntaxhighlight>Replace the device path with the target partition. Converting larger filesystems can take a long time. | </syntaxhighlight>Replace the device path with the target partition. Converting larger filesystems can take a long time. | ||
Next, mount the converted filesystem and chroot into | Next, mount the converted filesystem and chroot into itː<syntaxhighlight lang="sh"> | ||
mount /dev/sdXY /mnt | mount /dev/sdXY /mnt | ||
nixos-enter --root /mnt | nixos-enter --root /mnt | ||
Line 310: | Line 343: | ||
</syntaxhighlight>Apply the changes<syntaxhighlight lang="sh"> | </syntaxhighlight>Apply the changes<syntaxhighlight lang="sh"> | ||
nixos-rebuild boot | nixos-rebuild boot | ||
</syntaxhighlight> | </syntaxhighlight>If the Grub bootloader is used and it doesn't get reinstalled correctly, you can run the following command inside chrootː<syntaxhighlight lang="sh"> | ||
grub-install /dev/sdX | grub-install /dev/sdX | ||
</syntaxhighlight>If the conversion | </syntaxhighlight>If the conversion was successful and no rollback is required, the backup image which was stored by btrfs-convert can be removed withː<syntaxhighlight lang="sh"> | ||
btrfs subvolume delete /btrfs/ext2_saved | btrfs subvolume delete /btrfs/ext2_saved | ||
</syntaxhighlight> | </syntaxhighlight> | ||
=== TRIM support === | |||
{{main|Filesystems#SSD TRIM support}} | |||
Refer to [https://btrfs.readthedocs.io/en/latest/Trim.html btrfs docs] on how Trim works with btrfs through the <code>discard</code> mount option. | |||
[[Category: Configuration]] | [[Category: Configuration]] | ||
[[Category:Filesystem]] | [[Category:Filesystem]] |