Edit: wow, this is a never ending comment section!
TrueNAS SCALE as host with an Ubuntu LTS VM running Docker containers.
Original I went with only containers running on top of SCALE but both iX and TrueCharts made it harder to run plain Docker Compose on TrueNAS.
A few actually.
Rocky Linux 9, XCP-NG, Windows server 2022 datacenter
Different usecasses.
Currently I am using Arch Linux. I am in the process of switching to NixOS.
I still use Arch btw.
NixOS
Same here. I came for the integrated ZFS support and stayed for the declarative config.
how is nix better than debian for servers?
Declarative configuration of services and the rest of the entire system, and everything that brings with it.
- Want to test some new service, or make changes to an existing one, but don’t know if you want to keep it? Sure, just temporarily switch to the new configuration, you can always switch back to the old one and everything will be back as it was.
- Have multiple servers and want to share configuration between them? Absolutely, just import the same file from both. I have a git repo storing configurations for 10 machines and a huge part of it is shared configuration.
- Want to use one service’s endpoint (such as a socket path) in another? Sure, just use the socket path configuration option for the first service in the configuration for the second, such as here. This works since everything is a single tree of options which all the service configuration files are then generated from, so interpolate stuff as you wish.
- Checks for configuration correctness during build of the system (NixOS options are type checked during evaluation, and then during the actual system build there’s more checks, like nginx config has to succeed
nginx -t
, otherwise the system build fails and you can’t switch to it) - Want to spin up a VM to test changes before putting it on the actual target? There’s a builtin command (nixos-rebuild build-vm) that makes a script that starts a QEMU VM with your configuration running in it. It’s as fast as building the real system, so a couple seconds if you’re making small changes.
- Setting up services is also often as easy as putting
services.foo.enable = true;
in your configuration. And, if you remove that line, the service is gone, so you’re never left with “the random package or file you installed once to test something and has been forgotten about”. That’s the biggest thing it has over any kind of imperative solution IMO.
I feel like even if I want to distro hop again and end up putting something else on my desktop, NixOS is going to stay on my servers indefinitely. It’s pretty much a perfect fit for servers.
It isn’t, it’s just different. I use NixOS because of stupid easy rollbacks, which is great for experimenting in production, and its declarative nature, which is great in a server setting.
I just heard of NixOS for the first time because of this thread. Looked up some videos on it, and my jaw hit the fucking floor.
I really liked https://www.youtube.com/watch?v=AGVXJ-TIv3Y - step by step, with examples and great explanations. Warning: it’s long, but I watched it in one session.
My setup consists of the following:
Unraid, most services I self host run in docker here. Things like plex/jellyfin, nextcloud, unifi could controller.
Proxmox, used to virtualize my pfsense after I moved away from my unifi USG router. A few Linux and Debian headless virtual machines run here as well. Had pihole virtualized here as well but switched over to pfBlockerNG to consolidate.
TrueNAS, all my media shares. I also sync my desktop environments here to have a consistent windows desktop across my desktops and laptops.
Home assistant running on home assistant yellow. Runs a few add-on services.
Depends on what you want to do with it. But for most things Debian or Fedora (Server edition) work fine.
i hear bad things about it, how does fedora server compare to debian?
It’s much more up to date and in my experience works fine.
ArchlinuxARM, however it does not matter, given that everything I actually run, runs within Docker
Freebsd, but it would be openbsd if it had a better filesystem.
Debian for all things.
Debian all the way
Second that. I’m glad RPis are finally supported.
TrueNAS Scale
Hyper-V / ESXi for host. Mostly windows with some Ubuntu server.
Ubuntu, but I’m very strongly considering switching out to Debian or Rocky. Ubuntu has a lot of really unnecessary cruft that I think I’d be better off without.
I use Fedora on my laptop now, so going the RHEL/Rocky/Alma route for my servers is really tempting. Especially as I’m also considering switching to Podman.
NetBSD
Debian
3-Node ESXi cluster with 10 Debian VMs, 3 Windows VMs, and one FreeBSD VM