Kubernetes - Revision history

Zetsu: fix styling

2026-02-03T18:34:29Z

fix styling

← Older revision		Revision as of 18:34, 3 February 2026
Line 17:		Line 17:
	Caveats:		Caveats:

	* ~~this~~ was only tested on <code>20.09pre215024.e97dfe73bba (Nightingale)</code> (<code>unstable</code>)		* This was only tested on <code>20.09pre215024.e97dfe73bba (Nightingale)</code> (<code>unstable</code>)
	* ~~this~~ is probably not best-practice		* This is probably not best-practice
	** ~~for~~ a production-grade cluster you shouldn't use <code>easyCerts</code>		** For a production-grade cluster you shouldn't use <code>easyCerts</code>
	* If you experience inability to reach service CIDR from pods, disable firewall via <code>networking.firewall.enable = false;</code> or otherwise make sure that it doesn't interfere with packet forwarding.		* If you experience inability to reach service CIDR from pods, disable firewall via <code>networking.firewall.enable = false;</code> or otherwise make sure that it doesn't interfere with packet forwarding.
	* Make sure to set <code>docker0</code> in promiscuous mode <code>ip link set docker0 promisc on</code>		* Make sure to set <code>docker0</code> in promiscuous mode <code>ip link set docker0 promisc on</code>
Line 137:		Line 137:
	According to the [https://github.com/NixOS/nixpkgs/blob/18ff53d7656636aa440b2f73d2da788b785e6a9c/nixos/tests/kubernetes/rbac.nix#L118 NixOS tests], make your Node join the cluster:		According to the [https://github.com/NixOS/nixpkgs/blob/18ff53d7656636aa440b2f73d2da788b785e6a9c/nixos/tests/kubernetes/rbac.nix#L118 NixOS tests], make your Node join the cluster:

	on the master, grab the apitoken		On the master, grab the apitoken
	<syntaxhighlight lang=bash>		<syntaxhighlight lang=bash>
	cat /var/lib/kubernetes/secrets/apitoken.secret		cat /var/lib/kubernetes/secrets/apitoken.secret
	</syntaxhighlight>		</syntaxhighlight>

	on the node, join the node with		On the node, join the node with
	<syntaxhighlight lang=bash>		<syntaxhighlight lang=bash>
	echo TOKEN \| nixos-kubernetes-node-join		echo TOKEN \| nixos-kubernetes-node-join
Line 230:		Line 230:
	</syntaxhighlight>		</syntaxhighlight>

	=== ~~reset~~ to a clean state ===		=== Reset to a clean state ===

	Sometimes it helps to have a clean state on all instances:		Sometimes it helps to have a clean state on all instances:
Line 248:		Line 248:

	To do so, I found it necessary to change a few things (tested with <code>rook v1.2</code>):		To do so, I found it necessary to change a few things (tested with <code>rook v1.2</code>):
	* ~~you~~ need the <code>ceph</code> kernel module: <code>boot.kernelModules = [ "ceph" ];</code>		* You need the <code>ceph</code> kernel module: <code>boot.kernelModules = [ "ceph" ];</code>
	* ~~change~~ the root dir of the kubelet: <code>kubelet.extraOpts = "--root-dir=/var/lib/kubelet";</code>		* Change the root dir of the kubelet: <code>kubelet.extraOpts = "--root-dir=/var/lib/kubelet";</code>
	* ~~reboot~~ all your nodes		* Reboot all your nodes
	* ~~continue~~ with [https://rook.io/docs/rook/v1.2/ceph-quickstart.html the official quickstart guide]		* Continue with [https://rook.io/docs/rook/v1.2/ceph-quickstart.html the official quickstart guide]
	* in <code>operator.yaml</code>, help the CSI plugins find the hosts' ceph kernel modules by adding (or uncommenting -- they're in the example config) these entries:		* In <code>operator.yaml</code>, help the CSI plugins find the hosts' ceph kernel modules by adding (or uncommenting -- they're in the example config) these entries:
	CSI_CEPHFS_PLUGIN_VOLUME: \|		CSI_CEPHFS_PLUGIN_VOLUME: \|
	- name: lib-modules		- name: lib-modules
Line 336:		Line 336:
	There are various community projects aimed at facilitating working with Kubernetes combined with Nix:		There are various community projects aimed at facilitating working with Kubernetes combined with Nix:
	* [https://github.com/saschagrunert/kubernix kubernix]: simple setup of development clusters using Nix		* [https://github.com/saschagrunert/kubernix kubernix]: simple setup of development clusters using Nix
	* [https://kubenix.org/ kubenix] - [https://github.com/hall/kubenix GitHub (updated 2023)]		* [https://kubenix.org/ kubenix]: [https://github.com/hall/kubenix GitHub (updated 2023)]
	* [https://github.com/justinas/nixos-ha-kubernetes nixos-ha-kubernetes]		* [https://github.com/justinas/nixos-ha-kubernetes nixos-ha-kubernetes]
	* [https://github.com/nix-community/nixhelm nixhelm] - generates nix expressions from a selection of helm charts		* [https://github.com/nix-community/nixhelm nixhelm]: generates nix expressions from a selection of helm charts
	* [https://github.com/reMarkable/helmfile-nix helmfile-nix] - wrapper around [[Helm and Helmfile\|Helmfile]] to allow writing helmfiles in the nix language		* [https://github.com/reMarkable/helmfile-nix helmfile-nix]: wrapper around [[Helm and Helmfile\|Helmfile]] to allow writing helmfiles in the nix language

	== References ==		== References ==

	* [https://github.com/NixOS/nixpkgs/issues/39327 Issue #39327]: ~~kubernetes~~ support is missing some documentation		* [https://github.com/NixOS/nixpkgs/issues/39327 Issue #39327]: Kubernetes support is missing some documentation
	* [https://discourse.nixos.org/t/kubernetes-using-multiple-nodes-with-latest-unstable/3936 NixOS Discourse]: Using multiple nodes on unstable		* [https://discourse.nixos.org/t/kubernetes-using-multiple-nodes-with-latest-unstable/3936 NixOS Discourse]: Using multiple nodes on unstable
	* [https://kubernetes.io/docs/home/ Kubernetes docs]		* [https://kubernetes.io/docs/home/ Kubernetes docs]

Marcusramberg: Add more nix-based kubernetes tools

2025-08-23T15:18:40Z

Add more nix-based kubernetes tools

← Older revision		Revision as of 15:18, 23 August 2025
Line 338:		Line 338:
	* [https://kubenix.org/ kubenix] - [https://github.com/hall/kubenix GitHub (updated 2023)]		* [https://kubenix.org/ kubenix] - [https://github.com/hall/kubenix GitHub (updated 2023)]
	* [https://github.com/justinas/nixos-ha-kubernetes nixos-ha-kubernetes]		* [https://github.com/justinas/nixos-ha-kubernetes nixos-ha-kubernetes]
			* [https://github.com/nix-community/nixhelm nixhelm] - generates nix expressions from a selection of helm charts
			* [https://github.com/reMarkable/helmfile-nix helmfile-nix] - wrapper around [[Helm and Helmfile\|Helmfile]] to allow writing helmfiles in the nix language

	== References ==		== References ==

Alexandru Tocar: Reworded the warning comment about setting 'easyCerts = true;'.

2025-04-10T23:33:59Z

Reworded the warning comment about setting 'easyCerts = true;'.

← Older revision		Revision as of 23:33, 10 April 2025
Line 27:		Line 27:
	Add to your <code>configuration.nix</code>:		Add to your <code>configuration.nix</code>:

	<syntaxhighlight lang=nix>		<syntaxhighlight lang="nix">
	{ config, pkgs, ... }:		{ config, pkgs, ... }:
	let		let
	# When using easyCerts=true the IP ~~Address~~ must resolve to the master on creation.		# When using 'easyCerts = true;', the IP address must resolve to the master at the time of creation.
	# ~~So use simply~~ 127.0.0.1 ~~in that case~~. Otherwise you ~~will have errors like this~~ https://github.com/NixOS/nixpkgs/issues/59364		# In this case, set 'kubeMasterIP = "127.0.0.1";'. Otherwise, you may encounter the following issue: https://github.com/NixOS/nixpkgs/issues/59364.
	kubeMasterIP = "10.1.1.2";		kubeMasterIP = "10.1.1.2";
	kubeMasterHostname = "api.kube";		kubeMasterHostname = "api.kube";

Groulot: removed kube-nix which is unrelated to kubernetes but installs a kde groupware.

2024-05-18T11:03:29Z

removed kube-nix which is unrelated to kubernetes but installs a kde groupware.

← Older revision		Revision as of 11:03, 18 May 2024
Line 336:		Line 336:
	There are various community projects aimed at facilitating working with Kubernetes combined with Nix:		There are various community projects aimed at facilitating working with Kubernetes combined with Nix:
	* [https://github.com/saschagrunert/kubernix kubernix]: simple setup of development clusters using Nix		* [https://github.com/saschagrunert/kubernix kubernix]: simple setup of development clusters using Nix
	* [https://github.com/cmollekopf/kube-nix kube-nix]
	* [https://kubenix.org/ kubenix] - [https://github.com/hall/kubenix GitHub (updated 2023)]		* [https://kubenix.org/ kubenix] - [https://github.com/hall/kubenix GitHub (updated 2023)]
	* [https://github.com/justinas/nixos-ha-kubernetes nixos-ha-kubernetes]		* [https://github.com/justinas/nixos-ha-kubernetes nixos-ha-kubernetes]

Klinger: Category:NixOS Manual added

2024-05-15T18:06:13Z

Category:NixOS Manual added

← Older revision		Revision as of 18:06, 15 May 2024
Line 352:		Line 352:
	[[Category:Server]]		[[Category:Server]]
	[[Category:Container]]		[[Category:Container]]
			[[Category:NixOS Manual]]

Klinger: Link to manual added. Text at the beginning added (description and link)

2024-05-15T18:05:14Z

Link to manual added. Text at the beginning added (description and link)

← Older revision		Revision as of 18:05, 15 May 2024
Line 1:		Line 1:
			[https://kubernetes.io/ Kubernetes] is an open-source container orchestration system for automating software deployment, scaling, and management.

			This wiki article extends the documentation in [https://nixos.org/manual/nixos/stable/#sec-kubernetes NixOS manual].

	== [[wikipedia:en:KISS principle\|KISS]] ==		== [[wikipedia:en:KISS principle\|KISS]] ==

Klinger: Category:Applications Category:Server Category:Container

2024-04-19T21:08:29Z

Category:Applications Category:Server Category:Container

← Older revision		Revision as of 21:08, 19 April 2024
Line 347:		Line 347:
	[[Category:Applications]]		[[Category:Applications]]
	[[Category:Server]]		[[Category:Server]]
	[[Category:~~orchestration~~]]		[[Category:Container]]

Klinger at 20:54, 19 April 2024

2024-04-19T20:54:31Z

← Older revision		Revision as of 20:54, 19 April 2024
Line 346:		Line 346:

	[[Category:Applications]]		[[Category:Applications]]
	[[Category:~~Servers~~]]		[[Category:Server]]
	[[Category:orchestration]]		[[Category:orchestration]]

imported>Mcsaucy: Help the CSI plugins find the ceph kernel modules, rather than admit defeat and fall back to FUSE

2023-10-25T01:16:44Z

Help the CSI plugins find the ceph kernel modules, rather than admit defeat and fall back to FUSE

← Older revision		Revision as of 01:16, 25 October 2023
Line 248:		Line 248:
	* reboot all your nodes		* reboot all your nodes
	* continue with [https://rook.io/docs/rook/v1.2/ceph-quickstart.html the official quickstart guide]		* continue with [https://rook.io/docs/rook/v1.2/ceph-quickstart.html the official quickstart guide]
	* in <code>operator.yaml</code>, ~~set <code>CSI_FORCE_CEPHFS_KERNEL_CLIENT<~~/~~code> to <code>false<~~/~~code>~~		* in <code>operator.yaml</code>, help the CSI plugins find the hosts' ceph kernel modules by adding (or uncommenting -- they're in the example config) these entries:
			CSI_CEPHFS_PLUGIN_VOLUME: \|
			- name: lib-modules
			hostPath:
			path: /run/current-system/kernel-modules/lib/modules/
			CSI_RBD_PLUGIN_VOLUME: \|
			- name: lib-modules
			hostPath:
			path: /run/current-system/kernel-modules/lib/modules/

	=== NVIDIA ===		=== NVIDIA ===

imported>Peterbecich: /* Tooling */ nixos-ha-kubernetes

2023-09-05T00:04:10Z

Tooling: nixos-ha-kubernetes

← Older revision		Revision as of 00:04, 5 September 2023
Line 326:		Line 326:
	* [https://github.com/cmollekopf/kube-nix kube-nix]		* [https://github.com/cmollekopf/kube-nix kube-nix]
	* [https://kubenix.org/ kubenix] - [https://github.com/hall/kubenix GitHub (updated 2023)]		* [https://kubenix.org/ kubenix] - [https://github.com/hall/kubenix GitHub (updated 2023)]
			* [https://github.com/justinas/nixos-ha-kubernetes nixos-ha-kubernetes]

	== References ==		== References ==