Kubernetes: Difference between revisions

(7 intermediate revisions by 4 users not shown)

Line 1:

[https://kubernetes.io/ Kubernetes] is an open-source container orchestration system for automating software deployment, scaling, and management.

This wiki article extends the documentation in [https://nixos.org/manual/nixos/stable/#sec-kubernetes NixOS manual].

== [[wikipedia:en:KISS principle|KISS]] ==

Line 23:

Line 27:

Add to your <code>configuration.nix</code>:

{ config, pkgs, ... }:

let

# When using easyCerts=true the IP ~~Address~~ must resolve to the master on creation.

# When using 'easyCerts = true;', the IP address must resolve to the master at the time of creation.

# ~~So use simply~~ 127.0.0.1 ~~in that case~~. Otherwise you ~~will have errors like this~~ https://github.com/NixOS/nixpkgs/issues/59364

# In this case, set 'kubeMasterIP = "127.0.0.1";'. Otherwise, you may encounter the following issue: https://github.com/NixOS/nixpkgs/issues/59364.

kubeMasterIP = "10.1.1.2";

kubeMasterHostname = "api.kube";

Line 248:

Line 252:

* reboot all your nodes

* continue with [https://rook.io/docs/rook/v1.2/ceph-quickstart.html the official quickstart guide]

* in <code>operator.yaml</code>, ~~set <code>CSI_FORCE_CEPHFS_KERNEL_CLIENT<~~/~~code> to <code>false<~~/~~code>~~

* in <code>operator.yaml</code>, help the CSI plugins find the hosts' ceph kernel modules by adding (or uncommenting -- they're in the example config) these entries:

CSI_CEPHFS_PLUGIN_VOLUME: |

- name: lib-modules

hostPath:

path: /run/current-system/kernel-modules/lib/modules/

CSI_RBD_PLUGIN_VOLUME: |

- name: lib-modules

hostPath:

path: /run/current-system/kernel-modules/lib/modules/

=== NVIDIA ===

Line 324:

Line 336:

There are various community projects aimed at facilitating working with Kubernetes combined with Nix:

* [https://github.com/saschagrunert/kubernix kubernix]: simple setup of development clusters using Nix

* [https://github.com/cmollekopf/kube-nix kube-nix]

* [https://kubenix.org/ kubenix] - [https://github.com/hall/kubenix GitHub (updated 2023)]

* [https://github.com/justinas/nixos-ha-kubernetes nixos-ha-kubernetes]

* [https://github.com/nix-community/nixhelm nixhelm] - generates nix expressions from a selection of helm charts

* [https://github.com/reMarkable/helmfile-nix helmfile-nix] - wrapper around [[Helm and Helmfile|Helmfile]] to allow writing helmfiles in the nix language

== References ==

Line 338:

Line 351:

[[Category:Applications]]

[[Category:~~Servers~~]]

[[Category:Server]]

[[Category:~~orchestration~~]]

[[Category:Container]]

[[Category:NixOS Manual]]

@@ Line 1: / Line 1: @@
+[https://kubernetes.io/ Kubernetes] is an open-source container orchestration system for automating software deployment, scaling, and management.
+This wiki article extends the documentation in [https://nixos.org/manual/nixos/stable/#sec-kubernetes NixOS manual].
 == [[wikipedia:en:KISS principle|KISS]] ==
@@ Line 23: / Line 27: @@
 Add to your <code>configuration.nix</code>:
-<syntaxhighlight lang=nix>
+<syntaxhighlight lang="nix">
 { config, pkgs, ... }:
 let
-   # When using easyCerts=true the IP Address must resolve to the master on creation.
+   # When using 'easyCerts = true;', the IP address must resolve to the master at the time of creation.
- # So use simply 127.0.0.1 in that case. Otherwise you will have errors like this https://github.com/NixOS/nixpkgs/issues/59364
+  # In this case, set 'kubeMasterIP = "127.0.0.1";'. Otherwise, you may encounter the following issue: https://github.com/NixOS/nixpkgs/issues/59364.
    kubeMasterIP = "10.1.1.2";
    kubeMasterHostname = "api.kube";
@@ Line 248: / Line 252: @@
 * reboot all your nodes
 * continue with [https://rook.io/docs/rook/v1.2/ceph-quickstart.html the official quickstart guide]
-* in <code>operator.yaml</code>, set <code>CSI_FORCE_CEPHFS_KERNEL_CLIENT</code> to <code>false</code>
+* in <code>operator.yaml</code>, help the CSI plugins find the hosts' ceph kernel modules by adding (or uncommenting -- they're in the example config) these entries:
+  CSI_CEPHFS_PLUGIN_VOLUME: |
+  - name: lib-modules
+    hostPath:
+      path: /run/current-system/kernel-modules/lib/modules/
+  CSI_RBD_PLUGIN_VOLUME: |
+  - name: lib-modules
+    hostPath:
+      path: /run/current-system/kernel-modules/lib/modules/
 === NVIDIA ===
@@ Line 324: / Line 336: @@
 There are various community projects aimed at facilitating working with Kubernetes combined with Nix:
 * [https://github.com/saschagrunert/kubernix kubernix]: simple setup of development clusters using Nix
-* [https://github.com/cmollekopf/kube-nix kube-nix]
 * [https://kubenix.org/ kubenix] - [https://github.com/hall/kubenix GitHub (updated 2023)]
 * [https://github.com/justinas/nixos-ha-kubernetes nixos-ha-kubernetes]
+* [https://github.com/nix-community/nixhelm nixhelm] - generates nix expressions from a selection of helm charts
+* [https://github.com/reMarkable/helmfile-nix helmfile-nix] - wrapper around [[Helm and Helmfile|Helmfile]] to allow writing helmfiles in the nix language
 == References ==
@@ Line 338: / Line 351: @@
 [[Category:Applications]]
-[[Category:Servers]]
+[[Category:Server]]
-[[Category:orchestration]]
+[[Category:Container]]
+[[Category:NixOS Manual]]