CUDA - Revision history

Ullika: Remove nowiki tags

2026-01-05T08:07:56Z

Remove nowiki tags

← Older revision		Revision as of 08:07, 5 January 2026
Line 62:		Line 62:
	<syntaxhighlight lang="nix" line="1" start="1">		<syntaxhighlight lang="nix" line="1" start="1">
	# flake.nix, run with `nix develop`# Run with `nix-shell cuda-shell.nix`		# flake.nix, run with `nix develop`# Run with `nix-shell cuda-shell.nix`
	{ pkgs ? import ~~</nowiki>~~<nixpkgs~~><nowiki~~> {} }:		{ pkgs ? import <nixpkgs> {} }:
	let		let
	nvidiaPackage = pkgs.linuxPackages.nvidiaPackages.stable;		nvidiaPackage = pkgs.linuxPackages.nvidiaPackages.stable;

Perchun: Replace nix-community binary cache with cache.nixos-cuda.org

2025-11-19T10:14:49Z

Replace nix-community binary cache with cache.nixos-cuda.org

← Older revision		Revision as of 10:14, 19 November 2025
Line 1:		Line 1:
	NixOS supports using NVIDIA GPUs for pure computing purposes, not just for graphics. For example, many users rely on NixOS for machine learning both locally and on cloud instances. These use cases are supported by the [https://github.com/orgs/NixOS/teams/cuda-maintainers @NixOS/cuda-maintainers team] on GitHub ([https://github.com/orgs/NixOS/projects/27 project board]). If you have an issue using your NVIDIA GPU for computing purposes [https://github.com/NixOS/nixpkgs/issues/new/choose open an issue] on GitHub and tag <code>@NixOS/cuda-maintainers</code>.		NixOS supports using NVIDIA GPUs for pure computing purposes, not just for graphics. For example, many users rely on NixOS for machine learning both locally and on cloud instances. These use cases are supported by the [https://github.com/orgs/NixOS/teams/cuda-maintainers @NixOS/cuda-maintainers team] on GitHub ([https://github.com/orgs/NixOS/projects/27 project board]). If you have an issue using your NVIDIA GPU for computing purposes [https://github.com/NixOS/nixpkgs/issues/new/choose open an issue] on GitHub and tag <code>@NixOS/cuda-maintainers</code>.

	{{tip\|1='''Cache''': Using the ~~[https://app.cachix.org/~~cache~~/nix-community nix-community cache]~~ is recommended! It will save you valuable time and electrons~~. Getting set up should be as simple as <code>cachix use nix-community</code>~~. Click [[#Setting up CUDA Binary Cache\|here]] for more details.}}		{{tip\|1='''Cache''': Using the binary cache is recommended! It will save you valuable time and electrons. Click [[#Setting up CUDA Binary Cache\|here]] for more details.}}

	{{tip\|1='''Data center GPUs''': Note that you may need to adjust your driver version to use "data center" GPUs like V100/A100s. See [https://discourse.nixos.org/t/how-to-use-nvidia-v100-a100-gpus/17754 this thread] for more info.}}		{{tip\|1='''Data center GPUs''': Note that you may need to adjust your driver version to use "data center" GPUs like V100/A100s. See [https://discourse.nixos.org/t/how-to-use-nvidia-v100-a100-gpus/17754 this thread] for more info.}}
Line 144:		Line 144:
	== Setting up CUDA Binary Cache ==		== Setting up CUDA Binary Cache ==

	The ~~[https://nix-community.org/~~cache~~/ Nix-community cache]~~ contains pre-built CUDA packages. By adding it to your system, Nix will fetch these packages instead of building them, saving valuable time and processing power.		The binary cache contains pre-built CUDA packages. By adding it to your system, Nix will fetch these packages instead of building them, saving valuable time and processing power.

	For more information, refer to the [[Binary Cache#Using a binary cache Using a binary cache\|Using a binary cache]] page.		For more information, refer to the [[Binary Cache#Using a binary cache Using a binary cache\|Using a binary cache]] page.
Line 153:		Line 153:
	Add the cache to <code>substituters</code> and <code>trusted-public-keys</code> inside your system configuration:		Add the cache to <code>substituters</code> and <code>trusted-public-keys</code> inside your system configuration:

	{{file\|~~/etc/nixos/configuration.nix\|nix\|~~<nowiki>		{{file\|3=<nowiki>
	nix.settings = {		nix.settings = {
	substituters = [		substituters = [
	"https://~~nix~~-~~community.cachix~~.org"		"https://cache.nixos-cuda.org"
	];		];
	trusted-public-keys = [		trusted-public-keys = [
	"~~nix~~-~~community.cachix~~.org-1:~~mB9FSh9qf2dCimDSUo8Zy7bkq5CX+/rkCWyvRCYg3Fs~~="		"cache.nixos-cuda.org:74DUi4Ye579gUqzH4ziL9IyiJBlDpMRn9MBN8oNan9M="
	];		];
	};		};
	</nowiki>}}		</nowiki>\|name=/etc/nixos/configuration.nix\|lang=nix}}

	=== Non-NixOS ===		=== Non-NixOS ===

	~~If you~~ have ~~[https:~~//~~www~~.~~cachix.org cachix] installed and set up, all you need to do is run~~:		You have to add <code>substituters</code> and <code>trusted-public-keys</code> to <code>/etc/nix/nix.conf</code>:

	~~<syntaxHighlight lang="console">~~		{{file\|3=<nowiki>
	~~$ cachix use nix-community~~		trusted-public-keys = cache.nixos-cuda.org:74DUi4Ye579gUqzH4ziL9IyiJBlDpMRn9MBN8oNan9M=
	~~</syntaxHighlight>~~		trusted-substituters = https://cache.nixos-cuda.org

	~~Else, you have to add <code>substituters</code> and <code>trusted-public-keys</code> to <code>/etc/nix/nix.conf</code>:~~

	{{file\|~~/etc/nix/nix.conf\|nix\|~~<nowiki>
	trusted-public-keys = ~~nix~~-~~community.cachix~~.org-1:~~mB9FSh9qf2dCimDSUo8Zy7bkq5CX+/rkCWyvRCYg3Fs~~=
	trusted-substituters = https://~~nix~~-~~community.cachix~~.org
	trusted-users = root @wheel		trusted-users = root @wheel
	</nowiki>}}		</nowiki>\|name=/etc/nix/nix.conf\|lang=nix}}

	If your user is in <code>trusted-users</code>, you can also add the cache in your home directory:		If your user is in <code>trusted-users</code>, you can also add the cache in your home directory:

	{{file\|~~~/.config/nix/nix.conf\|nix\|~~<nowiki>		{{file\|3=<nowiki>
	substituters = https://~~nix~~-~~community.cachix~~.org		trusted-public-keys = cache.nixos-cuda.org:74DUi4Ye579gUqzH4ziL9IyiJBlDpMRn9MBN8oNan9M=
	</nowiki>}}		trusted-substituters = https://cache.nixos-cuda.org
			</nowiki>\|name=~/.config/nix/nix.conf\|lang=nix}}

	== Some things to keep in mind when setting up CUDA in NixOS ==		== Some things to keep in mind when setting up CUDA in NixOS ==

Aos at 07:21, 16 November 2025

2025-11-16T07:21:12Z

← Older revision		Revision as of 07:21, 16 November 2025
Line 19:		Line 19:
	<syntaxhighlight lang="nix" line="1" start="1"># flake.nix, run with `nix develop`		<syntaxhighlight lang="nix" line="1" start="1"># flake.nix, run with `nix develop`
	# Run with `nix-shell cuda-fhs.nix`		# Run with `nix-shell cuda-fhs.nix`
	{ pkgs ? import ~~<nowiki>~~<nixpkgs~~></nowiki~~> {} }:		{ pkgs ? import <nixpkgs> {} }:
	let		let
	# Change according to the driver used: stable, beta		# Change according to the driver used: stable, beta

Aos at 07:20, 16 November 2025

2025-11-16T07:20:26Z

← Older revision		Revision as of 07:20, 16 November 2025
Line 19:		Line 19:
	<syntaxhighlight lang="nix" line="1" start="1"># flake.nix, run with `nix develop`		<syntaxhighlight lang="nix" line="1" start="1"># flake.nix, run with `nix develop`
	# Run with `nix-shell cuda-fhs.nix`		# Run with `nix-shell cuda-fhs.nix`
	{ pkgs ? import </nowiki><nixpkgs><nowiki> {} }:		{ pkgs ? import <nowiki><nixpkgs></nowiki> {} }:
	let		let
	# Change according to the driver used: stable, beta		# Change according to the driver used: stable, beta

Bachp at 21:06, 24 June 2025

2025-06-24T21:06:32Z

← Older revision		Revision as of 21:06, 24 June 2025
Line 17:		Line 17:
	* By making a FHS user env		* By making a FHS user env

	~~{{file\|\|\|3~~=# Run with `nix-shell cuda-fhs.nix`		<syntaxhighlight lang="nix" line="1" start="1"># flake.nix, run with `nix develop`
			# Run with `nix-shell cuda-fhs.nix`
	{ pkgs ? import </nowiki><nixpkgs><nowiki> {} }:		{ pkgs ? import </nowiki><nixpkgs><nowiki> {} }:
	let		let
Line 54:		Line 55:
	export EXTRA_CCFLAGS="-I/usr/include"		export EXTRA_CCFLAGS="-I/usr/include"
	'';		'';
	}).env~~\|name=cuda-fhs.nix\|lang=nix}}~~		}).env
			</syntaxhighlight>


	* By making a nix-shell		* By making a nix-shell
	~~{{file\|\|\|3~~=# Run with `nix-shell cuda-shell.nix`		<syntaxhighlight lang="nix" line="1" start="1">
			# flake.nix, run with `nix develop`# Run with `nix-shell cuda-shell.nix`
	{ pkgs ? import </nowiki><nixpkgs><nowiki> {} }:		{ pkgs ? import </nowiki><nixpkgs><nowiki> {} }:
	let		let
Line 80:		Line 83:
	export EXTRA_CCFLAGS="-I/usr/include"		export EXTRA_CCFLAGS="-I/usr/include"
	'';		'';
	}~~\|name=cuda-shell.nix\|lang=nix}}~~		}
			</syntaxhighlight>

	* By making a flake.nix<syntaxhighlight lang="nix" line="1" start="1"># flake.nix, run with `nix develop`		* By making a flake.nix
			<syntaxhighlight lang="nix" line="1" start="1"># flake.nix, run with `nix develop`
	{		{
	description = "CUDA development environment";		description = "CUDA development environment";

Bachp: Document selection of nvidia driver

2025-06-24T21:02:36Z

Document selection of nvidia driver

← Older revision		Revision as of 21:02, 24 June 2025
Line 17:		Line 17:
	* By making a FHS user env		* By making a FHS user env

	{{file\|~~cuda-fhs.nix~~\|~~nix~~\|~~<nowiki>~~		{{file\|\|\|3=# Run with `nix-shell cuda-fhs.nix`
	# Run with `nix-shell cuda-fhs.nix`
	{ pkgs ? import </nowiki><nixpkgs><nowiki> {} }:		{ pkgs ? import </nowiki><nixpkgs><nowiki> {} }:
			let
			# Change according to the driver used: stable, beta
			nvidiaPackage = pkgs.linuxPackages.nvidiaPackages.stable;
			in
	(pkgs.buildFHSEnv {		(pkgs.buildFHSEnv {
	name = "cuda-env";		name = "cuda-env";
Line 35:		Line 38:
	unzip		unzip
	cudatoolkit		cudatoolkit
	~~linuxPackages.nvidia_x11~~		nvidiaPackage
	libGLU libGL		libGLU libGL
	xorg.libXi xorg.libXmu freeglut		xorg.libXi xorg.libXmu freeglut
Line 47:		Line 50:
	profile = ''		profile = ''
	export CUDA_PATH=${pkgs.cudatoolkit}		export CUDA_PATH=${pkgs.cudatoolkit}
	# export LD_LIBRARY_PATH=${~~pkgs.linuxPackages.nvidia_x11~~}/lib		# export LD_LIBRARY_PATH=${nvidiaPackage}/lib
	export EXTRA_LDFLAGS="-L/lib -L${~~pkgs.linuxPackages.nvidia_x11~~}/lib"		export EXTRA_LDFLAGS="-L/lib -L${nvidiaPackage}/lib"
	export EXTRA_CCFLAGS="-I/usr/include"		export EXTRA_CCFLAGS="-I/usr/include"
	'';		'';
	}).env		}).env\|name=cuda-fhs.nix\|lang=nix}}
	~~</nowiki>~~}}


	* By making a nix-shell		* By making a nix-shell
	{{file\|~~cuda-shell.nix~~\|~~nix~~\|~~<nowiki>~~		{{file\|\|\|3=# Run with `nix-shell cuda-shell.nix`
	# Run with `nix-shell cuda-shell.nix`
	{ pkgs ? import </nowiki><nixpkgs><nowiki> {} }:		{ pkgs ? import </nowiki><nixpkgs><nowiki> {} }:
			let
			nvidiaPackage = pkgs.linuxPackages.nvidiaPackages.stable;
			in
	pkgs.mkShell {		pkgs.mkShell {
	name = "cuda-env-shell";		name = "cuda-env-shell";
Line 64:		Line 68:
	git gitRepo gnupg autoconf curl		git gitRepo gnupg autoconf curl
	procps gnumake util-linux m4 gperf unzip		procps gnumake util-linux m4 gperf unzip
	cudatoolkit ~~linuxPackages.nvidia_x11~~		cudatoolkit nvidiaPackage
	libGLU libGL		libGLU libGL
	xorg.libXi xorg.libXmu freeglut		xorg.libXi xorg.libXmu freeglut
Line 72:		Line 76:
	shellHook = ''		shellHook = ''
	export CUDA_PATH=${pkgs.cudatoolkit}		export CUDA_PATH=${pkgs.cudatoolkit}
	# export LD_LIBRARY_PATH=${~~pkgs.linuxPackages.nvidia_x11~~}/lib:${pkgs.~~ncurses5~~}/lib		# export LD_LIBRARY_PATH=${nvidiaPackage}/lib:${pkgs.ncurses}/lib
	export EXTRA_LDFLAGS="-L/lib -L${~~pkgs.linuxPackages.nvidia_x11~~}/lib"		export EXTRA_LDFLAGS="-L/lib -L${nvidiaPackage}/lib"
	export EXTRA_CCFLAGS="-I/usr/include"		export EXTRA_CCFLAGS="-I/usr/include"
	'';		'';
	}		}\|name=cuda-shell.nix\|lang=nix}}
	~~</nowiki>~~}}

	* By making a flake.nix<syntaxhighlight lang="nix" line="1" start="1">		* By making a flake.nix<syntaxhighlight lang="nix" line="1" start="1"># flake.nix, run with `nix develop`
	# flake.nix, run with `nix develop`
	{		{
	description = "CUDA development environment";		description = "CUDA development environment";
Line 94:		Line 96:
	config.cudaVersion = "12";		config.cudaVersion = "12";
	};		};
			# Change according to the driver used: stable, beta
			nvidiaPackage = pkgs.linuxPackages.nvidiaPackages.stable;
	in {		in {
	# alejandra is a nix formatter with a beautiful output		# alejandra is a nix formatter with a beautiful output
Line 103:		Line 107:
	cudaPackages.cuda_cudart		cudaPackages.cuda_cudart
	cudatoolkit		cudatoolkit
	~~linuxPackages.nvidia_x11~~		nvidiaPackage
	cudaPackages.cudnn		cudaPackages.cudnn
	libGLU		libGLU
Line 115:		Line 119:
	xorg.libXrandr		xorg.libXrandr
	zlib		zlib
	~~ncurses5~~		ncurses
	stdenv.cc		stdenv.cc
	binutils		binutils
Line 122:		Line 126:

	shellHook = ''		shellHook = ''
	export LD_LIBRARY_PATH="${~~pkgs.linuxPackages.nvidia_x11~~}/lib:$LD_LIBRARY_PATH"		export LD_LIBRARY_PATH="${nvidiaPackage}/lib:$LD_LIBRARY_PATH"
	export CUDA_PATH=${pkgs.cudatoolkit}		export CUDA_PATH=${pkgs.cudatoolkit}
	export EXTRA_LDFLAGS="-L/lib -L${~~pkgs.linuxPackages.nvidia_x11~~}/lib"		export EXTRA_LDFLAGS="-L/lib -L${nvidiaPackage}/lib"
	export EXTRA_CCFLAGS="-I/usr/include"		export EXTRA_CCFLAGS="-I/usr/include"
	export CMAKE_PREFIX_PATH="${pkgs.fmt.dev}:$CMAKE_PREFIX_PATH"		export CMAKE_PREFIX_PATH="${pkgs.fmt.dev}:$CMAKE_PREFIX_PATH"
Line 131:		Line 135:
	};		};
	};		};
	}		}</syntaxhighlight>
	</syntaxhighlight>

	== Setting up CUDA Binary Cache ==		== Setting up CUDA Binary Cache ==

DoggoBit: /* cudatoolkit, cudnn, and related packages */

2025-06-07T22:29:27Z

cudatoolkit, cudnn, and related packages

← Older revision		Revision as of 22:29, 7 June 2025
Line 6:		Line 6:

	== <code>cudatoolkit</code>, <code>cudnn</code>, and related packages ==		== <code>cudatoolkit</code>, <code>cudnn</code>, and related packages ==
			{{outdated\|scope=section\|date=July 2024\|reason=Note that these examples have been updated more recently (as of 2024-07-30). May not be the best solution. A better resource is likely the packaging CUDA sample code [https://github.com/NixOS/nixpkgs/tree/master/pkgs/development/cuda-modules/cutensor here].}}
	The CUDA toolkit is available in a [https://search.nixos.org/packages?channel=unstable&from=0&size=50&buckets=%7B%22package_attr_set%22%3A%5B%22cudaPackages%22%5D%2C%22package_license_set%22%3A%5B%5D%2C%22package_maintainers_set%22%3A%5B%5D%2C%22package_platforms%22%3A%5B%5D%7D&sort=relevance&type=packages&query=cudatoolkit number of different versions]. Please use the latest major version. You can see where they're defined in nixpkgs [https://github.com/NixOS/nixpkgs/blob/master/pkgs/development/cuda-modules/cudatoolkit/releases.nix here].		The CUDA toolkit is available in a [https://search.nixos.org/packages?channel=unstable&from=0&size=50&buckets=%7B%22package_attr_set%22%3A%5B%22cudaPackages%22%5D%2C%22package_license_set%22%3A%5B%5D%2C%22package_maintainers_set%22%3A%5B%5D%2C%22package_platforms%22%3A%5B%5D%7D&sort=relevance&type=packages&query=cudatoolkit number of different versions]. Please use the latest major version. You can see where they're defined in nixpkgs [https://github.com/NixOS/nixpkgs/blob/master/pkgs/development/cuda-modules/cudatoolkit/releases.nix here].

Line 12:		Line 12:
	* cuDNN is packaged [https://github.com/NixOS/nixpkgs/tree/master/pkgs/development/cuda-modules/cudnn here].		* cuDNN is packaged [https://github.com/NixOS/nixpkgs/tree/master/pkgs/development/cuda-modules/cudnn here].
	* cuTENSOR is packaged [https://github.com/NixOS/nixpkgs/tree/master/pkgs/development/cuda-modules/cutensor here].		* cuTENSOR is packaged [https://github.com/NixOS/nixpkgs/tree/master/pkgs/development/cuda-modules/cutensor here].

	{{warning\|1=Note that these examples have been updated more recently (as of 2024-07-30). May not be the best solution. A better resource is likely the packaging CUDA sample code [https://github.com/NixOS/nixpkgs/tree/master/pkgs/development/cuda-modules/cutensor here].}}

	There are some possible ways to setup a development environment using CUDA on NixOS. This can be accomplished in the following ways:		There are some possible ways to setup a development environment using CUDA on NixOS. This can be accomplished in the following ways:

Bachp: Update fhs example to fix warning: evaluation warning: 'buildFHSUserEnv' has been renamed to 'buildFHSEnv' and will be removed in 25.11

2025-06-06T22:01:57Z

Update fhs example to fix warning: evaluation warning: 'buildFHSUserEnv' has been renamed to 'buildFHSEnv' and will be removed in 25.11

← Older revision		Revision as of 22:01, 6 June 2025
Line 22:		Line 22:
	# Run with `nix-shell cuda-fhs.nix`		# Run with `nix-shell cuda-fhs.nix`
	{ pkgs ? import </nowiki><nixpkgs><nowiki> {} }:		{ pkgs ? import </nowiki><nixpkgs><nowiki> {} }:
	(pkgs.~~buildFHSUserEnv~~ {		(pkgs.buildFHSEnv {
	name = "cuda-env";		name = "cuda-env";
	targetPkgs = pkgs: with pkgs; [		targetPkgs = pkgs: with pkgs; [

VitalyR: add instructions using nix flake to set up CUDA development environment

2025-05-12T17:48:40Z

add instructions using nix flake to set up CUDA development environment

@@ Line 80: / Line 80: @@
+}
 </nowiki>}}
 == Setting up CUDA Binary Cache ==

Pbsds: Improve cuda team github links

2025-02-27T10:38:40Z

Improve cuda team github links

← Older revision		Revision as of 10:38, 27 February 2025
Line 1:		Line 1:
	NixOS supports using NVIDIA GPUs for pure computing purposes, not just for graphics. For example, many users rely on NixOS for machine learning both locally and on cloud instances. These use cases are supported by the [https://github.com/orgs/NixOS/~~projects~~/27 @NixOS/cuda-maintainers team] on GitHub. If you have an issue using your NVIDIA GPU for computing purposes [https://github.com/~~nixos~~/nixpkgs/issues/new open an issue] on GitHub and tag @NixOS/cuda-maintainers.		NixOS supports using NVIDIA GPUs for pure computing purposes, not just for graphics. For example, many users rely on NixOS for machine learning both locally and on cloud instances. These use cases are supported by the [https://github.com/orgs/NixOS/teams/cuda-maintainers @NixOS/cuda-maintainers team] on GitHub ([https://github.com/orgs/NixOS/projects/27 project board]). If you have an issue using your NVIDIA GPU for computing purposes [https://github.com/NixOS/nixpkgs/issues/new/choose open an issue] on GitHub and tag <code>@NixOS/cuda-maintainers</code>.

	{{tip\|1='''Cache''': Using the [https://app.cachix.org/cache/nix-community nix-community cache] is recommended! It will save you valuable time and electrons. Getting set up should be as simple as <code>cachix use nix-community</code>. Click [[#Setting up CUDA Binary Cache\|here]] for more details.}}		{{tip\|1='''Cache''': Using the [https://app.cachix.org/cache/nix-community nix-community cache] is recommended! It will save you valuable time and electrons. Getting set up should be as simple as <code>cachix use nix-community</code>. Click [[#Setting up CUDA Binary Cache\|here]] for more details.}}