Shell scripts: Difference between revisions
m →See also: add Nix-shell shebang to the list |
m capitalize sentences |
||
| (One intermediate revision by the same user not shown) | |||
| Line 1: | Line 1: | ||
The package <code>writeShellScript</code> can be used to add shell scripts to nix expressions | |||
<syntaxHighlight lang="nix"> | <syntaxHighlight lang="nix"> | ||
someBuildHelper = { name, sha256 }: | |||
stdenv.mkDerivation { | |||
inherit name; | |||
outputHashMode = "recursive"; | |||
outputHashAlgo = "sha256"; | |||
outputHash = sha256; | |||
builder = writeShellScript "builder.sh" '' | |||
echo "hi, my name is ''${0}" # escape bash variable | |||
echo "hi, my hash is ${sha256}" # use nix variable | |||
echo "hello world" >output.txt | |||
''; | |||
}; | |||
</syntaxHighlight> | </syntaxHighlight> | ||
| Line 20: | Line 20: | ||
Longer bash scripts are usually stored as external script files, and called from Nix: | Longer bash scripts are usually stored as external script files, and called from Nix: | ||
{{file|default.nix|nix|3= | |||
{ | { | ||
outputTxtDrv = stdenv.mkDerivation rec { | outputTxtDrv = stdenv.mkDerivation rec { | ||
| Line 36: | Line 35: | ||
}; | }; | ||
} | } | ||
}} | |||
{{file|builder.sh|sh|3= | |||
echo "$someString $(echo "$someJson" | jq -r '.dst') $someNumber" >$out | echo "$someString $(echo "$someJson" | jq -r '.dst') $someNumber" >$out | ||
}} | |||
See also | See also | ||
| Line 52: | Line 50: | ||
Instead of <code>stdenv.mkDerivation</code>, we can also use <code>runCommand</code> to call an external bash script: | Instead of <code>stdenv.mkDerivation</code>, we can also use <code>runCommand</code> to call an external bash script: | ||
{{file|default.nix|nix|3= | |||
{ | { | ||
outputTxtDrv = runCommand "output.txt" { | outputTxtDrv = runCommand "output.txt" { | ||
| Line 63: | Line 60: | ||
} (builtins.readFile ./builder.sh); | } (builtins.readFile ./builder.sh); | ||
} | } | ||
}} | |||
== Packaging == | == Packaging == | ||
Example: | |||
<syntaxHighlight lang="nix"> | <syntaxHighlight lang="nix"> | ||
| Line 104: | Line 101: | ||
=== Command not found === | === Command not found === | ||
For example, the script throws the error <code>svn: command not found</code>, because the dependency <code>subversion</code> is missing. | |||
When a command is missing, you can use <code>nix-locate</code> to find the package name. for example, the <code>stat</code> command: | |||
<syntaxHighlight lang="console"> | <syntaxHighlight lang="console"> | ||
$ nix-locate bin/stat | grep 'bin/stat$' | $ nix-locate bin/stat | grep 'bin/stat$' | ||
coreutils.out | coreutils.out 0 s /nix/store/vr96j3cxj75xsczl8pzrgsv1k57hcxyp-coreutils-8.31/bin/stat | ||
</syntaxHighlight> | </syntaxHighlight> | ||
| Line 119: | Line 116: | ||
To trace commands and line numbers, we can use | To trace commands and line numbers, we can use | ||
{{file|test-trace.nix|nix|3= | |||
{ runCommand, coreutils }: | { runCommand, coreutils }: | ||
runCommand "output.txt" { nativeBuildInputs = [ coreutils ]; } '' | |||
# line 5 in nix file = line 1 in bash script -> offset 4 | |||
PS4='+ Line $(expr $LINENO + 4): ' | |||
set -o xtrace # print commands | |||
echo hello >$out # line 9 in nix file | |||
set +o xtrace # hide commands | |||
'' | |||
}} | |||
<syntaxHighlight lang="console"> | <syntaxHighlight lang="console"> | ||
| Line 147: | Line 142: | ||
== Posix Shell == | == Posix Shell == | ||
Some environments (like OpenWRT, via <code>busybox</code>) offer only a "limited" shell (<code>sh</code> instead of <code>bash</code>). | |||
On NixOS, posix shells are provided by the packages <code>dash</code> and <code>posh</code>. | |||
== See also == | == See also == | ||
Latest revision as of 18:37, 19 July 2026
The package writeShellScript can be used to add shell scripts to nix expressions
someBuildHelper = { name, sha256 }:
stdenv.mkDerivation {
inherit name;
outputHashMode = "recursive";
outputHashAlgo = "sha256";
outputHash = sha256;
builder = writeShellScript "builder.sh" ''
echo "hi, my name is ''${0}" # escape bash variable
echo "hi, my hash is ${sha256}" # use nix variable
echo "hello world" >output.txt
'';
};
External builder.sh script
Longer bash scripts are usually stored as external script files, and called from Nix:
{
outputTxtDrv = stdenv.mkDerivation rec {
name = "output.txt";
# disable unpackPhase etc
phases = "buildPhase";
builder = ./builder.sh;
nativeBuildInputs = [ coreutils jq ];
PATH = lib.makeBinPath nativeBuildInputs;
# only strings can be passed to builder
someString = "hello";
someNumber = builtins.toString 42;
someJson = builtins.toJSON { dst = "world"; };
};
}
jq -r '.dst') $someNumber" >$out
See also
runCommand + builder.sh
Instead of stdenv.mkDerivation, we can also use runCommand to call an external bash script:
{
outputTxtDrv = runCommand "output.txt" {
nativeBuildInputs = [ coreutils jq ];
# only strings can be passed to builder
someString = "hello";
someNumber = builtins.toString 42;
someJson = builtins.toJSON { dst = "world"; };
} (builtins.readFile ./builder.sh);
}
Packaging
Example:
# nix-build -E 'with import <nixpkgs> { }; callPackage ./default.nix { }'
{ stdenv
, lib
, fetchFromGitHub
, bash
, subversion
, makeWrapper
}:
stdenv.mkDerivation {
pname = "github-downloader";
version = "08049f6";
src = fetchFromGitHub {
# https://github.com/Decad/github-downloader
owner = "Decad";
repo = "github-downloader";
rev = "08049f6183e559a9a97b1d144c070a36118cca97";
sha256 = "073jkky5svrb7hmbx3ycgzpb37hdap7nd9i0id5b5yxlcnf7930r";
};
buildInputs = [ bash subversion ];
nativeBuildInputs = [ makeWrapper ];
installPhase = ''
mkdir -p $out/bin
cp github-downloader.sh $out/bin/github-downloader.sh
wrapProgram $out/bin/github-downloader.sh \
--prefix PATH : ${lib.makeBinPath [ bash subversion ]}
'';
}
wrapProgram will move the original script to .github-downloader.sh-wrapped
Command not found
For example, the script throws the error svn: command not found, because the dependency subversion is missing.
When a command is missing, you can use nix-locate to find the package name. for example, the stat command:
$ nix-locate bin/stat | grep 'bin/stat$'
coreutils.out 0 s /nix/store/vr96j3cxj75xsczl8pzrgsv1k57hcxyp-coreutils-8.31/bin/stat
Debugging embedded scripts
When a bash script fails, it prints only an error message, but no code location.
To trace commands and line numbers, we can use
{ runCommand, coreutils }:
runCommand "output.txt" { nativeBuildInputs = [ coreutils ]; } ''
# line 5 in nix file = line 1 in bash script -> offset 4
PS4='+ Line $(expr $LINENO + 4): '
set -o xtrace # print commands
echo hello >$out # line 9 in nix file
set +o xtrace # hide commands
''
$ nix-build -E 'with import <nixpkgs> { }; callPackage ./test-trace.nix { }'
this derivation will be built:
/nix/store/2v5biwny8plpyk2bv6cfr41ppp0a1i4k-output.txt.drv
building '/nix/store/2v5biwny8plpyk2bv6cfr41ppp0a1i4k-output.txt.drv'...
++ Line 9: echo hello
++ Line 11: set +o xtrace
/nix/store/ppidmnpd5m762x9kqj8jd3g7df7dknrz-output.txt
Posix Shell
Some environments (like OpenWRT, via busybox) offer only a "limited" shell (sh instead of bash).
On NixOS, posix shells are provided by the packages dash and posh.