Skip to content

Commit 4064b43

Browse files
authored
Merge pull request #238 from NYU-RTS/mdweisner-patch-5
Update 07_jupyter_with_conda_singularity.mdx
2 parents f3e0141 + 7bc539d commit 4064b43

File tree

1 file changed

+4
-2
lines changed

1 file changed

+4
-2
lines changed

docs/hpc/09_ood/07_jupyter_with_conda_singularity.mdx

Lines changed: 4 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -65,7 +65,7 @@ Above we used the overlay file `overlay-15GB-500K.ext3.gz` which will contain al
6565

6666
### Launch Singularity Environment for Installation
6767
```bash
68-
[NetID@log-1 ~]$ singularity exec --overlay /scratch/$USER/my_env/overlay-15GB-500K.ext3:rw /share/apps/images/cuda12.3.2-cudnn9.0.0-ubuntu-22.04.4.sif /bin/bash
68+
[NetID@log-1 ~]$ singularity exec --fakeroot --overlay /scratch/$USER/my_env/overlay-15GB-500K.ext3:rw /share/apps/images/cuda12.3.2-cudnn9.0.0-ubuntu-22.04.4.sif /bin/bash
6969
```
7070
Above we used the Singularity OS image `cuda12.3.2-cudnn9.0.0-ubuntu-22.04.4.sif` which provides the base operating system environment for the conda environment. There are other Singularity OS images available at `/share/apps/images`
7171

@@ -137,6 +137,8 @@ Singularity> which pip
137137

138138
Now use either conda or pip to install your required python packages to the Miniforge environment.
139139

140+
:::note If using Apptainer (the default Singularity installation on Torch) be sure to use the --fakeroot flag when launching overlay files in read-write mode (:rw).
141+
140142
To install larger packages, like Tensorflow, you must first start an interactive job with adequate compute and memory resources to install packages. The login nodes restrict memory to 2GB per user, which may cause some large packages to crash.
141143
```bash
142144
Singularity> exit
@@ -145,7 +147,7 @@ Singularity> exit
145147

146148
# wait to be assigned a node
147149

148-
[NetID@cm001 my_env]$ singularity exec --overlay /scratch/$USER/my_env/overlay-15GB-500K.ext3:rw /share/apps/images/cuda12.3.2-cudnn9.0.0-ubuntu-22.04.4.sif /bin/bash
150+
[NetID@cm001 my_env]$ singularity exec --fakeroot --overlay /scratch/$USER/my_env/overlay-15GB-500K.ext3:rw /share/apps/images/cuda12.3.2-cudnn9.0.0-ubuntu-22.04.4.sif /bin/bash
149151

150152
Singularity> source /ext3/env.sh
151153
# activate the environment

0 commit comments

Comments
 (0)