BwUniCluster2.0/Jupyter - Revision history

P Schuhmacher at 09:11, 14 February 2025

2025-02-14T09:11:03Z

← Older revision		Revision as of 11:11, 14 February 2025
Line 274:		Line 274:
	Don't forget to load the <code>devel/julia/1.6.2</code> module (blue button) before using the kernel.		Don't forget to load the <code>devel/julia/1.6.2</code> module (blue button) before using the kernel.


			== Jupyter Container ==

			The container integration on the jupyterhub is done via pyxis. In order to use it the checkmark for container mode has to be clicked. Available options are:

			* <code> --container-image:</code> The container image to use. Corresponds to the pyxis option --container-image
			* <code> --container-name:</code> The name of the image to use. Corresponds to the pyxis option --container-name. Already downloaded containers in ~/.local/share/enroot can be startet by simply specifing their name.
			* <code> --container-mount-home:</code> Corresponds to the pyxis option --container-mount-home. Mounts the home-directory

			'''Attention:'''
			Make sure Python3.9 and pip are installed in the Container or the notebook will not spawn. This can be checked via command python3.9 -m pip list inside your container

			It is advised to create the container prior via e.G. enroot and install all necessary software. For more information see [https://wiki.bwhpc.de/e/BwUniCluster2.0/Containers#SLURM_Integration here]

	----		----

S Braun: S Braun moved page BwUniCluster/Jupyter to BwUniCluster2.0/Jupyter over redirect

2025-01-09T12:19:57Z

S Braun moved page BwUniCluster/Jupyter to BwUniCluster2.0/Jupyter over redirect

← Older revision	Revision as of 14:19, 9 January 2025
(No difference)

S Braun: S Braun moved page BwUniCluster2.0/Jupyter to BwUniCluster/Jupyter over redirect

2025-01-09T12:18:46Z

S Braun moved page BwUniCluster2.0/Jupyter to BwUniCluster/Jupyter over redirect

← Older revision	Revision as of 14:18, 9 January 2025
(No difference)

S Braun: /* Software Stacks for Jupyter */

2024-12-19T09:26:18Z

Software Stacks for Jupyter

← Older revision		Revision as of 11:26, 19 December 2024
Line 173:		Line 173:
	*: For a complete list of pre-installed packages, please refer to [https://uc2-jupyter.scc.kit.edu/software-modules/#pre-installed-software-packages this site].		*: For a complete list of pre-installed packages, please refer to [https://uc2-jupyter.scc.kit.edu/software-modules/#pre-installed-software-packages this site].

	* <code>jupyter/tensorflow</code> (default at login)		* <code>jupyter/tensorflow</code> (default at login, will be deprecated with the advent of bwUniCluster 3.0)
	*: Preinstalled software packages for machine learning applications. Includes among others TensorFlow, Keras, Torch, Pandas, Matplotlib, SKLearn.		*: Preinstalled software packages for machine learning applications. Includes among others TensorFlow, Keras, Torch, Pandas, Matplotlib, SKLearn.
	*: For a complete list of pre-installed packages and their respective version, please refer to [https://uc2-jupyter.scc.kit.edu/software-modules/#pre-installed-software-packages this site].		*: For a complete list of pre-installed packages and their respective version, please refer to [https://uc2-jupyter.scc.kit.edu/software-modules/#pre-installed-software-packages this site].

S Braun: /* Software Stacks for Jupyter */

2024-12-19T09:22:52Z

Software Stacks for Jupyter

← Older revision		Revision as of 11:22, 19 December 2024
Line 166:		Line 166:
	Currently 3 special Jupyter software stacks are available via Lmod:		Currently 3 special Jupyter software stacks are available via Lmod:

	* jupyter/minimal		* <code>jupyter/minimal</code>
	*: Minimal installation of JupyterLab		*: Minimal installation of JupyterLab

	* jupyter/base		* <code>jupyter/base</code>
	*: Basic installation of JupyterLab.		*: Basic installation of JupyterLab.
	*: For a complete list of pre-installed packages, please refer to [https://uc2-jupyter.scc.kit.edu/software-modules/#pre-installed-software-packages this site].		*: For a complete list of pre-installed packages, please refer to [https://uc2-jupyter.scc.kit.edu/software-modules/#pre-installed-software-packages this site].

	* jupyter/tensorflow (default at login)		* <code>jupyter/tensorflow</code> (default at login)
	*: Preinstalled software packages for machine learning applications. Includes among others TensorFlow, Keras, Torch~~, MXNet~~, Pandas, Matplotlib, SKLearn.		*: Preinstalled software packages for machine learning applications. Includes among others TensorFlow, Keras, Torch, Pandas, Matplotlib, SKLearn.
	*: For a complete list of pre-installed packages and their respective version, please refer to [https://uc2-jupyter.scc.kit.edu/software-modules/#pre-installed-software-packages this site].		*: For a complete list of pre-installed packages and their respective version, please refer to [https://uc2-jupyter.scc.kit.edu/software-modules/#pre-installed-software-packages this site].

			* <code>jupyter/ai</code> (will be the new default at login für bwUniCluster 3.0, contains all latest and greatest software for AI workflows)
⚫	* jupyter/extensions
			*: Preinstalled software packages for machine learning applications. Includes among others TensorFlow, Keras, Torch, Torchvision, Lighning, Pandas, Matplotlib, SKLearn.
			*: For a complete list of pre-installed packages and their respective version, please refer to [https://uc2-jupyter.scc.kit.edu/software-modules/#pre-installed-software-packages this site].

		⚫	* <code>jupyter/extensions</code>
	*: Same packages as tensorflow + extensions		*: Same packages as tensorflow + extensions

S Braun: /* Creation of virtual environment */

2024-11-08T15:14:36Z

Creation of virtual environment

← Older revision		Revision as of 17:14, 8 November 2024
Line 207:		Line 207:

	<pre>		<pre>
	~~python3.11~~ -m venv <myEnv>		python -m venv <myEnv>
	source <myEnv>/bin/activate		source <myEnv>/bin/activate
	pip install <packageName>		pip install <packageName>
Line 213:		Line 213:
	</pre>		</pre>

	The additional packages are installed under <code><myEnv>/lib/python3.11/site-packages/</code>.		The additional packages are installed under <code><myEnv>/lib/python3.9/site-packages/</code>.

	=== Usage of virtual environment ===		=== Usage of virtual environment ===

S Braun: /* Creation of virtual environment */

2024-11-08T15:13:54Z

Creation of virtual environment

← Older revision		Revision as of 17:13, 8 November 2024
Line 213:		Line 213:
	</pre>		</pre>

	The additional packages are installed under <code><myEnv>/lib/python3.9/site-packages/</code>.		The additional packages are installed under <code><myEnv>/lib/python3.11/site-packages/</code>.

	=== Usage of virtual environment ===		=== Usage of virtual environment ===

S Braun: /* Creation of virtual environment */

2024-11-08T15:13:40Z

Creation of virtual environment

← Older revision		Revision as of 17:13, 8 November 2024
Line 207:		Line 207:

	<pre>		<pre>
	~~virtualenv~~ -p ~~python~~ <myEnv>		python3.11 -m venv <myEnv>
	source <myEnv>/bin/activate		source <myEnv>/bin/activate
	pip install <packageName>		pip install <packageName>

K Siegmund at 09:29, 23 April 2024

2024-04-23T09:29:43Z

← Older revision		Revision as of 11:29, 23 April 2024
Line 272:		Line 272:

	----		----
	[[Category:BwUniCluster_2.0]][[Category:Access]]

R Keller: Provide the link to the Workshop repository with content provided by HS ES, KIT and UniKN

2023-07-25T14:29:27Z

Provide the link to the Workshop repository with content provided by HS ES, KIT and UniKN

← Older revision		Revision as of 16:29, 25 July 2023
Line 235:		Line 235:
	'''Attention'''		'''Attention'''
	The (Lmod) base module you used in the Creation of virtual environment step must be loaded to use the venv. However, to be on the safe side, you can also use the system Python (<code>/usr/bin/python3.9</code>) at creation time, which is available even without any <code>jupyter/{base,tensorflow}</code> module loaded.		The (Lmod) base module you used in the Creation of virtual environment step must be loaded to use the venv. However, to be on the safe side, you can also use the system Python (<code>/usr/bin/python3.9</code>) at creation time, which is available even without any <code>jupyter/{base,tensorflow}</code> module loaded.

			== Examples on Data processing, Machine Learning & Visualization ==

			In the [https://github.com/hpcraink/workshop-parallel-jupyter/ workshop repository] the usage and best practices on Python in general, and the packages NumPy, Pandas, SciKit and Dask are provided, containing running examples based on open data. It also explains, how Jupyter interacts with pre-installed and your own provided environments.

	== R language ==		== R language ==