JUSTUS2/Software/Julia/Parallel Programming

Parallel Programming in Julia

Julia supports several paradigms of parallel programming

1. Implicit multi-threading by math libraries (OpenBLAS, MKL)
2. Explicit multi-threading using Julia threads (e.g. `Threads.@threads for`)
3. Multiple processes on one ore more nodes
   • Distributed package and SlurmManager from ClusterManagers.jl package, @distributed for-loops
   • MPI.jl
4. Execution on GPUs/CUDA using CUDA.jl