JUSTUS2/Software/Julia/Parallel Programming

Parallel Programming in Julia

Julia supports several paradigms of parallel programming

1. Implicit multi-threading by math libraries (OpenBLAS, MKL)
2. Explicit multi-threading using Julia threads (e.g. `Threads.@threads for`)
3. Multiple processes on one ore more nodes
   • Distributed package and SlurmManager from [ClusterManagers.jl https://github.com/JuliaParallel/ClusterManagers.jl] package, @distributed for-loops
   • [MPI.jl https://github.com/JuliaParallel/MPI.jl]
4. Execution on GPUs/CUDA using [CUDA.jl https://cuda.juliagpu.org/stable/]