Speakers - Anderson Banihirwe, Guillaume Eynard-Bontemps
The goal of this workshop is to bring together scientists, software developers and HPC center administrators to share their experiences with interactive supercomputing, using Dask in High Performance Computing (HPC) settings.
High Performance Computing (HPC) users perform different kinds of data analysis with a variety of tools and workflows. HPC users tend to be well versed in technologies like MPI (for scaling complex computions), and batch job queuing systems such as PBS, Slurm, etc. With the advent of tools like Jupyter notebooks, there's a growing interest in interactive, "human-in-the-loop" workflows. However, this kind of workflows isn't supported by the traditional MPI with batch processing approach. One remedy to this problem is the Dask toolchain which includes tools like dask-jobqueue that enables interactive supercomputing on HPC systems.
The goal of this workshop is to bring together scientists, software developers and HPC center administrators to share their experiences with interactive/non-interactive supercomputing with Dask in HPC settings. Topics of interest for this workshop include (but are not limited to):
User stories and user demos of Dask on supercomputers
Tools and environments for interactive/non-interactive supercomputing with Dask
Most wanted features in distributed and/or dask-jobqueue or other dask related projects for a better experience in HPC settings
Challenges that folks run into when using Dask on HPC systems
Tips and lessons learned about tuning Dask clusters on HPC systems
===
The Dask Distributed Summit is where users, contributors, and newcomers can share experiences to learn from one another and grow together. The Dask Distributed Summit provides content, information, and learning opportunities for attendees of all levels of Dask familiarity and expertise.
summit.dask.org/
3 окт 2024
