Back to All Events

Parallel Programming: MPI I/O Advanced Features

Presenter: Jemmy Hu, SHARCNET

MPI-IO is a set of extensions to the MPI library that enable parallel high-performance I/O operations. It provides a parallel file access interface that allows multiple processes to write to and read from the same file simultaneously. MPI-IO allows for efficient data transfer between processes and enables high-performance I/O operations on large datasets. In this seminar, we will talk about some MPI-IO advanced features such as file view, contiguous vs non-contiguous IO, hints info, independent vs collective IO, blocking vs non-blocking IO as well as MPI derived filetype and datatype.

Previous
Previous
April 9

Too Big to Train: Large model training in PyTorch with Fully Sharded Data Parallel

Next
Next
May 7

Checkpoints: why, when and how