Description
The Max Planck Computing and Data Facility is engaged in the development and optimization of algorithms and applications for high performance computing as well as for data-intensive projects. As programming language in data science, Python is now used at MPCDF in the scientific area of “atom probe crystallography” (APT): a Fourier analysis in 3D space can be simulated in order to reveal composition and crystallographic structure at the atomic scale of billions APT experimental data sets.
The Python data ecosystem has proved to be well suited to this, as it has grown beyond the confines of single machines to embrace scalability. The talk aims to describe our approach to scaling across multiple GPUs, and the role of visualization methods too.
Our data workflow analysis relies on the GPU-accelerated Python software package PyNX, an open source library which provides fast parallel computation scattering. The code takes advantage of the high throughput of GPUs, using the pyCUDA library.
Exploratory data analysis, high productivity and rapid prototyping with high performance are enabled through Jupyter Notebooks and Python packages e.g., pandas, matplotlib/plotly. In production stage, interactive visualization is realized by using standard scientific tool, e.g. Paraview, an open-source 3D visualization program which requires Python modules to generate visualization components within VTK files.
in __on sabato 21 aprile at 14:45 **See schedule**