How to Find Meaning in Petabytes of Data
October 19, 2016
I will use the example of an analysis framework developed for HACC, a cosmological N-body code that simulates the development of the universe, to illustrate approaches for handling petabyte-scale outputs. We explored the balance between scheduling analysis task inside the main simulation and offloading them. I will use the example of finding the location of the galaxies in the simulated universe.