SD ID: Photon-Neutron Science Demonstrator
ORGANISATIONS: DESY, EMBL, ESRF, EU-XFeL, ESS, ILL, STFC
CONTACT: Volker Guelzow, DESY
The Photon Neutron Data Science Demonstrator will leverage on the photon-neutron community to improve computing facilities by creating a virtual platform for all users.
The Photon-Neutron science demo is based on the concept that:
- Data sets become too large to take home;
- The EOSC forms a platform for analysis and data storage
- The EOSC allows for easy data sharing
- Data rates require dedicated central IT infrastructure, way beyond previous requirements;
- A wide variety of scientific users means significant number of data formats and analysis software.
Exploiting a community of more than 35,000 unique users (in 2011), the science demonstrator aims to enable cloud based storage and compute solutions, foster standardized data formats and allow transparent and secure remote access to scientific data. We will focus for this demonstrator on a particular data analysis framework outlined in the diagram. The crystfel framework is increasingly used at various synchrotrons and FELs to analyze date from serial (femto-second) x-ray crystallography. The nature of these experiments make a cloud-based distributed pipeline particularly appealing, since the framework can fully exploit large computational resources with tunable demands. The framework is well documented and vast amount of data are readily and openly available.
- Exploit and improve the crystfel framework for distributed computing.
- Provide compatible data analysis software
- Allow transparent and secure remote access to data
- Standardize data formats NeXus/HDF5 and annotation of data
- Test and establish (if feasible) web-services for easy consumption and visualization of the data
- Exploit existing authentication and authorization solutions
- Allow long term preservation of data
- Promote data policies in laboratories