SHIWA - SHaring Interoperable Workflows for large-scale scientific simulations on Available DCIs

  • Background

Researchers of all disciplines, from Life Sciences and Astronomy to Computational Chemistry, create and use ever-increasing amounts of complex data, and rely more and more on compute-intensive modelling, simulation and analysis.

Scientific workflows have become a key paradigm for managing complex tasks and have emerged as a unifying mechanism for handling scientific data. Workflows capture the essence of the scientific process, providing a means to describe it via logical data- or work-flows. Workflows are mapped onto concrete Distributed Computing Infrastructures (DCIs) to perform large-scale experiments.

The learning curve for reusing workflows, however, is still steep because workflows typically have their own user interfaces/APIs, description languages, provenance strategies, and enactment engines, which are not standard and do not interoperable. Workflow integration or reuse therefore is currently impractical, thereby inhibiting the growth in uptake and proliferation of workflows in scientific practice.

  • Project goal

User communities from all around Europe use many kinds of different workflow languages. Communities develop their workflows using one of the workflow engines. Workflow development, testing and validation is a time consuming process and it requires specific expertise. These limit the number of available workflows, so it is important to reuse them. Workflows developed for one workflow system is normally not compatible with workflows of other workflow systems. In the past if two user communities using different workflow systems wanted to collaborate, they had to create the workflows from scratch to transform them to the desired workflow languages. This situation can be resolved by emerging new workflow interoperability technologies. The goal of SHIWA is to develop such technologies.

According to the new SHIWA technologies publicly available workflows can be used by different research communities working on different workflow systems and are enabled to run on multiple distributed computing infrastructures. As a result workflow communities are not locked anymore in to their selected workflow system and its supported distributed computing infrastructure.

SHIWA develops, deploys and operates the SHIWA Simulation Platform to offer users production-level services supporting workflow interoperability. As part of the SHIWA Simulation Platform the SHIWA Repository facilitates publishing and sharing workflows, and the SHIWA Portal enables their actual enactment and execution in all the DCIs available in Europe. Use cases targeting various scientific domains will serve to drive and evaluate this platform from a user's perspective.

The SHIWA project started on the 1st of July 2010 and lasts two years.

More information about the project can be found on the project's fact sheet.

If you want to know more,visit our FAQ page.

Work Packages Work Packages

WP1 - NA1 Project Administrative and Technical Management Contact: Eva Feuer
  Eva Feuer (SZTAKI)  
  Peter Kacsuk (SZTAKI)  
  Thomas Fahringer (UIBK)  
     
WP2 - NA2 Knowledge Services Contact: Kitti Varga
  Kitti Varga (SZTAKI)  
  Miklos Kozlovszky (SZTAKI)  
  Gabor  Terstyanszky (UoW)  
  Tamas Kukla (UoW)  
  Radu Prodan (UIBK)  
  Johan Montagnat (CNRS)  
  Tram Truong Huu (CNRS)  
  Ketan Maheshwari (CNRS)  
     
WP3 - SA1 SHIWA Simulation Platform ContactGabor Terstyanszky
  Gabor Terstyanszky (UoW)  
  Tamas Kukla (UoW)   
  Nasullah Khalid (UoW)  
  Zsolt  Lichtenberger (UoW)  
  Akos Balasko (SZTAKI)  
  Matthias Janetschek (UIBK)  
  Johan Montagnat (CNRS)   
  Javier Rojas Balderrama (CNRS)  
  Tram Truong Huu (CNRS)   
  Ketan Maheshwari (CNRS)   
     
WP4 - SA2 Application Support Service Contact: Johan Montagnat
  Silvia Olabarriaga (AMC)  
  Vladimir Korkhov (AMC)  
  Simon Ostermann (UIBK)  
  Johan Montagnat (CNRS)  
  Tristan Glatard (CNRS)  
  Javier Rojas Balderrama (CNRS)   
  Tram Truong Huu (CNRS)   
  Ketan Maheshwari (CNRS)   
  Noam Weingarten (UoW)  
  Thomas Tolxdorff (C-UB)  
  Dagmar Krefting (C-UB)  
  Mario Wohlfahrt (C-UB)  
  Akos Balasko (SZTAKI)  
  Barbera van Schaik (AMC) - bioinformatics workflows  
  Matthan Caan (AMC) - neuroimaging workflows  
  Perry Moerland (AMC) - proteomics workflows  
  Ishtiaq Ahmad (AMC) - proteomics, galaxy workflows  
     
WP5 - JRA1 Coarse-grained workflow interoperability ContactIan Taylor
  Ian Taylor (CU)  
  Ian Harvey (CU)  
  David Rogers (CU)  
  Kieran Evans (CU)  
  Andrew Jones (CU)  
  Akos Balasko (SZTAKI)   
  Peter Kacsuk (SZTAKI)  
  Gabor  Terstyanszky (UoW)   
  Tamas Kukla (UoW)   
  Zsolt  Lichtenberger (UoW)   
  Matthias Janetschek (UIBK)  
  Malik Muhammad (UIBK)  
  Johan Montagnat (CNRS)   
  Javier Rojas Balderrama (CNRS)   
  Tram Truong Huu (CNRS)   
  Ketan Maheshwari (CNRS)   
     
WP6 - JRA2 Fine-grained workflow interoperability ContactRadu Prodan
  Radu Prodan (UIBK)  
  Kassian Plankensteiner (UIBK)  
  Ian Harvey (CU)  
  David Rogers (CU)  
  Akos Balasko (SZTAKI)   
  Peter Kacsuk (SZTAKI)  
  Csaba Kranyecz (SZTAKI)  
  Johan Montagnat (CNRS)   
  Javier Rojas Balderrama (CNRS)   
  Tram Truong Huu (CNRS)   
  Ketan Maheshwari (CNRS)   

Contacts Contacts

Public Relations
PR Team
email: pr at lpds.sztaki.hu


Project Coordinator
Prof. Peter Kacsuk
email: kacsuk at sztaki.hu
Phone/Fax: +36 1 329 7864


Administrative and Financial Coordinator
Ms. Eva Feuer
email: eva.feuer at sztaki.hu
Phone: +36 1 279 6285


Website contact
SHIWA admin group
email:
shiwaadmin at shiwa-workflow.eu

               

   

 SHIWA (project number 261585) was supported by a Grant from the European Commission's  FP7 INFRASTRUCTURES-2010-2 call under grant agreement n°261585
Provided by the MTA SZTAKI Computer  and Automation Research Institute - Maintained by Laboratory of Parallel and Distributed Computing with Free and Open Source Software (2010)