A Community Roadmap for Scientific Workflows Research and Development

Rafael Ferreira Da Silva; Henri Casanova; Kyle Chard; Ilkay Altintas; Rosa M Badia; Bartosz Balis; Taina Coleman; Frederik Coppens; Frank Di Natale; Bjoern Enders; Thomas Fahringer; Rosa Filgueira; Grigori Fursin; Daniel Garijo; Carole Goble; Dorran Howell; Shantenu Jha; Daniel S. Katz; Daniel Laney; Ulf Leser; Maciej Malawski; Kshitij Mehta; Loic Pottier; Jonathan Ozik; J. Luc Peterson; Lavanya Ramakrishnan; Stian Soiland-reyes; Douglas Thain; Matthew Wolf

doi:10.1109/WORKS54523.2021.00016

A Community Roadmap for Scientific Workflows Research and Development

Rafael Ferreira Da Silva, Henri Casanova, Kyle Chard, Ilkay Altintas, Rosa M Badia, Bartosz Balis, Taina Coleman, Frederik Coppens, Frank Di Natale, Bjoern Enders, Thomas Fahringer, Rosa Filgueira, Grigori Fursin, Daniel Garijo, Carole Goble, Dorran Howell, Shantenu Jha, Daniel S. Katz, Daniel Laney, Ulf LeserMaciej Malawski, Kshitij Mehta, Loic Pottier, Jonathan Ozik, J. Luc Peterson, Lavanya Ramakrishnan, Stian Soiland-reyes, Douglas Thain, Matthew Wolf

Information Management

Research output: Contribution to conference › Paper › peer-review

Abstract

The landscape of workflow systems for scientific applications is notoriously convoluted with hundreds of seemingly equivalent workflow systems, many isolated research claims, and a steep learning curve. To address some of these challenges and lay the groundwork for transforming workflows research and development, the WorkflowsRI and ExaWorks projects partnered to bring the international workflows community together.

This paper reports on discussions and findings from two virtual "Workflows Community Summits" (January and April, 2021). The overarching goals of these workshops were to develop a view of the state of the art, identify crucial research challenges in the workflows community, articulate a vision for potential community efforts, and discuss technical approaches for realizing this vision.

To this end, participants identified six broad themes: FAIR computational workflows; AI workflows; exascale challenges; APIs, interoperability, reuse, and standards; training and education; and building a workflows community. We summarize discussions and recommendations for each of these themes.

Original language	English
Pages	81-90
Number of pages	10
DOIs	https://doi.org/10.1109/WORKS54523.2021.00016
Publication status	Published - 28 Dec 2021
Event	2021 IEEE Workshop on Workflows in Support of Large-Scale Science (WORKS) - St. Louis, MO, USA Duration: 15 Nov 2021 → 15 Nov 2021

Conference

Conference	2021 IEEE Workshop on Workflows in Support of Large-Scale Science (WORKS)
Period	15/11/21 → 15/11/21

Access to Document

10.1109/WORKS54523.2021.00016

https://arxiv.org/pdf/2110.02168Licence: Unspecified

Workflows Community Initiative (External organisation)
Stian Soiland-Reyes (Invited member)
24 Feb 2022 → …
Activity: Membership › Membership of board › Research

Cite this

Da Silva, R. F., Casanova, H., Chard, K., Altintas, I., Badia, R. M., Balis, B., Coleman, T., Coppens, F., Di Natale, F., Enders, B., Fahringer, T., Filgueira, R., Fursin, G., Garijo, D., Goble, C., Howell, D., Jha, S., Katz, D. S., Laney, D., ... Wolf, M. (2021). A Community Roadmap for Scientific Workflows Research and Development. 81-90. Paper presented at 2021 IEEE Workshop on Workflows in Support of Large-Scale Science (WORKS). https://doi.org/10.1109/WORKS54523.2021.00016

@conference{092cd3b6627f44d0a14c2e2419484aaa,

title = "A Community Roadmap for Scientific Workflows Research and Development",

abstract = "The landscape of workflow systems for scientific applications is notoriously convoluted with hundreds of seemingly equivalent workflow systems, many isolated research claims, and a steep learning curve. To address some of these challenges and lay the groundwork for transforming workflows research and development, the WorkflowsRI and ExaWorks projects partnered to bring the international workflows community together. This paper reports on discussions and findings from two virtual {"}Workflows Community Summits{"} (January and April, 2021). The overarching goals of these workshops were to develop a view of the state of the art, identify crucial research challenges in the workflows community, articulate a vision for potential community efforts, and discuss technical approaches for realizing this vision. To this end, participants identified six broad themes: FAIR computational workflows; AI workflows; exascale challenges; APIs, interoperability, reuse, and standards; training and education; and building a workflows community. We summarize discussions and recommendations for each of these themes.",

author = "{Da Silva}, {Rafael Ferreira} and Henri Casanova and Kyle Chard and Ilkay Altintas and Badia, {Rosa M} and Bartosz Balis and Taina Coleman and Frederik Coppens and {Di Natale}, Frank and Bjoern Enders and Thomas Fahringer and Rosa Filgueira and Grigori Fursin and Daniel Garijo and Carole Goble and Dorran Howell and Shantenu Jha and Katz, {Daniel S.} and Daniel Laney and Ulf Leser and Maciej Malawski and Kshitij Mehta and Loic Pottier and Jonathan Ozik and Peterson, {J. Luc} and Lavanya Ramakrishnan and Stian Soiland-reyes and Douglas Thain and Matthew Wolf",

year = "2021",

month = dec,

day = "28",

doi = "10.1109/WORKS54523.2021.00016",

language = "English",

pages = "81--90",

note = "2021 IEEE Workshop on Workflows in Support of Large-Scale Science (WORKS) ; Conference date: 15-11-2021 Through 15-11-2021",

}

Da Silva, RF, Casanova, H, Chard, K, Altintas, I, Badia, RM, Balis, B, Coleman, T, Coppens, F, Di Natale, F, Enders, B, Fahringer, T, Filgueira, R, Fursin, G, Garijo, D, Goble, C, Howell, D, Jha, S, Katz, DS, Laney, D, Leser, U, Malawski, M, Mehta, K, Pottier, L, Ozik, J, Peterson, JL, Ramakrishnan, L, Soiland-reyes, S, Thain, D & Wolf, M 2021, 'A Community Roadmap for Scientific Workflows Research and Development', Paper presented at 2021 IEEE Workshop on Workflows in Support of Large-Scale Science (WORKS), 15/11/21 - 15/11/21 pp. 81-90. https://doi.org/10.1109/WORKS54523.2021.00016

TY - CONF

T1 - A Community Roadmap for Scientific Workflows Research and Development

AU - Da Silva, Rafael Ferreira

AU - Casanova, Henri

AU - Chard, Kyle

AU - Altintas, Ilkay

AU - Badia, Rosa M

AU - Balis, Bartosz

AU - Coleman, Taina

AU - Coppens, Frederik

AU - Di Natale, Frank

AU - Enders, Bjoern

AU - Fahringer, Thomas

AU - Filgueira, Rosa

AU - Fursin, Grigori

AU - Garijo, Daniel

AU - Goble, Carole

AU - Howell, Dorran

AU - Jha, Shantenu

AU - Katz, Daniel S.

AU - Laney, Daniel

AU - Leser, Ulf

AU - Malawski, Maciej

AU - Mehta, Kshitij

AU - Pottier, Loic

AU - Ozik, Jonathan

AU - Peterson, J. Luc

AU - Ramakrishnan, Lavanya

AU - Soiland-reyes, Stian

AU - Thain, Douglas

AU - Wolf, Matthew

PY - 2021/12/28

Y1 - 2021/12/28

N2 - The landscape of workflow systems for scientific applications is notoriously convoluted with hundreds of seemingly equivalent workflow systems, many isolated research claims, and a steep learning curve. To address some of these challenges and lay the groundwork for transforming workflows research and development, the WorkflowsRI and ExaWorks projects partnered to bring the international workflows community together. This paper reports on discussions and findings from two virtual "Workflows Community Summits" (January and April, 2021). The overarching goals of these workshops were to develop a view of the state of the art, identify crucial research challenges in the workflows community, articulate a vision for potential community efforts, and discuss technical approaches for realizing this vision. To this end, participants identified six broad themes: FAIR computational workflows; AI workflows; exascale challenges; APIs, interoperability, reuse, and standards; training and education; and building a workflows community. We summarize discussions and recommendations for each of these themes.

AB - The landscape of workflow systems for scientific applications is notoriously convoluted with hundreds of seemingly equivalent workflow systems, many isolated research claims, and a steep learning curve. To address some of these challenges and lay the groundwork for transforming workflows research and development, the WorkflowsRI and ExaWorks projects partnered to bring the international workflows community together. This paper reports on discussions and findings from two virtual "Workflows Community Summits" (January and April, 2021). The overarching goals of these workshops were to develop a view of the state of the art, identify crucial research challenges in the workflows community, articulate a vision for potential community efforts, and discuss technical approaches for realizing this vision. To this end, participants identified six broad themes: FAIR computational workflows; AI workflows; exascale challenges; APIs, interoperability, reuse, and standards; training and education; and building a workflows community. We summarize discussions and recommendations for each of these themes.

U2 - 10.1109/WORKS54523.2021.00016

DO - 10.1109/WORKS54523.2021.00016

M3 - Paper

SP - 81

EP - 90

T2 - 2021 IEEE Workshop on Workflows in Support of Large-Scale Science (WORKS)

Y2 - 15 November 2021 through 15 November 2021

ER -

A Community Roadmap for Scientific Workflows Research and Development

Abstract

Conference

Access to Document

Fingerprint

Activities

Workflows Community Initiative (External organisation)

Cite this