A Notation and System for Expressing and Executing Cleanly Typed Workflows on Messy Scientific Data

DMCA

A Notation and System for Expressing and Executing Cleanly Typed Workflows on Messy Scientific Data (2005)

Cached

Download Links

Other Repositories/Bibliography

DBLP

by Yong Zhao , Jed Dobson , Ian Foster , Luc Moreau Michael Wilde

Venue:	SIGMOD Record
Citations:	62 - 12 self

BibTeX

@ARTICLE{Zhao05anotation,
    author = {Yong Zhao and Jed Dobson and Ian Foster and Luc Moreau Michael Wilde},
    title = {A Notation and System for Expressing and Executing Cleanly Typed Workflows on Messy Scientific Data},
    journal = {SIGMOD Record},
    year = {2005},
    volume = {34},
    pages = {37--43}
}

OpenURL

Abstract

The description, composition, and execution of even logically simple scientific workflows are often complicated by the need to deal with “messy ” issues like heterogeneous storage formats and ad-hoc file system structures. We show how these difficulties can be overcome via a typed, compositional workflow notation within which issues of physical representation are cleanly separated from logical typing, and by the implementation of this notation within the context of a powerful runtime system that supports distributed execution. The resulting notation and system are capable both of expressing complex workflows in a simple, compact form, and of enacting those workflows in distributed environments. We apply our technique to cognitive neuroscience workflows that analyze functional MRI image data, and demonstrate significant reductions in code size relative to other approaches. 1

Keyphrases

messy scientific data executing cleanly typed workflow physical representation significant reduction neuroscience workflow simple scientific workflow complex workflow ad-hoc file system structure logical typing compositional workflow notation compact form code size relative powerful runtime system messy issue functional mri image data heterogeneous storage format distributed environment

DMCA