Introduction and evaluation of Martlet: A scientific workflow language for abstracted parallelisation

Daniel James Goodman

    Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

    Abstract

    The workflow language Martlet described in this paper implements a new programming model that allows users to write parallel programs and analyse distributed data without having to be aware of the details of the parallelisation. Martlet abstracts the parallelisation of the computation and the splitting of the data through the inclusion of constructs inspired by functional programming. These allow programs to be written as an abstract description that can be adjusted automatically at runtime to match the data set and available resources. Using this model it is possible to write programs to perform complex calculations across a distributed data set such as Singular Value Decomposition or Least Squares problems, as well as creating an intuitive way of working with distributed system. Having described and evaluated Martlet against other functional languages for parallel computation, this paper goes on to look at how Martlet might develop. In doing so it covers both possible additions to the language itself, and the use of JIT compilers to increase the range of platforms it is capable of running on.
    Original languageEnglish
    Title of host publication16th International World Wide Web Conference, WWW2007|Int. World Wide Web Conf.
    PublisherAssociation for Computing Machinery
    Pages983-992
    Number of pages9
    ISBN (Print)1595936548, 9781595936547
    Publication statusPublished - 2007
    Event16th International World Wide Web Conference, WWW2007 - Banff, AB
    Duration: 1 Jul 2007 → …
    http://dblp.uni-trier.de/db/conf/www/www2007.html#KolovskiHP07http://dblp.uni-trier.de/rec/bibtex/conf/www/KolovskiHP07.xmlhttp://dblp.uni-trier.de/rec/bibtex/conf/www/KolovskiHP07

    Conference

    Conference16th International World Wide Web Conference, WWW2007
    CityBanff, AB
    Period1/07/07 → …
    Internet address

    Keywords

    • Abstraction
    • Distributing computing
    • E-Science
    • Martlet
    • Parallel computing
    • Scientific computing
    • Workflow

    Fingerprint

    Dive into the research topics of 'Introduction and evaluation of Martlet: A scientific workflow language for abstracted parallelisation'. Together they form a unique fingerprint.

    Cite this