Pegasus

Pegasus: A framework for mapping complex scientific workflows onto distributed systems. This paper describes the Pegasus framework that can be used to map complex scientific workflows onto distributed resources. Pegasus enables users to represent the workflows at an abstract level without needing to worry about the particulars of the target execution systems. The paper describes general issues in mapping applications and the functionality of Pegasus. We present the results of improving application performance through workflow restructuring which clusters multiple tasks in a workflow into single entities. A real-life astronomy application is used as the basis for the study


References in zbMATH (referenced in 42 articles )

Showing results 1 to 20 of 42.
Sorted by year (citations)

1 2 3 next

  1. Yadu Babuji, Anna Woodard, Zhuozhao Li, Daniel S. Katz, Ben Clifford, Rohan Kumar, Lukasz Lacinski, Ryan Chard, Justin M. Wozniak, Ian Foster, Michael Wilde, Kyle Chard: Parsl: Pervasive Parallel Programming in Python (2019) arXiv
  2. Ariella L.Gladstein; Consuelo D. Quinto-Cortés; Julian L. Pistorius; David Christy; Logan Gantner; Blake L. Joyce: SimPrily: A Python framework to simplify high-throughput genomic simulations (2018) not zbMATH
  3. Bhatti, Muhammad Khurram; Oz, Isil; Amin, Sarah; Mushtaq, Maria; Farooq, Umer; Popov, Konstantin; Brorsson, Mats: Locality-aware task scheduling for homogeneous parallel computing systems (2018)
  4. Drozdov, Alexander Yu.; Tchernykh, Andrei; Novikov, Sergey V.; Vladislavlev, Victor E.; Rivera-Rodriguez, Raul: PHEFT: pessimistic image processing workflow scheduling for DSP clusters (2018)
  5. Maria Luiza Mondelli, Thiago Magalhães, Guilherme Loss, Michael Wilde, Ian Foster, Marta Mattoso, Daniel S. Katz, Helio J. C. Barbosa, Ana Tereza R. Vasconcelos, Kary Ocaña, Luiz M. R. Gadelha Jr: BioWorkbench: A High-Performance Framework for Managing and Analyzing Bioinformatics Experiments (2018) arXiv
  6. Agrawal, Tarun K.; Sahu, Aryabartta; Ghose, Manojit; Sharma, R.: Scheduling chained multiprocessor tasks onto large multiprocessor system (2017)
  7. Pacini, Elina; Mateos, Cristian; García Garino, Carlos: Multi-objective swarm intelligence schedulers for online scientific clouds (2016) ioport
  8. Ma, Yinglong; Shi, Moyi; Wei, Jun: Cost and accuracy aware scientific workflow retrieval based on distance measure (2015)
  9. Stehr, Mark-Oliver; Kim, Minyoung; McCarthy, Tim: A distributed computing model for dataflow, controlflow, and workflow in fractionated cyber-physical systems (2014)
  10. Tsamoura, Efthymia; Gounaris, Anastasios; Manolopoulos, Yannis: Optimization of decentralized multi-way join queries over pipelined filtering services (2012)
  11. Byun, Eun-Kyu; Kee, Yang-Suk; Kim, Jin-Soo; Deelman, Ewa; Maeng, Seungryoul: BTS: Resource capacity estimate for time-targeted science workflows (2011) ioport
  12. Han, Liangxiu; Liew, Chee Sun; van Hemert, Jano; Atkinson, Malcolm: A generic parallel processing model for facilitating data mining and integration (2011) ioport
  13. Mika, Marek; Waligóra, Grzegorz; Węglarz, Jan: Modelling and solving grid resource allocation problem with network resources for workflow applications (2011)
  14. Wang, Chenqi; Cafferkey, Neil; Kennedy, James; Morrison, John P.: CG3DR: coordination of icosahedral virus reconstruction using condensed graphs (2011) ioport
  15. Wilde, Michael; Hategan, Mihael; Wozniak, Justin M.; Clifford, Ben; Katz, Daniel S.; Foster, Ian: Swift: A language for distributed parallel scripting (2011) ioport
  16. Wu, Qishi; Gu, Yi: Modeling and simulation of distributed computing workflows in heterogeneous network environments (2011) ioport
  17. Yuan, Dong; Yang, Yun; Liu, Xiao; Chen, Jinjun: On-demand minimum cost benchmarking for intermediate dataset storage in scientific cloud workflow systems (2011)
  18. Bittencourt, Luiz Fernando; Madeira, Edmundo R. M.: Towards the scheduling of multiple workflows on computational grids (2010) ioport
  19. Callaghan, Scott; Deelman, Ewa; Gunter, Dan; Juve, Gideon; Maechling, Philip; Brooks, Christopher; Vahi, Karan; Milner, Kevin; Graves, Robert; Field, Edward; Okaya, David; Jordan, Thomas: Scaling up workflow-based applications (2010) ioport
  20. Camarasu-Pop, Sorina; Glatard, Tristan; Mościcki, Jakub T.; Benoit-Cattin, Hugues; Sarrut, David: Dynamic partitioning of GATE Monte-Carlo simulations on EGEE (2010) ioport

1 2 3 next


Further publications can be found at: https://pegasus.isi.edu/publications/