Pegasus

Pegasus: A framework for mapping complex scientific workflows onto distributed systems. This paper describes the Pegasus framework that can be used to map complex scientific workflows onto distributed resources. Pegasus enables users to represent the workflows at an abstract level without needing to worry about the particulars of the target execution systems. The paper describes general issues in mapping applications and the functionality of Pegasus. We present the results of improving application performance through workflow restructuring which clusters multiple tasks in a workflow into single entities. A real-life astronomy application is used as the basis for the study


References in zbMATH (referenced in 41 articles )

Showing results 1 to 20 of 41.
Sorted by year (citations)

1 2 3 next

  1. Yadu Babuji, Anna Woodard, Zhuozhao Li, Daniel S. Katz, Ben Clifford, Rohan Kumar, Lukasz Lacinski, Ryan Chard, Justin M. Wozniak, Ian Foster, Michael Wilde, Kyle Chard: Parsl: Pervasive Parallel Programming in Python (2019) arXiv
  2. Ariella L.Gladstein; Consuelo D. Quinto-Cortés; Julian L. Pistorius; David Christy; Logan Gantner; Blake L. Joyce: SimPrily: A Python framework to simplify high-throughput genomic simulations (2018) not zbMATH
  3. Bhatti, Muhammad Khurram; Oz, Isil; Amin, Sarah; Mushtaq, Maria; Farooq, Umer; Popov, Konstantin; Brorsson, Mats: Locality-aware task scheduling for homogeneous parallel computing systems (2018)
  4. Drozdov, Alexander Yu.; Tchernykh, Andrei; Novikov, Sergey V.; Vladislavlev, Victor E.; Rivera-Rodriguez, Raul: PHEFT: pessimistic image processing workflow scheduling for DSP clusters (2018)
  5. Agrawal, Tarun K.; Sahu, Aryabartta; Ghose, Manojit; Sharma, R.: Scheduling chained multiprocessor tasks onto large multiprocessor system (2017)
  6. Pacini, Elina; Mateos, Cristian; García Garino, Carlos: Multi-objective swarm intelligence schedulers for online scientific clouds (2016) ioport
  7. Ma, Yinglong; Shi, Moyi; Wei, Jun: Cost and accuracy aware scientific workflow retrieval based on distance measure (2015)
  8. Stehr, Mark-Oliver; Kim, Minyoung; McCarthy, Tim: A distributed computing model for dataflow, controlflow, and workflow in fractionated cyber-physical systems (2014)
  9. Tsamoura, Efthymia; Gounaris, Anastasios; Manolopoulos, Yannis: Optimization of decentralized multi-way join queries over pipelined filtering services (2012)
  10. Byun, Eun-Kyu; Kee, Yang-Suk; Kim, Jin-Soo; Deelman, Ewa; Maeng, Seungryoul: BTS: Resource capacity estimate for time-targeted science workflows (2011) ioport
  11. Han, Liangxiu; Liew, Chee Sun; van Hemert, Jano; Atkinson, Malcolm: A generic parallel processing model for facilitating data mining and integration (2011) ioport
  12. Mika, Marek; Waligóra, Grzegorz; Węglarz, Jan: Modelling and solving grid resource allocation problem with network resources for workflow applications (2011)
  13. Wang, Chenqi; Cafferkey, Neil; Kennedy, James; Morrison, John P.: CG3DR: coordination of icosahedral virus reconstruction using condensed graphs (2011) ioport
  14. Wilde, Michael; Hategan, Mihael; Wozniak, Justin M.; Clifford, Ben; Katz, Daniel S.; Foster, Ian: Swift: A language for distributed parallel scripting (2011) ioport
  15. Wu, Qishi; Gu, Yi: Modeling and simulation of distributed computing workflows in heterogeneous network environments (2011) ioport
  16. Yuan, Dong; Yang, Yun; Liu, Xiao; Chen, Jinjun: On-demand minimum cost benchmarking for intermediate dataset storage in scientific cloud workflow systems (2011)
  17. Bittencourt, Luiz Fernando; Madeira, Edmundo R. M.: Towards the scheduling of multiple workflows on computational grids (2010) ioport
  18. Callaghan, Scott; Deelman, Ewa; Gunter, Dan; Juve, Gideon; Maechling, Philip; Brooks, Christopher; Vahi, Karan; Milner, Kevin; Graves, Robert; Field, Edward; Okaya, David; Jordan, Thomas: Scaling up workflow-based applications (2010) ioport
  19. Camarasu-Pop, Sorina; Glatard, Tristan; Mościcki, Jakub T.; Benoit-Cattin, Hugues; Sarrut, David: Dynamic partitioning of GATE Monte-Carlo simulations on EGEE (2010) ioport
  20. Joseph C. Jacob, Daniel S. Katz, G. Bruce Berriman, John Good, Anastasia C. Laity, Ewa Deelman, Carl Kesselman, Gurmeet Singh, Mei-Hui Su, Thomas A. Prince, Roy Williams: Montage: a grid portal and software toolkit for science-grade astronomical image mosaicking (2010) arXiv

1 2 3 next


Further publications can be found at: https://pegasus.isi.edu/publications/