Volcano
Volcano - an extensible and parallel query evaluation system. To investigate the interactions of extensibility and parallelism in database query processing, we have developed a new dataflow query execution system called Volcano. The Volcano effort provides a rich environment for research and education in database systems design, heuristics for query optimization, parallel query execution, and resource allocation. Volcano uses a standard interface between algebra operators, allowing easy addition of new operators and operator implementations. Operations on individual items, e.g., predicates, are imported into the query processing operators using support functions. The semantics of support functions is not prescribed; any data type including complex objects and any operation can be realized. Thus, Volcano is extensible with new operators, algorithms, data types, and type-specific methods. Volcano includes two novel meta-operators. The choose-plan meta-operator supports dynamic query evaluation plans that allow delaying selected optimization decisions until run-time, e.g., for embedded queries with free variables. The exchange meta-operator supports intra-operator parallelism on partitioned datasets and both vertical and horizontal inter-operator parallelism, translating between demand-driven dataflow within processes and data-driven dataflow between processes. All operators, with the exception of the exchange operator, have been designed and implemented in a single-process environment, and parallelized using the exchange operator. Even operators not yet designed can be parallelized using this new operator if they use and provide the interator interface. Thus, the issues of data manipulation and parallelism have become orthogonal, making Volcano the first implemented query execution engine that effectively combines extensibility and parallelism
Keywords for this software
References in zbMATH (referenced in 22 articles )
Showing results 1 to 20 of 22.
Sorted by year (- Luigi Bellomarini, Georg Gottlob, Emanuel Sallinger: The Vadalog System: Datalog-based Reasoning for Knowledge Graphs (2020) arXiv
- Rompf, Tiark; Amin, Nada: A SQL to C compiler in 500 lines of code (2019)
- Shaikhha, Amir; Dashti, Mohammad; Koch, Christoph: Push versus pull-based loop fusion in query engines (2018)
- Safaei, Ali A.: Real-time processing of streaming big data (2017)
- Akinde, Michael; Böhlen, Michael H.; Chatziantoniou, Damianos; Gamper, Johann: (\theta)-constrained multi-dimensional aggregation (2011) ioport
- Boehm, Matthias; Habich, Dirk; Preissler, Steffen; Lehner, Wolfgang; Wloka, Uwe: Cost-based vectorization of instance-based integration processes (2011) ioport
- Green, Todd J.; Ives, Zachary G.; Tannen, Val: Reconcilable differences (2011)
- Gounaris, Anastasios; Smith, Jim; Paton, Norman W.; Sakellariou, Rizos; Fernandes, Alvaro A. A.; Watson, Paul: Adaptive workload allocation in query processing in autonomous heterogeneous environments (2009) ioport
- Neumann, Thomas; Moerkotte, Guido: Generating optimal DAG-structured query evaluation plans (2009) ioport
- Paton, Norman W.; Buenabad-Chavez, Jorge; Chen, Mengsong; Raman, Vijayshankar; Swart, Garret; Narang, Inderpal; Yellin, Daniel M.; Fernandes, Alvaro A. A.: Autonomic query parallelization using non-dedicated computers: an evaluation of adaptivity options (2009) ioport
- Cornacchia, Roberto; Héman, Sándor; Zukowski, Marcin; de Vries, Arjen P.; Boncz, Peter: Flexible and efficient IR using array databases (2008) ioport
- Neumann, Thomas; Michel, Sebastian: Algebraic query optimization for distributed top-(k) queries (2007) ioport
- Taniar, David; Khaw, Hui Yee; Tjioe, Haorianto Cokrowijoyo; Pardede, Eric: The use of hints in SQL-nested query optimization (2007) ioport
- Wang, Shan; Du, Xiao-Yong; Meng, Xiao-Feng; Chen, Hong: Database research: achievements and challenges (2006) ioport
- Zheng, Xiao-Qing; Chen, Hua-Jun; Wu, Zhao-Hui; Mao, Yu-Xin: Dynamic query optimization approach for semantic database grid (2006) ioport
- Ewen, Stephan; Ortega-Binderberger, Michael; Markl, Volker: A learning optimizer for a federated database management system (2005) ioport
- Ewen, Stephan; Ortega-Binderberger, Michael; Markl, Volker: A learning optimizer for a federated database management system (2005) ioport
- Ewen, Stephan; Ortega-Binderberger, Michael; Markl, Volker: A learning optimizer for a federated database management system (2005) ioport
- Dalvi, Nilesh N.; Sanghai, Sumit K.; Roy, Prasan; Sudarshan, S.: Pipelining in multi-query optimization. (2003)
- Ambite, J. L.; Knoblock, C. A.: Flexible and scalable cost-based query planning in mediators: A transformational approach (2000)