Reflow is a system for incremental data processing in the cloud. Reflow enables scientists and engineers to compose existing tools (packaged in Docker images) using ordinary programming constructs. Reflow then evaluates these programs in a cloud environment, transparently parallelizing work and memoizing results. Reflow was created at GRAIL to manage our NGS (next generation sequencing) bioinformatics workloads on AWS, but has also been used for many other applications, including model training and ad-hoc data analyses.
References in zbMATH (referenced in 1 article )
Showing result 1 of 1.
- Mokhov, Andrey; Mitchell, Neil; Peyton Jones, Simon: Build systems à la carte: theory and practice (2020)