EpicFlow: Edge-Preserving Interpolation of Correspondences for Optical Flow. We propose a novel approach for optical flow estimation , targeted at large displacements with significant oc-clusions. It consists of two steps: i) dense matching by edge-preserving interpolation from a sparse set of matches; ii) variational energy minimization initialized with the dense matches. The sparse-to-dense interpolation relies on an appropriate choice of the distance, namely an edge-aware geodesic distance. This distance is tailored to handle occlusions and motion boundaries -- two common and difficult issues for optical flow computation. We also propose an approximation scheme for the geodesic distance to allow fast computation without loss of performance. Subsequent to the dense interpolation step, standard one-level variational energy minimization is carried out on the dense matches to obtain the final flow estimation. The proposed approach, called Edge-Preserving Interpolation of Correspondences (EpicFlow) is fast and robust to large displacements. It significantly outperforms the state of the art on MPI-Sintel and performs on par on Kitti and Middlebury.
Keywords for this software
References in zbMATH (referenced in 8 articles )
Showing results 1 to 8 of 8.
- Duran, Joan; Navarro, Julia; Buades, Antoni: Variational densification and refinement of registration maps (2021)
- Ranjan, Anurag; Hoffmann, David T.; Tzionas, Dimitrios; Tang, Siyu; Romero, Javier; Black, Michael J.: Learning multi-human optical flow (2020)
- Farhan, Erez: Highly accurate matching of weakly localized features (2019)
- Pengpeng Liu, Irwin King, Michael R.Lyu, Jia Xu: DDFlow: Learning Optical Flow with Unlabeled Data Distillation (2019) arXiv
- Wang, Song; Wang, Zengfu: Optical flow estimation with occlusion detection (2019)
- Kuzmin, A. I.: Learning the regularization operator for the optical flow problem (2018)
- E. Ilg, N. Mayer, T. Saikia, M. Keuper, A. Dosovitskiy, T. Brox: FlowNet 2.0: Evolution of Optical Flow Estimation with Deep Networks (2016) arXiv
- Fortun, Denis; Bouthemy, Patrick; Kervrann, Charles: A variational aggregation framework for patch-based optical flow estimation (2016)