The Unassembled Hyper Matrix (UHM) solver is developed for the efficient solution of large sparse linear systems of equations arising from Finite Element Methods (FEM). The efficiency of UHM solver comes from the direct use of information from an application instead of analyzing a given sparse matrix only. While most sparse direct solvers adopt a black box approach: a sparse linear system of equations is given as input and the solution is returned as output, UHM solver focuses on the problem domain information and the interfaces them. Especially UHM solver outperforms the other sparse direct solvers for the problems that use high order FE approximation. This solver is built on the FLAME library and follows its methodologies.