Practical systems such as hybrid power systems are currently implemented around the world. In order to get the system to work properly, the systems usually require their behavior to be maintained or state values to stay within a certain threshold. However, it is difficult to form a perfect mathematical model for describing behavior of the practical systems since there may be some information (uncertainties) that is not observed. Thus, in this article, we studied the stability of an uncertain linear system with a non-differentiable time-varying delay. We constructed Lyapunov-Krasovskii functionals (LKFs) containing several symmetric positive definite matrices to obtain robust finite-time stability (RFTS) and stabilization (RFTU) of the uncertain linear system. With the controller and uncertainties in the considered system, there exist nonlinear terms occurring in the formulation process. Past research handled these nonlinear terms as new variables but this led to some difficulty from a computation point of view. Instead, we applied a novel approach via Cauchy-like matrix inequalities to handle these difficulties. In the end, we present three numerical simulations to show the effectiveness of our proposed theory.