A hyperchaotic system is often used to generate secure keys or carrier wave for secure communication and the realistic hyperchaotic circuit often is made of capacitor, nonlinear resistor unit and induction coil. Parameters are often fixed in these hyperchaotic circuits and the hyperchaotic property of the system can be estimated by using a scheme of synchronization and time series analysis. In this paper, a time-varying hyperchaotic system is proposed by introducing changeable electric power source into the circuit; the changeable electric power source is combined with induction coil or capacitor in series to generate changeable output signals to excite the system. The diagrams of improved circuit are illustrated and critical parameters in experimental circuits are presented; the Lyapunov exponent spectrum vs. external applied electric power source is calculated. It is confirmed that the improved circuit always holds two positive Lyapunov exponents when the external electric power source works, and the chaotic attractors are much too different from the original one; thus, a more changeable hyperchaotic system is constructed in experiment.