This paper proposed a 4-D conservative chaotic system (4-D CCS) with a simple algebraic representation, which has only two quadratic nonlinear terms. The dynamic characteristics of the 4-D CCS were investigated by phase portraits, Poincaré mappings, Lyapunov exponent (LE), bifurcation diagrams, equilibrium points and spectral entropy (SE) complexity algorithm. Alternations between quasi-periodic and chaotic flows were observed by varying parameters and initial values (Hamiltonian energy) in the 4-D CCS. The maximum Lyapunov exponent of the 4-D CCS can reach a high value of 366300 under adjusting appropriate parameters and initial values. The pseudorandom sequences generated by the 4-D CCS successfully passed the NIST test. Additionally, both the electronic circuit and FPGA implementation of the 4-D CCS were carried out, and the experimental results were consistent with the simulation results.