The present work demonstrates the nonlinear finite element analysis (NLFEA) of 13 concentrically and eccentrically loaded short rectangular concrete column specimens reinforced with GFRP and conventional steel bars. GFRP bars are lightweight having the high tensile strength and high corrosion resistance. An NLFEA model for the rectangular concrete specimens was developed using the commercial software ABAQUS Standard and calibrated for different materials and geometric parameters based on the previous experimental test results of the studied specimen. The behavior of reinforced concrete was modelled using the concrete damaged plasticity (CDP) model, the behavior of steel bars was simulated as a bilinear elastoplastic material, and the GFRP bars were considered as a linear elastic material. After the calibration of CDP parameters, the control sample was used for the further numerical parametric analysis to investigate the effect of critical parameters, i.e., the area of concrete (Ac), the compressive strength of concrete (fc′), and the ratio of longitudinal reinforcement (ρl) and transverse reinforcement (ρt) on the load-carrying capacity of columns. The results show that the selected NLFEA model can simulate the behavior of columns accurately and there was good agreement of numerical results obtained from ABAQUS Standard with the experimental results.