The type and the properties of the soil can potentially intensify the internal forces on buildings during seismic loads. To predict the effects of the soil parameters on the soil–structure interaction of buildings, it is necessary to consider the soil–structure interaction (SSI) in the modeling process. Therefore, this document aims to evaluate the seismic effect on the maximal displacement and inter-story drift, and evaluate the behavior of buildings under the second-order effect known in the literature as the P-delta effect. For this purpose, three cases of buildings with 5, 10 and 15 stories were modelled using a FLAC 2D finite-difference element calculation software with infinite soil conditions, including five types of base with four types of soil (one cohesive soil and three non-cohesive soils) considering the soil–structure interaction and a fixed base (without soil–structure interaction). According to the results for the above-mentioned boundary, as the height of the building increases and due to the weak properties of the soil, we notice that the maximal displacements and inter-story drift increase considerably. To that purpose, we recommend considering the second-order effect in seismic design, especially for non-cohesive soil.