Although the key factor affecting the biocompatibility of IONPs is the core size, there is a lack of regular investigation concerning the impact of the parameter on the toxicity of these nanomaterials. Therefore, such studies were carried out in this paper. Their purpose was to compare the influence of PEG-coated-magnetite NPs with the core of 5, 10 and 30 nm on six carefully selected cell lines. The proliferation rate, viability, metabolic activity, migration activity, ROS levels and cytoskeleton architecture of cells have been evaluated for specified incubation periods. These were 24 and 72-h long incubations with IONPs administered in two doses: 5 and 25 µg Fe/ml. A decrease in viability was observed after exposure to the tested NPs for all the analyzed cell lines. This effect was not connected with core diameter but depended on the exposure time to the nanomaterials. IONPs increased not only the proliferation rate of macrophages—being phagocytic cells—but also, under certain conditions stimulated tumor cell divisions. Most likely, the increase in proliferation rate of macrophages contributed to the changes in the architecture of their cytoskeleton. The growth in the level of ROS in cells had been induced mainly by the smallest NPs. This effect was observed for HEK293T cells and two cancerous lines: U87MG (at both doses tested) and T98G (only for the higher dose). This requires further study concerning both potential toxicity of such IONPs to the kidneys and assessing their therapeutic potential in the treatment of glioblastoma multiforme.