In Alzheimer’s disease, ion permeability through the ionic channel formed by Aβ peptides on cellular membranes appears to underlie neuronal cell death. An understanding of the formation mechanism of the toxic ionic channel by Aβ peptides is very important, but remains unclear. Our simulation results demonstrated the dynamics and mechanism of channel formation by Aβ1-28 peptides on the DPPC and POPC membrane by the coarse-grained method. The ionic channel formation is driven by the gyration of the radius and solvent accessible molecular surface area of Aβ1-28 peptides. The ionic channel formation mechanism was explored by the free energy profile based on the distribution of the gyration of the radius and solvent accessible molecular surface area of Aβ1-28 peptides on the fluid membrane. The stability and water permeability of the ionic channel formed by Aβ peptides was investigated by all-atomic model simulation. Our simulation showed that the ionic channel formed by Aβ1-28 peptides is very stable and has a good water permeability. This could help us to understand the pore formation mechanism by Aβ1-28 peptides on the fluidic membrane. It also provides us with a guideline by which to understand the toxicity of Aβ1-28 peptides’ pores to the cell.