A fast mixing is critical for subsequent practical development of microfluidic devices, which are often used for assays in the detection of reagents and samples. The present work sets up computational fluid dynamics simulations to explore the flow characteristic and mixing mechanism of fluids in cross-shaped mixers within the laminar regime. First, the effects of increasing an operating parameter on local mixing quality along the microchannels are investigated. It is found that sufficient diffusion cannot occur even though the concentration gradient is large at a high Reynolds number. Meanwhile, a method for calculating local mixing efficiency is also characterized. The mixing efficiency varies exponentially with the flow distance. Second, in order to optimize the cross-shaped mixer, the effects of design parameters, namely aspect ratio, mixing angle and blockage, on mixing quality are captured and the visualization of velocity and concentration distribution are demonstrated. The results show that the aspect ratio and the blockage play an important role in accelerating the mixing process. They can improve the mixing efficiency by increasing the mass transfer area and enhancing the chaotic advection, respectively. In contrast, the inflow angle that affects dispersion length is not an effective parameter. Besides, the surface roughness, which makes the disturbance of fluid flow by roughness more obvious, is considered. Three types of rough elements bring benefits for enhancing mixing quality due to the convection induced by the lateral velocity.