Ship ballast water contains high concentration of plankton, bacteria, and other microorganisms. If the huge amount of ballast water is discharged without being inactivated, it will definitely spell disaster to the marine environment. Microalgae is the most common species exiting in ballast water, so the detection of the concentration and viability of microalgae is a very important issue. The traditional methods of detecting microalgae in ballast water were costly and need the help of bulky equipment. Herein, a novel method based on microalgae cell intracellular chlorophyll fluorescence (CF) imaging combines with cell bright field (BF) microscopy was proposed. The geometric features of microalgae cells were obtained by BF image, and the cell viability was obtained by CF image. The two images were fused through the classic image registration algorithm to achieve simultaneous detection of the viability and concentration of microalgae cells. Furthermore, a low-cost, miniaturized CF/BF microscopy imaging prototype system based on the above principles was designed. In order to verify the effectiveness of the proposed method, four typical microalgae in ballast water (Platymonas, Pyramimonas sp., Chrysophyta, and Prorocentrum lima) were selected as the samples. The experimental results show that the self-developed prototype can quickly and accurately determine the concentration and the viability of microalgae cells in ship ballast water based on the dual images of BF and CF, and the detection accuracy is equivalent to that of commercial microscope. It was the first time to simultaneously detect the viability and concentration of microalgae cells in ship ballast water using the method that combining the fluorescence and bright field images; moreover, a miniaturized microscopic imaging prototype was developed. Those findings expected to contribute to the microalgae detection and ship ballast water management.