In recent years, with the development of unmanned platforms, unmanned surface vehicles (USV) are attracting more and more attention. Compared to ordinary ships, USV have a smaller volume and faster speed, so their collision avoidance system (CAS) should have better responsiveness and stability. The paper describes a method that is based on finite control set model predictive control (FCS-MPC). A finite control set is generated by more practical control commands: the thruster speed and propulsion angle of the USV. The method is conceptually and computationally simple and yet quite versatile, as it can account for the dynamics of the USV, steering and propulsion system. Based on the theory of FCS-MPC, a safe and fast CAS is proposed, and it is verified in different static and dynamic environments. The real environment model for collision avoidance is established by extracting the environment data from the electronic chart. The result shows that the method is effective and can control the USV to sail safely and quickly in complex real scenarios with multiple dynamic obstacles.