Accurate simulation is a critical requirement for modern optical systems, but precise theoretical modeling can be challenging due to various factors such as misalignment, theoretical approximations, and instrument errors. This paper presents the black-box simulation method, which addresses these limitations by training the optical system model using the optical field outputs. This approach leads to more accurate simulations, making it possible to effectively train optical Neural Network systems for improved performance.