In the present study, artificial neural network (ANN) along with heuristic algorithms, namely particle swarm optimization (PSO) and simulated annealing (SA), has been employed to carry out the modeling and optimization procedure of electrical discharge machining (EDM) process on AISI2312 hot worked steel parts. Surface roughness (SR), tool wear rate (TWR) and material removal rate (MRR) are the process quality measures considered as process output characteristics. Determination of a process variables (pulse on and off time, current, voltage and duty factor) combination to minimize TWR and SR and maximize MRR independently (as single objective) and also simultaneously (as multi-criteria) optimization is the main objective of this study. The experimental data are gathered using Taguchi L 36 orthogonal array based on design of experiments approach. Next, the output measures are used to develop the ANN model. Furthermore, the architecture of the ANN has been modified using PSO algorithm. At the last step, in order to determine the best set of process output variables values for a desired set of process quality measures, the developed ANN model is embedded into proposed heuristic algorithms (SA and PSO) with which their derived results have been compared. It is evident that the proposed optimization procedure is quite efficient in modeling (with less than 1% error) and optimization (less than 4 and 7 percent error for single-and multiobjective optimizations, respectively) of EDM process variables.