This paper presents a new parallel hybrid algorithm combining Particle Swarm Optimization (PSO), Differential Evolution (ED) and Genetic Algorithms (GA) for optimizing unconstrained numerical functions. Basically, PSO and ED evolves independently in our proposal, then they cooperate between them exchanging their best individual, which undergo GA operators locally in order to search different areas in the search space. The results are evaluated concerning the quality of the solution and speedup against six benchmarks functions. The outcomes are compared with GA, PSO and ED in the serial version and with the classical island model of PSO and DE, considering two and four threads. A comparison with a hybrid algorithm is done as well.