Automated web service composition is one of the ultimate goals of serviceoriented computing. It loosely couples web services to accommodate users' complex requirements. Evolutionary Computation (EC) techniques combined with AI planning have been successfully proposed to efficiently produce composite services with near-optimal Quality of Semantic Matchmaking (QoSM) and/or Quality of Service (QoS), which measure the satisfaction of the functional and non-functional requirements from users, respectively. Despite some recent progress, both the effectiveness and efficiency of existing approaches need further improvement to enhance the competitive advantage of service providers. The overall goal of this thesis is to propose novel EC-based fully automated service composition approaches that can effectively and efficiently solve challenging singleobjective, multi-objective, and dynamic service composition problems.Firstly, this thesis proposes two novel Estimation of Distribution Algorithm (EDA) based approaches (called EDA-NHM and EDA-EHM) and one memetic EDA-based approach with four different local search operators to single-objective fully automated web service composition that jointly optimizes QoSM and QoS. EDA-NHM and EDA-EHM are proposed with novel permutation-based and DAG-based representations to model the distribution of composition solutions with respect to varied service composition workflows. Two sampling techniques are also studied in EDA-NHM and EDA-EHM to effectively and efficiently sample new promising permutations and functionally valid DAGs, respectively. These two EDA-based approaches are compared to state-of-the-art works. The comparisons reveal that EDA-NHM produces better-quality composite services than EDA-EHM and the state-of-the-art works. On the other hand, EDA-EHM achieves the highest efficiency among all the competing EC-based methods, delivering moderate effectiveness. Furthermore, one proposed memetic approaches built upon EDA-NHM (called MEEDA-LOP) pushes the cutting-edge performance in terms of effectiveness and efficiency.Secondly, this thesis studies two categories of multi-objective service composition problems: one category aims to generate a set of approximated Pareto optimal solutions for users to choose from, while the other category aims to generate multiple composite services for multiple user segments with distinctive preferences on QoSM. To effectively and efficiently handle the first category of problems, a memetic approach based on Non-dominated Sorting Genetic Algorithm II (NSGA-II), called MNSGA2-EDA, is proposed by enhancing NSGA-II with EDA-based local search. The novelty of this method lies in the innovative use of EDA for effective and efficient local improvements, rather than for global exploration. MNSGA2-EDA is compared to state-of-the-art multi-objective works, for studying its performance. We found that MNSGA2-EDA achieves much higher effectiveness and efficiency in finding Pareto optimal solutions. The second category of problems can be naturally treated as multit...