Humans have a remarkable capacity to learn new motor skills, a process that requires novel muscle activity patterns. Muscle synergies may simplify the generation of muscle patterns through the selection of a small number of synergy combinations. Learning new motor skills may then be achieved by acquiring novel muscle synergies. In a previous study, we used myoelectric control to construct virtual surgeries that altered the mapping from muscle activity to cursor movements. After compatible virtual surgeries, which could be compensated by recombining subject-specific muscle synergies, participants adapted quickly. In contrast, after incompatible virtual surgeries, which could not be compensated by recombining existing synergies, participants explored new muscle patterns, but failed to adapt. Here, we tested whether task space exploration can promote learning of novel muscle synergies, required to overcome an incompatible surgery. Participants performed the same reaching task as in our previous study, but with more time to complete each trial, thus allowing for exploration. We found an improvement in trial success after incompatible virtual surgeries. Remarkably, improvements in movement direction accuracy after incompatible surgeries occurred faster for corrective movements than for the initial movement, suggesting that learning of new synergies is more effective when used for feedback control. Moreover, reaction time was significantly higher after incompatible than after compatible virtual surgeries, suggesting an increased use of an explicit adaptive strategy to overcome incompatible surgeries. Taken together, these results indicate that exploration is important for skill learning and suggest that human participants, with sufficient time can learn new muscle synergies.