In this paper we share our experience implementing a CALL project with first year, lower level, non-English major, university students, using two CALL packages popular in Japan: DynEd and ALC. In addition to comparing the pros and cons of both, we will also discuss how the project was launched and how it evolved over time. Implementing commercial CALL software in a classroom setting involved a number of challenges, both technical and pedagogical, necessitating a variety of adaptations to suit the needs of both learners and the institution. Along with describing how changes were made, both in our methods of implementation and how the software was used, we also share our process of dealing with two key issues that arose: student motivation and learner assessment. We hope that by recounting our entire experience with this project, as well as sharing results from a series of student surveys, we will provide ideas for other teachers and faculty departments interested in introducing CALL projects with lower-level students.