The large volume of data automatically collected by smart card fare systems offers a rich source of information regarding daily human activities with a high resolution of spatial and temporal representation. This provides an opportunity for aiding transport planners and policy-makers to plan transport systems and cities more responsively. However, there are currently limitations when it comes to understanding the secondary activities of individual commuters. Accordingly, in this paper, we propose a framework to detect and infer secondary activities from individuals' daily travel patterns from the smart card data and reduce the use of conventional surveys. First, we proposed a 'heuristic secondary activity identification algorithm', which uses commuters' primary locations (home & work) and the direction (from & to) information to identify secondary activities for individuals. The algorithm provides a high-level classification of the activity types as beforework, midday and after-work activity patterns of individuals. Second, this classification is semantically enriched using Points of Interests to provide meaningful insights into individuals' travel purposes and mobility in an urban environment. Lastly, using the transit data of London as a case study, the model is compared with a volunteer survey to demonstrate its effectiveness and offering a cost-effective method to travel demand research.