Providing accurate maps of mangroves, where the spatial scales of the mapped features correspond to the ecological structures and processes, as opposed to pixel sizes and mapping approaches, is a major challenge for remote sensing. This study developed and evaluated an object-based approach to understand what types of mangrove information can be mapped using different image datasets (Landsat TM, ALOS AVNIR-2, WorldView-2, and LiDAR). We compared and contrasted the ability of these images to map five levels of mangrove features, including vegetation boundary, mangrove stands, mangrove zonations, individual tree crowns, and species communities. We used the Moreton Bay site in Australia as the primary site to develop the classification rule sets and Karimunjawa Island in Indonesia to test the applicability of the rule sets. The results demonstrated the effectiveness of a conceptual hierarchical model for mapping specific mangrove features at discrete spatial scales. However, the rule sets developed in this study require modification to map similar mangrove features at different locations or when using image data acquired by different sensors. Across the hierarchical levels, smaller object sizes (i.e., tree crowns) required more complex classification rule sets. Incorporation of contextual information (e.g., distance and elevation) increased the overall mapping accuracy at the mangrove stand level (from 85% to 94%) and mangrove zonation level (from 53% to 59%). We found that higher image spatial resolution, larger object size, and fewer land-cover classes result in higher mapping accuracies. This study highlights the potential of selected images and mapping techniques to map mangrove features, and provides guidance for how to do this effectively through multi-scale mangrove composition mapping.