The objective of this study was to assess the species composition, abundance and habitat association of non-volant small mammals from grassland, Acacia woodland, farmland, riverine forest, bushland and wooded grassland habitats in Gibe Sheleko National Park, southwestern Ethiopia. Data were collected using 49 Sherman live traps in 70 × 70 m sized girds and visual observations from December 2018 to August 2020. A total of 937 small mammals belonging to 10 species were captured and directly identified. The identified small mammal species and their relative abundance include Arvicanthis niloticus (7.04%), Crocidura olivieri (1.92%), Grammomys dolichurus (3.84%), Lemniscomys striatus (10.25%), Mastomys awashensis (24.55%), Mastomys natalensis (33.83%), Mus tenellus (0.85%), Myomys fumatus (6.30%), Rattus rattus (4.70%) and Stenocephalemys albipes (6.72%). Hystrix cristata, Xerus rutilus and Tachyoryctes splendens were documented through observation. The highest number of species ( 6) was registered at farmland and wooded grassland followed by bushland and riverine forest (5) and Acacia woodland and grassland (4). Lemniscomys striatus, M. awashensis and M. natalensis were common in all habitats. More, 216 (23.05%) individuals were recorded in farmland, while the least, 111 (11.85%) were recorded in Acacia woodland.The study area has various topographical land settings additional study is needed using different traps.