The dialectics of information and communication technologies (ICTs) entail their potential in fostering digital dividends and fomenting digital exclusion. Based on 165 personal interviews with women entrepreneurs of MSMEs in the Ganjam and Gajapati districts of the state of Odisha in India, this study considers the opportunities and challenges regarding the access and use of ICTs. The primary intent of the study is to explore the participants' views on the diversity of ICT use, the relevance of these technologies for their businesses, and the challenges they face while using the digital technologies. Deploying Amartya Sen's Capability Approach (CA) as the primary theoretical lens, this study documents the popularity of "new ICTs" among the respondents, the constraints they face in performing digital transactions, their views on digital exclusion, and the impact of local factors (language barriers and institutional support) on their digital appropriation. Based on these findings, the study emphasises the need for increased availability of business-relevant content on ICT platforms, incorporation of ICT training in ongoing programmes, and explores ways of overcoming the language barriers and promoting effective use of digital payment applications. This study aims at enhancing the ICT-related capability sets of women entrepreneurs in the underdeveloped sub-regions of India.