This study aims to investigate the factors affecting on English speech of undergraduate students at the SMIU, Karachi. The study prospects two aspects as outcomes of the study, one to discover what are the major issues and hindrances and another one to find their solutions for developing techniques and skills to gain confidence while speaking English as a second language in ESL classroom and in public. It will further investigate as how to help develop a wonderful speech free from speech anxiety. The study administered Likert Scale as a tool for data collection. Forty participating students were recruited from the department of Computer Science, Sindh Madressatul Islam University, Karachi. Speech anxiety is a common phenomenon amongst the students in the second language classrooms. Second language i.e., English, however, has become the lingua franca of the world. It is no longer the language of only native Britishers and Americans, rather, it is a widely spoken language by most people living in every nook & corner of the world. This study investigates as to how ESL learners turn out as nervous speakers while speaking English. Findings of the study suggest that speech anxiety seems to be an unavoidable phenomenon for ESL learners as the data reveal. In addition, this study is associated with the previous studies that there is a moderate level of Foreign Language Speech Anxiety (FLSA) amongst the Pakistani English speakers. Since English is taught from the primary level and every literate person almost understands and speaks English. Pakistani English language speakers should speak without speech anxiety, though it seems to be a part of human nature being nervous while speaking English as a second language. The students should learn how to manage speech anxiety by welcoming it and try to overcome it not by mindless imitation but by being natural in English speech.