In our modern world, multilingualism is a common phenomenon. By broad definition, the term ‘multilingualism’ is the use of two or more languages, either by a person or by a group of speakers. Though there have appeared debates and countless studies along with the dominance of multilingualism in any given society. It is often agreed upon by many scholars that multilingualism can be both a problem and a resource. This research paper aims at illuminating the tension of unity and conflict in multilingualism and linguistic diversity. In doing so, this research focuses on multilingualism in Africa and possible implication for unity and conflict within the continent. This paper discovers that multilingualism can cause a crisis of identity, language loss, the death of a language. It can lead to violence and ethnic clashes. In some cases, it can help foster unity in a country.