Different neurological disorders may lead to speech related problems, due to paralysis in vocal fold or weakness of the related muscles. This may modify the acoustic characteristics of the subject's voice which may provide important information for detecting certain neurological diseases. The vowel phonation which is acoustically informative and uttered by the patient with not much difficulty is collected and various acoustic features are extracted by time domain and frequency domain techniques. The use of all these features for classification may lead to a large feature space, which may lead to complexity. Hence to avoid this, in the present work experimentation is done by fusing different classifiers which are fed with features extracted from different domains. The time domain and frequency domain features are given to Support Vector Machine (SVM) and Gaussian Mixture Model (GMM) respectively, and the intermediate decision of these classifiers is given to another SVM to identify the voice signal as normal or diseased. It is observed that this hybrid classifier model has shown some improvement with a classification accuracy of 91.43% compared to single GMM classifier with an accuracy of classification of 90% with frequency domain features as input.