Background Non-invasive mechanical ventilation (NIV) has become an alternative to an invasive artificial airway for the management of acute respiratory failure (ARF). NIV failure causes delayed intubation, which eventually has been associated with increased morbidity and mortality. This study aimed to develop the clinical scoring system of NIV failure in ARF patients. Methods This study was a diagnostic, retrospectively cross-sectional, and exploratory model at the Emergency Medicine Department in Ramathibodi Hospital between February 2017 and December 2017. We included all of the acute respiratory failure patients aged >18 years and received non-invasive ventilation (NIV). Clinical factors associated with NIV failure were recorded. The predictive model and prediction score for NIV failure were developed by multivariable logistic regression analysis. Result A total of 329 acute respiratory failure patients have received NIV success (N = 237) and failure (N = 92). This study showed that NIV failure was associated with heart rate > 110 bpm, systolic BP < 110 mmHg, SpO2 < 90%, arterial pH < 7.30 and serum lactate. The clinical scores were classified into three groups: low, moderate, and high. Conclusion We suggested that the novel clinical scoring of the NIV failure in this study may use as a good predictor for NIV failure in the emergency room.