The conventional hydrodenitrogenation method is expensive and involves the use of catalysts and harsh procedures. In the last few years, ionic liquids (ILs) have gained attention as a promising alternative solvent for fuel oil extractive denitrogenation. In this work, the Conductor-like Screening Model for Real Solvents (COSMO-RS) was used to screen 173 potential ILs as solvents for fuel oil. Two ILs (1-ethyl-3-methylimidazolium dicyanamide ([EMIM][N(CN)2]) and 1-ethyl-3-methylimidazolium methanesulfonate ([EMIM][MeSO3])) were selected for experimental investigation. The experimental liquid–liquid extraction of pyrrole (taken as the model nitrogen compound) from n-hexadecane (the model fuel) was conducted at 298 K and 1 atm with feed concentrations of pyrrole ranging from 10 to 50 wt%, using either the two pure ILs or their mixtures with dimethylformamide or ethylene glycol. Moreover, the NRTL model was effectively used to correlate the experimental tie lines. This work shows that the use of a binary mixture of ILs with a conventional solvent results in good selectivity, but has a low capacity for extracting pyrrole compounds. On the other hand, using an IL-IL mixture exhibits good results for both capacity and selectivity. All the ternary systems tested showed positive slopes, indicating that the nitrogen compounds had a higher affinity for the IL and binary mixture extract phase. In fact, the extraction efficiency for all the systems shows promising results. This characteristic is advantageous, as it requires less solvent to remove nitrogen compounds.