The role of organic fertilizer is essential as an ameliorant of soil for tobacco cultivation. This study aimed to determine the effect of organic fertilizer types and N fertilizer on soil chemical characteristics, yield, and quality of tobacco. The study was carried out in the field experimental station, located in Glapansari village of Temanggung in 2017. The research was arranged in a split-plot design with two factors and three replications. The first factor as the main plot is two organic fertilizer types (vermicompost and manure). The second factor as the subplot is N fertilizer consisting of three levels (90, 120, and 150 kg N ha−1). The result showed that the effect of vermicompost and manure was not significantly different on soil chemicals, except on soil C content. At the same level of N rate, vermicompost gave a higher tobacco yield than manure fertilizer. Vermicompost with the lowest N level (90 kg kg N ha−1) produced a high tobacco crop index (crop value index). Vermicompost can reduce inorganic N fertilizer input and could be used as an ameliorant of tobacco dryland.