Although the UL-94 vertical flame test is often used to evaluate the flammability of polymers based on ignition time and combustion duration parameters, a significant amount of information regarding the time course of combustion is difficult to analyze in detail. Herein, image analysis of the time course of the upper and lower end heights, total area, and color division of flame was performed for polyolefins and polystyrene with different molecular weights in the vertical flame test. The combustion process was classified into two stages: before and after the first drip. In the first stage, the upward spread velocity, oscillation, and color of flame were analyzed. It was assumed that the difference in the fuel production rates or thermal decomposition products depends on the molecular structure. In the second stage, the melt flowability, flame position, and combustion continuity differed vastly depending on the molecular structure or molecular weight.