Automatic Identification and Classification of Software Development Video Tutorial Fragments

Abstract

Software development video tutorials have seen a steep increase in popularity in recent years. Their main advantage is that they thoroughly illustrate how certain technologies, programming languages, etc. are to be used. However, they come with a caveat: there is currently little support for searching and browsing their content. This makes it difficult to quickly find the useful parts in a longer video, as the only options are watching the entire video, leading to wasted time, or fast-forwarding through it, leading to missed information. We present an approach to mine video tutorials found on the web and enable developers to query their contents as opposed to just their metadata. The video tutorials are processed and split into coherent fragments, such that only relevant fragments are returned in response to a query. Moreover, fragments are automatically classified according to their purpose, such as introducing theoretical concepts, explaining code implementation steps, or dealing with errors. This allows developers to set filters in their search to target a specific type of video fragment they are interested in. In addition, the video fragments in CODETUBE are complemented with information from other sources, such as Stack Overflow discussions, giving more context and useful information for understanding the concepts.

Enhancing developer interactions with programming screencasts through accurate code extraction

“…Most of the consecutive frames from a programming screencast are nearly the same, and these nearly-identical frames are of no use for further analysis. Hence, similar to existing techniques [1,11,13,14], the first step of psc2code is to remove such non-informative frames. First, psc2code samples the given programming screencast by extracting the first frame of each second as an image using FFmpeg 1 .…”

System analysis and Design of Tutorial for Teaching Industrial Automatism

“…In addition, it would allow operators to test themselves in order to stay on top of their skills. Indeed, the courseware offers the possibility to "refresh", and to check if they are still able to respond to the demand [10].…”

UIScreens: extracting user interface screens from mobile programming video tutorials

“…YouTube displays some metadata (i.e., title and description, as provided by the video creators) about each video to make it easier for users to understand what a video is about. Unfortunately, this information is often insufficient for a developer to fully understand if a video contains specific information relevant to a programming task [12][13][14]. This is true in the case of developers looking for examples of mobile UI designs, as the only ways to determine if a video contains the right UI are to watch the videos entirely, leading to wasted time, or to skim through them, risking to miss information.…”