Face Retrieval in Large-Scale News Video Datasets

Ngo, Thanh Duc; Vu, Hung; Le, Duy-Dinh; Satoh, Shin’ichi

doi:10.1587/transinf.e96.d.1811

Cited by 12 publications

(21 citation statements)

References 26 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Now we can extract faces from the video shots as in (Ngo et al 2013), designed to be applied on large dataset. The extraction is done in the following steps (illustrated in Fig.…”

Section: Face Detection and Trackingmentioning

confidence: 99%

“…For each face-track, we create a mean face that is a representative face in the VGG feature space (Everingham et al 2006), based on the k-Faces method (Ngo et al 2013). The mean face is a mean point in the feature space described by k sampled faces.…”

Section: Face Detection and Trackingmentioning

confidence: 99%

“…The faces of 139 characters have been annotated during the evaluation campaign of (Ngo et al 2013) giving a ground truth for retrieving matching face-tracks. These faces are the faces of well known people among the Japanese media scene, including celebrities and politicians (Japanese and international), for which we had the highest precision of retrieval and identification.…”

Section: Face Detection and Trackingmentioning

confidence: 99%

See 2 more Smart Citations

When face-tracking meets social networks: a story of politics in news videos

et al. 2016

Self Cite

View full text Add to dashboard Cite

In the age of data processing, news videos are rich mines of information. After all, the news are essentially created to convey information to the public. But can we go beyond what is directly presented to us and see a wider picture? Many works already focus on what we can discover and understand from the analysis of years of news broadcasting. These analysis bring monitoring and understanding of the activity of public figures, political strategies, explanation and even prediction of critical media events. Such tools can help public figures in managing their public image, as well as support the work of journalists, social scientists and other media experts. News analysis can also be seen from the lens of complex systems, gathering many types of entities, attributes and interactions over time. As many public figures intervene in different news stories, a first interesting task is to observe the social interactions between these actors. Towards this goal, we propose to use video analysis to automatise the process of constructing social networks directly from news video archives. In this paper we are introducing a system deriving multiple social networks from face detections in news videos. We present preliminary results obtained from analysis of these networks, by monitoring the activity of more than a hundred public figures. We finally use these networks as a support for political studies and we provide an overview of the political landscape presented by the Japanese public broadcaster NHK over a decade of the 7 PM news archives.

show abstract

“…Now we can extract faces from the video shots as in (Ngo et al 2013), designed to be applied on large dataset. The extraction is done in the following steps (illustrated in Fig.…”

Section: Face Detection and Trackingmentioning

confidence: 99%

Section: Face Detection and Trackingmentioning

confidence: 99%

Section: Face Detection and Trackingmentioning

confidence: 99%

See 1 more Smart Citation

When face-tracking meets social networks: a story of politics in news videos

et al. 2016

Self Cite

View full text Add to dashboard Cite

show abstract

“…1-3). Each face-track is temporally sampled using kfaces [4], and we extract their average point in the OpenFace 128-dimensional feature space [1]. Face-tracks are finally clustered using GreedyRSC [3] (Fig.…”

Section: Description Of the Systemmentioning

confidence: 99%

“…Selecting sections in the timeline (Fig. 2-3) loads a playlist corresponding to the dates of detection (4). For a given date, we display timelines corresponding to topic segmentations (5) and individual face-tracks (6), all interactively linked highlighted independently to scales (7).…”

Section: A Multi-level Visualizationmentioning

confidence: 99%

News Archive Exploration Combining Face Detection and Tracking with Network Visual Analytics

Renoust

Ngo²,

et al. 2016

Proceedings of the 24th ACM International Conference on Multimedia

Self Cite

View full text Add to dashboard Cite

Visual analytics helps analytical reasoning and exploration of complex systems, for which it combines the means of interactive visualization, with the power of data analytics. The recent progress in computer vision techniques opens wide applications in real world video archives. Particularly, recent advances in face detection and recognition have been put under the spotlight. The applications of such techniques are often concern intelligence, or peer recognition in photo posted in social networks. We propose to combine those two domains by demonstrating a visual exploration of over a decade of the news program from the Japanese broadcaster NHK News 7. We derive social networks from face detection and tracking of this large dataset. With the help of a little domain knowledge, we monitor the activity of political public figures and explore the archive. This allows understanding and comparison of the politico-media scene presented by NHK under different Prime Minister's governance. The social networks are interactive, and to explore the multimedia database and its video content.

show abstract