The Apollo Program is one of the most significant benchmarks for technology and innovation in human history. The previously introduced UTD-CRSS Fearless Steps initiative resulted in the digitization of the original analog audio tapes recorded during the Apollo Space Missions. The entire speech data for the Apollo 11 Mission is now being made publicly available with the release of the Fearless Steps Corpus. This corpus consists of a cumulative 19,000 hours of conversational speech spanning over thirty time-synchronized channels. With over six hundred speakers, the corpus has a rich collection of information which can be beneficial for research and advancement in the speech and language community. Recent efforts on this data have led to the generation of pipeline diarization transcripts for the entire speech corpus. Research has also been done to address speech and natural language tasks such as speech activity detection, speech recognition, and sentiment analysis. This paper provides an overview of the Fearless Steps Corpus and highlights the factors that make the processing of this data a challenging problem. To promote further development of algorithms for naturalistic data, five challenge tasks are also organized. We also describe the challenge tasks with details on a fully transcribed subset of the corpus, and initial results achieved by our systems.

The 2019 FEARLESS STEPS (FS-1) Challenge is an initial step to motivate a streamlined and collaborative effort from the speech and language community towards addressing massive naturalistic audio, the first of its kind. The Fearless Steps Corpus is a collection of 19,000 hours of multi-channel recordings of spontaneous speech from over 450 speakers under multiple noise conditions. A majority of the Apollo Missions original analog data is unlabeled and has thus far motivated the development of both unsupervised and semi-supervised strategies. This edition of the challenge encourages the development of core speech and language technology systems for data with limited groundtruth/low resource availability and is intended to serve as the "First Step" towards extracting high-level information from such massive unlabeled corpora. In conjunction with the Challenge, 11,000 hours of synchronized 30-channel Apollo-11 audio data has also been released to the public by CRSS-UTDallas. We describe in this paper the Fearless Steps Corpus, Challenge Tasks, their associated baseline systems, and results. In conclusion, we also provide insights gained by the CRSS-UTDallas team during the inaugural Fearless Steps Challenge.

No abstract

The Fearless Steps Initiative by UTDallas-CRSS led to the digitization, recovery, and diarization of 19,000 hours of original analog audio data, as well as the development of algorithms to extract meaningful information from this multi-channel naturalistic data resource. The 2020 FEARLESS STEPS (FS-2) Challenge is the second annual challenge held for the Speech and Language Technology community to motivate supervised learning algorithm development for multi-party and multi-stream naturalistic audio. In this paper, we present an overview of the challenge sub-tasks, data, performance metrics, and lessons learned from Phase-2 of the Fearless Steps Challenge (FS-2). We present advancements made in FS-2 through extensive community outreach and feedback. We describe innovations in the challenge corpus development, and present revised baseline results. We finally discuss the challenge outcome and general trends in system development across both phases (Phase FS-1 Unsupervised, and Phase FS-2 Supervised) of the challenge, and its continuation into multi-channel challenge tasks for the upcoming Fearless Steps Challenge Phase-3.

Between 1963 and 1972, a massive team of dedicated scientists, engineers, and specialists at the NASA Mission Control Center (MCC) worked seamlessly together in a cohesive manner to successfully carry out multiple manned missions to the moon. All communications between personnel were carried out over multiple inter-connected audio channels and recorded on two 30-track analog tapes. Digitization of the entire Apollo-11 mission tapes made possible through the UTDallas-CRSS Fearless Steps (FS) initiative contains the recordings of all the crew members including the three astronauts. With over 600 speakers in constant communication ensuring the astronauts’ safety throughout the mission, the success of the Apollo missions can be attributed largely to the MCC crew members. The focus of this effort is thus, to analyze their high-level group dynamics and intricate communication characteristics and gain insight into the success parameters involved in such large-scale time-critical operations. The 100 hour FS Challenge corpus highlights multiple salient moments like Lift-Off and Lunar-Landing and poses its’ own challenges for core speech tasks. This effort aims at analyzing spontaneous multi-speaker conversations in recordings often degraded by various noise types. Analysis of speech characteristics under varying stress, overlap, and noise conditions are observed to develop novel speech-activity and speaker models. These domain-specific models are leveraged to develop state-of-the-art SLT systems.