Multimodal human behavior analysis

Song, Yang; Morency, Louis–Philippe; Davis, Randall

doi:10.1145/2388676.2388684

Cited by 45 publications

(2 citation statements)

References 10 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Fortunately, studies on collaborative learning and communications can be leveraged to objectively assess teamwork skills [37]. Furthermore, advancements in HCI and sensors technologies have paved the way for the use of multimodal data to provide a reliable assessment of human behavior [38], through quantitative measures of several dimensions of collaboration [39].…”

Section: Introductionmentioning

confidence: 99%

Design of a Desktop Virtual Reality-Based Collaborative Activities Simulator (ViRCAS) to Support Teamwork in Workplace Settings for Autistic Adults

Amat

Adiani

Tauseef

et al. 2023

IEEE Trans. Neural Syst. Rehabil. Eng.

View full text Add to dashboard Cite

Autistic adults possess many skills sought by employers, but may be at a disadvantage in the workplace if social-communication differences negatively impact teamwork. We present a novel collaborative virtual reality (VR)-based activities simulator, called ViRCAS, that allows autistic and neurotypical adults to work together in a shared virtual space, offering the chance to practice teamwork and assess progress. ViRCAS has three main contributions: 1) a new collaborative teamwork skills practice platform; 2) a stakeholder-driven collaborative task set with embedded collaboration strategies; and 3) a framework for multimodal data analysis to assess skills. Our feasibility study with 12 participant pairs showed preliminary acceptance of ViRCAS, a positive impact of the collaborative tasks on supported teamwork skills practice for autistic and neurotypical individuals, and promising potential to quantitatively assess collaboration through multimodal data analysis. The current work paves the way for longitudinal studies that will assess whether the collaborative teamwork skill practice that ViRCAS provides also contributes towards improved task performance.

show abstract

Section: Introductionmentioning

confidence: 99%

Design of a Desktop Virtual Reality-Based Collaborative Activities Simulator (ViRCAS) to Support Teamwork in Workplace Settings for Autistic Adults

Amat

Adiani

Tauseef

et al. 2023

IEEE Trans. Neural Syst. Rehabil. Eng.

View full text Add to dashboard Cite

show abstract

“…Today, there are more than a billion smart phones in use and millions of users are using sensors for capturing their individual activity [8]. In this paper, we use the communication data collected by smart phones to monitor individual's social behavior and how it is related to their productivity.…”

Section: Introductionmentioning

confidence: 99%

Connecting Productivity with Social Capital via Daily Mobile Phone Logs

Padmaja

Prasad²,

Sunitha³

2016

View full text Add to dashboard Cite

Human behavior and their social interactions can be quantified and modeled with the use of smart phones and any wearable badges which senses and captures real-life interactions. In traditional social sciences, such information was gathered by conducting surveys. However in digital era, smart phones are regarded as a popular tool which automatically senses much human information to quantify our lives. Reality mining gives a clear picture of a human being and its social relations. Social Network Analysis (SNA) is a powerful research tool which provides a comprehensive analysis on ego-alters communications with their individual productivity within a community. In this paper, various popular measures of social network analysis have used to study a closed community through their mobile call logs for a period of time. We experimented various social network measures both on daily basis and also over a period of time. The pattern shows that the relationships and interaction between ego-alter ties have more productive benefits. Using Pearsoncorrelation analysis, we observed that significant (positive) correlation exists between various network properties and their productivity. Results showed that degree (size) has the strongest positive correlation with average productivity, followed by effective size, efficiency, constraint, hierarchy, and k-core of an individual. Density and betweenness centrality have a weak, negative correlation with productivity. Hence social capital has a significant influence on human productivity.

show abstract

Multimodal query-level fusion for efficient multimedia information retrieval

Sattari

Yazıcı

2018

Int. J. Intell. Syst.

View full text Add to dashboard Cite

Managing a large volume of multimedia data containing various modalities such as visual, audio, and text reveals the necessity for efficient methods for modeling, processing, storing, and retrieving complex data. In this paper, we propose a fusion‐based approach at the query level to improve query retrieval performance of multimedia data. We discuss various flexible query types including the combination of content as well as concept‐based queries that provide users with the ability to efficiently perform multimodal querying. We have carried out a number of experiments on a video database to show the efficiency of our approach for various types of queries. Our experimental results show that our query‐level fusion approach presents a notable improvement in retrieval performance especially for the concept‐based queries.

show abstract

Multimodal human behavior analysis

Cited by 45 publications

References 10 publications

Design of a Desktop Virtual Reality-Based Collaborative Activities Simulator (ViRCAS) to Support Teamwork in Workplace Settings for Autistic Adults

Design of a Desktop Virtual Reality-Based Collaborative Activities Simulator (ViRCAS) to Support Teamwork in Workplace Settings for Autistic Adults

Connecting Productivity with Social Capital via Daily Mobile Phone Logs

Multimodal query-level fusion for efficient multimedia information retrieval

Contact Info

Product

Resources

About