Personalized weather information for low-literate farmers using multimodal dialog systems

Qasim, Muhammad; Zia, Haris Bin; Athar, Awais; Habib, Tufail; Raza, Agha Ali

doi:10.1007/s10772-021-09806-2

Cited by 4 publications

(2 citation statements)

References 40 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The most important thing about virtual reality is the construction of virtual environment, i.e., virtual world, which not only pays attention to multiple media elements such as text, image, sound, language, animation, etc. but more importantly, emphasizes the synthesis of various media elements to constitute a 3D sensory world with high approximation to the real environment ( Qasim et al, 2021 ). To obtain a better immersion, this chapter implements the construction of a virtual space configuration system in the Unity3D engine based on a splicing screen, Kinect, and a camera.…”

Section: Intelligent Augmented Multimodal Human Art Pose Recognition and Interaction Analysismentioning

confidence: 99%

Multimodal Art Pose Recognition and Interaction With Human Intelligence Enhancement

Liu

Dang

2021

Front. Psychol.

View full text Add to dashboard Cite

This paper provides an in-depth study and analysis of human artistic poses through intelligently enhanced multimodal artistic pose recognition. A complementary network model architecture of multimodal information based on motion energy proposed. The network exploits both the rich information of appearance features provided by RGB data and the depth information provided by depth data as well as the characteristics of robustness to luminance and observation angle. The multimodal fusion is accomplished by the complementary information characteristics of the two modalities. Moreover, to better model the long-range temporal structure while considering action classes with sub-action sharing phenomena, an energy-guided video segmentation method is employed. And in the feature fusion stage, a cross-modal cross-fusion approach is proposed, which enables the convolutional network to share local features of two modalities not only in the shallow layer but also to obtain the fusion of global features in the deep convolutional layer by connecting the feature maps of multiple convolutional layers. Firstly, the Kinect camera is used to acquire the color image data of the human body, the depth image data, and the 3D coordinate data of the skeletal points using the Open pose open-source framework. Then, the action automatically extracted from keyframes based on the distance between the hand and the head, and the relative distance features are extracted from the keyframes to describe the action, the local occupancy pattern features and HSV color space features are extracted to describe the object, and finally, the feature fusion is performed and the complex action recognition task is completed. To solve the consistency problem of virtual-reality fusion, the mapping relationship between hand joint point coordinates and the virtual scene is determined in the augmented reality scene, and the coordinate consistency model of natural hand and virtual model is established; finally, the real-time interaction between hand gesture and virtual model is realized, and the average correct rate of its hand gesture reaches 99.04%, which improves the robustness and real-time interaction of hand gesture recognition.

show abstract

Section: Intelligent Augmented Multimodal Human Art Pose Recognition and Interaction Analysismentioning

confidence: 99%

Multimodal Art Pose Recognition and Interaction With Human Intelligence Enhancement

Liu

Dang

2021

Front. Psychol.

View full text Add to dashboard Cite

show abstract

“…The main barriers are lack of technical infrastructure (Mehrabi et al, 2020), lack of access to digital tools and services, lack of ease of use for non-tech-savvy farmers, and lack of design that is targeted for low-literate and marginal groups. Recent studies show that mobile phone-based dissemination of information as a service for smallholders can have a positive impact in promoting farm management practices (Djido et al, 2021), deliver advice as an automated advisory service that collects household data to improve advice over time (Steinke et al, 2019), and use of speech-based services as a viable way for providing information to low-literate farmers (Qasim et al, 2021). The access and availability gaps and challenges with technology (e.g., lack of connectivity in rural areas) will disappear over time.…”

Section: Introductionmentioning

confidence: 99%

Data Collection Smart and Simple: Evaluation and Metanalysis of Call Data From Studies Applying the 5Q Approach

Eitzinger

2021

Front. Sustain. Food Syst.

View full text Add to dashboard Cite

Agricultural development projects often struggle to show impact because they lack agile and cost-effective data collection tools and approaches. Due to the lack of real-time feedback data, they are not responsive to emerging opportunities during project implementation and often miss the needs of beneficiaries. This study evaluates the application of the 5Q approach (5Q). It shows findings from analyzing more than 37,000 call log records from studies among five countries. Results show that response rate and completion status for interactive voice response (IVR) surveys vary between countries, survey types, and survey topics. The complexity of question trees, the number of question blocks in a tree, and the total call duration are relevant parameters to improve response and survey completion rate. One of the main advantages of IVR surveys is low cost and time efficiency. The total cost for operating 1,000 calls of 5 min each in five countries was 1,600 USD. To take full advantage of 5Q, questions and question-logic trees must follow the principle of keeping surveys smart and simple and aligned to the project's theory of change and research questions. Lessons learned from operating the IVR surveys in five countries show that the response rate improves through quality control of the phone contact database, using a larger pool of phone numbers to reach the desired target response rate, and using project communication channels to announce the IVR surveys. Among other things, the respondent's first impression is decisive. Thus, the introduction and the consent request largely determine the response and completion rate.

show abstract

Investigating the dependability of Weather Forecast Application: A Netnographic study

Otuu

2023

Proceedings of the 35th Australian Computer-Human Interaction Conference

View full text Add to dashboard Cite

Personalized weather information for low-literate farmers using multimodal dialog systems

Cited by 4 publications

References 40 publications

Multimodal Art Pose Recognition and Interaction With Human Intelligence Enhancement

Multimodal Art Pose Recognition and Interaction With Human Intelligence Enhancement

Data Collection Smart and Simple: Evaluation and Metanalysis of Call Data From Studies Applying the 5Q Approach

Investigating the dependability of Weather Forecast Application: A Netnographic study

Contact Info

Product

Resources

About