Losing Confidence in Quality: Unspoken Evolution of Computer Vision Services

Cummaudo, Alex; Vasa, Rajesh; Grundy, John; Abdelrazek, Mohamed; Cain, Andrew

doi:10.1109/icsme.2019.00051

Cited by 22 publications

(29 citation statements)

References 30 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…According to Cummaudo et al [19] and Hosseini et al [20], the development of intelligent services differs from the usual web services, as they are developed with components based on artificial intelligence (AI).…”

Section: Intelligent Servicesmentioning

confidence: 99%

A Literature Review on Intelligent Services Applied to Distance Learning

et al. 2021

View full text Add to dashboard Cite

Distance learning has assumed a relevant role in the educational scenario. The use of Virtual Learning Environments contributes to obtaining a substantial amount of educational data. In this sense, the analyzed data generate knowledge used by institutions to assist managers and professors in strategic planning and teaching. The discovery of students’ behaviors enables a wide variety of intelligent services for assisting in the learning process. This article presents a literature review in order to identify the intelligent services applied in distance learning. The research covers the period from January 2010 to May 2021. The initial search found 1316 articles, among which 51 were selected for further studies. Considering the selected articles, 33% (17/51) focus on learning systems, 35% (18/51) propose recommendation systems, 26% (13/51) approach predictive systems or models, and 6% (3/51) use assessment tools. This review allowed for the observation that the principal services offered are recommendation systems and learning systems. In these services, the analysis of student profiles stands out to identify patterns of behavior, detect low performance, and identify probabilities of dropouts from courses.

show abstract

Section: Intelligent Servicesmentioning

confidence: 99%

A Literature Review on Intelligent Services Applied to Distance Learning

et al. 2021

View full text Add to dashboard Cite

show abstract

“…According to Cummaudo et al [14] and Hosseini et al [15], the development of intelligent services differs from the usual web services, as they are developed with components based on artificial intelligence (AI).…”

Section: Intelligent Servicesmentioning

confidence: 99%

“…The predictions performed by the intelligent services focus only on training data sets and the results obtained are presented as probabilities that the inference satisfies one or more labels in the training data [14].…”

Section: Intelligent Servicesmentioning

confidence: 99%

See 1 more Smart Citation

A Literature Review on Intelligent Services Applied to Distance Learning

Silva¹,

Dias²,

Rigo³

et al. 2021

Preprint

View full text Add to dashboard Cite

Distance learning has assumed a relevant role in the Educational scenario. The use of Virtual Learning Environments contributes to obtain a substantial amount of educational data. In this sense, the analyzed data generate knowledge used by institutions to assist managers and professors in strategic planning and teaching. The discovery of students’ behaviors enables a wide variety of intelligent services for assisting in the learning process. This article presents a literature review in order to identify the intelligent services applied in distance learning. The research covers the period from January 2010 to May 2021. The initial search found 1,316 articles, among which 51 were selected for further studies. Considering the selected articles, 33% (17/51) focus on learning systems, 35% (18/51) propose recommendation systems, 26% (13/51) approach predictive systems or models, and 6% (3/51) use assessment tools. This review allowed to observe that the principal services offered are recommendation systems and learning systems. In these services, the analysis of student profiles stands out to identify patterns of behavior, detect low performance and identify probabilities of dropouts from courses.

show abstract

“…However, unlike traditional web services, the functionality of these intelligent services is dependent on a set of assumptions unique to ML [6]. These assumptions are based on the data used to train ML algorithms, the choice of algorithm, and the choice of data processing stepsÐmost of which are not documented.…”

mentioning

confidence: 99%

Threshy: supporting safe usage of intelligent web services

Cummaudo

Barnett

Vasa

et al. 2020

Proceedings of the 28th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Softw

Self Cite

View full text Add to dashboard Cite

Increased popularity of 'intelligent' web services provides endusers with machine-learnt functionality at little effort to developers. However, these services require a decision threshold to be set which is dependent on problem-specific data. Developers lack a systematic approach for evaluating intelligent services and existing evaluation tools are predominantly targeted at data scientists for pre-development evaluation. This paper presents a workflow and supporting tool, Threshy, to help software developers select a decision threshold suited to their problem domain. Unlike existing tools, Threshy is designed to operate in multiple workflows including pre-development, pre-release, and support. Threshy is designed for tuning the confidence scores returned by intelligent web services and does not deal with hyper-parameter optimisation used in ML models. Additionally, it considers the financial impacts of false positives. Threshold configuration files exported by Threshy can be integrated into client applications and monitoring infrastructure. Demo: https://bit.ly/2YKeYhE. CCS CONCEPTS • Information systems → Web services; • Computing methodologies → Artificial intelligence; • Software and its engineering → Designing software; Software post-development issues.

show abstract

Losing Confidence in Quality: Unspoken Evolution of Computer Vision Services

Cited by 22 publications

References 30 publications

A Literature Review on Intelligent Services Applied to Distance Learning

A Literature Review on Intelligent Services Applied to Distance Learning

A Literature Review on Intelligent Services Applied to Distance Learning

Threshy: supporting safe usage of intelligent web services

Contact Info

Product

Resources

About