No abstract

No abstract

Although modern machine learning and deep learning methods allow for complex and in-depth data analytics, the predictive models generated by these methods are often highly complex, and lack transparency. Explainable AI (XAI) methods are used to improve the interpretability of these complex models, and in doing so improve transparency. However, the inherent fitness of these explainable methods can be hard to evaluate. In particular, methods to evaluate the fidelity of the explanation to the underlying black box require further development, especially for tabular data. In this paper, we (a) propose a three phase approach to developing an evaluation method; (b) adapt an existing evaluation method primarily for image and text data to evaluate models trained on tabular data; and (c) evaluate two popular explainable methods using this evaluation method. Our evaluations suggest that the internal mechanism of the underlying predictive model, the internal mechanism of the explainable method used and model and data complexity all affect explanation fidelity. Given that explanation fidelity is so sensitive to context and tools and data used, we could not clearly identify any specific explainable method as being superior to another.

No abstract

This study aims to understand the effects that role‐diverse online communities have on informal carers, particularly in providing support. Australian Facebook communities used to support those involved in the National Disability Insurance Scheme (NDIS) were explored. Social network analysis of an NDIS‐centred community was conducted, based on 909 publicly visible interactions that occurred in May–June and August–September 2019. Two managers of informal NDIS communities were interviewed, the transcripts of which were analysed using NVivo. Results from the two analyses suggest that both an individual carer's attributes and the collective attributes of the network defined the capability of the network to support the carer, often depending on the experiences and expertise of those offering support. Support was unconstrained by role, though differing goals and expectations often impeded collaboration between roles. The outcomes of support provision were shown to affect not only individuals but also the collective network. However, while effective, community spaces currently lack organisational backing and resources available to informal communities are constrained. Findings drawn from this study, which we believe are applicable to a broader, international context, are three‐fold. Firstly, it is recommended that informal support communities clearly define purpose and create multiple channels to ensure that all participants can meet their needs. Secondly, the benefits of participation to organisations should be further explored. Finally, the use of social network analysis as a method in this study has provided significant insights into the communication patterns and activities of the community under study. Future use of SNA in similar studies may provide further insight into the effectiveness and interactions of community‐based support methods.