Details

Autor(en) / Beteiligte

• Huang, Zijie
• Yu, Huiqun
• Fan, Guisheng
• Shao, Zhiqing
• Li, Mingchen
• Liang, Yuguo

Titel

Aligning XAI explanations with software developers’ expectations: A case study with code smell prioritization

Ist Teil von

• Expert systems with applications, 2024-03, Vol.238, p.121640, Article 121640

Ort / Verlag

Elsevier Ltd

Erscheinungsjahr

2024

Link zum Volltext

Quelle

Alma/SFX Local Collection

Beschreibungen/Notizen

• EXplainable Artificial Intelligence (XAI) aims at improving users’ trust in black-boxed models by explaining their predictions. However, XAI techniques produced unreasonable explanations for software defect prediction since expected outputs (e.g., causes of bugs) were not captured by features used to build models. To set aside feature engineering limitations and evaluate whether XAI could adapt to developers, we exploit XAI for code smell prioritization (i.e., predicting criticalities of sub-optimal coding practices and design choices), whose features could capture developers’ major expectations. We assess the gap between XAI explanations and developers’ expectations in terms of (1) the accuracy of prediction, (2) the coverage of explanations on expectations, and (3) the complexity of explanations. We also narrow the gap by preserving the features related to developers’ expectations as much as possible in feature selection. We find that XAI can explain smells with simpler causes in top 3 to 5 features. Complex smells can be explained in around 10 features, which need more expertise to interpret. Selecting features adapting to the developers’ expectations improves coverage by 5% to 29%, with almost no negative impact on accuracy and complexity. Results also highlight the need of dividing coarse-grained prediction targets and developing fine-grained feature engineering. •We summarize the concerns of developers related to code smell criticality.•We verify the gap exists between XAI explanation and developers’ expectations.•We discover that the gap could be narrowed by adapting to developers.•We conclude that inspecting top-5 important features is sufficient for simple issues.•We outline the challenges and opportunities of XAI for code smell prioritization.