چهار اصل هوش مصنوعی تبیین‌پذیر

• [90] Shane T. Mueller, Robert R. Hoffman, William Clancey, Abigail Emrey, and Gary Klein. Explanation in Human-AI Systems: A Literature Meta-Review, Synopsis of Key Ideas and Publications, and Bibliography for Explainable AI. arXiv:1902.01876 [cs] , فوریه ۲۰۱۹ (بهمن ۱۳۹۷ تا اسفند ۱۳۹۷). URL http://arxiv.org/abs/1902.01876. arXiv: 1902.01876.

• [91] Shane T. Mueller, Elizabeth S. Veinott, Robert R. Hoffman, Gary Klein, Lamia Alam, Tauseef Mamun, and William J. Clancey. Principles of explanation in humanai systems. arXiv preprint arXiv:2102.04972 , 2021. URL https://arxiv.org/abs/2102. 04972.

• [92] Menaka Narayanan, Emily Chen, Jeffrey He, Been Kim, Sam Gershman, and Finale Doshi-Velez. How do Humans Understand Explanations from Machine Learning Systems? An Evaluation of the Human-Interpretability of Explanation. arXiv:1802.00682 [cs] , فوریه ۲۰۱۸ (بهمن ۱۳۹۶ تا اسفند ۱۳۹۶). URL http://arxiv.org/abs/1802.00682. arXiv: 1802.00682.

• [93] Richard E Nisbett, Timothy Decamp Wilson, Michael Kruger, Lee Ross, Amos Indeed, Nancy Bellows, Dorwin Cartwright, Alvin Goldman, Sharon Gurwitz, Ronald Lemley, Harvey London, and Hazel Markus. Telling more than we can know: Verbal reports on mental processes. Psychological Review , 84(3), 1977.

• [94] NIST Standards Inclusivity Effort Team. Guidance for NIST staff on using inclusive language in documentary standards, NIST Interagency or Internal report 8366, 2021.

• [95] Stuart Oskamp. Overconfidence in case-study judgments. Journal of Consulting Psychology , 29(3):261–265, 1965. ISSN 00958891. doi: 10.1037/h0022125.

• [96] P. J. Phillips, H. Moon, S. Rizvi, and P. Rauss. The FERET evaluation methodology for face-recognition algorithms. IEEE Trans. PAMI , 22:1090–1104, اکتبر ۲۰۰۰ (مهر ۱۳۷۹ تا آبان ۱۳۷۹).

• [97] P. J. Phillips, W. T. Scruggs, A. J. O’Toole, P. J. Flynn, K. W. Bowyer, C. L. Schott, and M. Sharpe. FRVT 2006 and ICE 2006 large-scale results. IEEE Trans. PAMI , 32(5):831–846, 2010.

• [98] P Jonathon Phillips, Amy N Yates, Ying Hu, Carina A Hahn, Eilidh Noyes, Kelsey

Jackson, Jacqueline G Cavazos, G´eraldine Jeckeln, Rajeev Ranjan, Swami Sankaranarayanan, et al. Face recognition accuracy of forensic examiners, superrecognizers, and face recognition algorithms. Proceedings of the National Academy of Sciences , 115(24):6171–6176, 2018.

• [99] P.J. Phillips, K. W. Bowyer, P. J. Flynn, X. Liu, and W. T. Scruggs. The Iris Challenge Evaluation 2005. In Second IEEE International Conference on Biometrics: Theory, Applications, and Systems , 2008.

• [100] R¨udiger F. Pohl, editor. Cognitive illusions: A handbook on fallacies and biases in thinking, judgement and memory . Psychology Press, 2004.

• [101] Forough Poursabzi-Sangdeh, Daniel G. Goldstein, Jake M. Hofman, Jennifer Wortman Vaughan, and Hanna Wallach. Manipulating and Measuring Model Interpretability. arXiv:1802.07810 [cs] , نوامبر ۲۰۱۹ (آبان ۱۳۹۸ تا آذر ۱۳۹۸). URL http://arxiv.org/abs/1802. 07810. arXiv: 1802.07810.

• [102] Emily Pronin. The introspection illusion. In Advances in experimental social psychology , pages 1–67. Elsevier, 2009.

• [103] Mark A Przybocki, Alvin F Martin, and Audrey N Le. Nist speaker recognition evaluations utilizing the mixer corpora—2004, 2005, 2006. IEEE Transactions on Audio, Speech, and Language Processing , 15(7):1951–1959, 2007.

• [104] Zhongang Qi, Saeed Khorram, and Li Fuxin. Visualizing Deep Networks by Optimizing with Integrated Gradients. Proceedings of the AAAI Conference on Artificial Intelligence , 34(07):11890–11898, آوریل ۲۰۲۰ (فروردین ۱۳۹۹ تا اردیبهشت ۱۳۹۹). ISSN 2374-3468, 21595399. doi: 10.1609/aaai.v34i07.6863. URL http://arxiv.org/abs/1905.00954. arXiv: 1905.00954.

• [105] Dheeraj Rajagopal, Vidhisha Balachandran, Eduard Hovy, and Yulia Tsvetkov. SelfExplain: A Self-Explaining Architecture for Neural Text Classifiers. arXiv:2103.12279 [cs] , مارس ۲۰۲۱ (اسفند ۱۳۹۹ تا فروردین ۱۴۰۰). URL http://arxiv.org/abs/2103.12279. arXiv: 2103.12279.

• [106] Kaivalya Rawal and Himabindu Lakkaraju. Beyond Individualized Recourse: Interpretable and Interactive Summaries of Actionable Recourses. In Advances in Neural Information Processing Systems , volume 33, pages 12187–12198. Curran Associates, Inc., 2020. URL https://proceedings.neurips.cc/paper/2020/hash/ 8ee7730e97c67473a424ccfeff49ab20-Abstract.html.

• [107] Marco Tulio Ribeiro, Sameer Singh, and Carlos Guestrin. ”Why Should I Trust you?” Explaining the Predictions of Any Classifier. In KDD 2016: Proceedings of the 22nd ACM SIGKDD Conference on Knowledge Discovery and Data Mining , San Francisco, CA, USA, اوت ۲۰۱۶ (مرداد ۱۳۹۵ تا شهریور ۱۳۹۵). ACM. URL https://www.kdd.org/kdd2016/subtopic/view/ why-should-i-trust-you-explaining-the-predictions-of-any-classifier.

• [108] Allyson Rice, P. Jonathon Phillips, and Alice J. O’Toole. The role of the face and body in unfamiliar person identification. Applied Cognitive Psychology , 27:761– 768, 2013.

• [109] John Roach. Microsoft responsible machine learning capabilities build trust in AI systems, developers say, Accessed ۲۹ ژوئیه ۲۰۲۰ (۸ مرداد ۱۳۹۹). URL https://blogs.microsoft.com/ ai/azure-responsible-machine-learning/.

• [110] Marko Robnik-Sikonjaand Marko Bohanec. Perturbation-Based Explanations of Prediction Models. In Jianlong Zhou and Fang Chen, editors, Human and Machine Learning: Visible, Explainable, Trustworthy and Transparent , Human–Computer Interaction Series, pages 159–175. Springer International Publishing, Cham, 2018. ISBN 978-3-319-90403-0. doi: 10.1007/978-3-319-90403-0_9. URL https://doi. org/10.1007/978-3-319-90403-0_9.

• [111] Cynthia Rudin. Stop explaining black box machine learning models for high stakes decisions and use interpretable models instead. Nature Machine Intelligence , 1(5): 206–215, 2019.

• [112] Cynthia Rudin and Joanna Radin. Why are we using black box models in AI when we don’t need to? A lesson from an explainable AI competition. Harvard Data Science Review , 1(2), 2019.

• [113] Cynthia Rudin, Chaofan Chen, Zhi Chen, Haiyang Huang, Lesia Semenova, and Chudi Zhong. Interpretable machine learning: Fundamental principles and 10 grand challenges. arXiv preprint arXiv:2103.11251 , 2021. URL https://arxiv.org/abs/2103. 11251.

• [114] Seyed Omid Sadjadi, Timoth´ee Kheyrkhah, Audrey Tong, Craig S Greenberg, Douglas A Reynolds, Elliot Singer, Lisa P Mason, and Jaime Hernandez-Cordero. The 2016 nist speaker recognition evaluation. In Interspeech , pages 1353–1357, 2017.

• [115] Wojciech Samek, Alexander Binder, Gr´egoire Montavon, Sebastian Lapuschkin, and Klaus-Robert M¨uller. Evaluating the Visualization of What a Deep Neural Network Has Learned. IEEE Transactions on Neural Networks and Learning Systems , 28 (11):2660–2673, نوامبر ۲۰۱۷ (آبان ۱۳۹۶ تا آذر ۱۳۹۶). ISSN 2162-2388. doi: 10.1109/TNNLS.2016. 2599820. Conference Name: IEEE Transactions on Neural Networks and Learning Systems.

• [116] Philipp Schmidt and Felix Biessmann. Quantifying Interpretability and Trust in Machine Learning Systems. arXiv:1901.08558 [cs, stat] , ژانویه ۲۰۱۹ (دی ۱۳۹۷ تا بهمن ۱۳۹۷). URL http: //arxiv.org/abs/1901.08558. arXiv: 1901.08558.

• [117] Jonathan W. Schooler and Tonya Y. Engstler-Schooler. Verbal overshadowing of visual memories: Some things are better left unsaid. Cognitive Psychology , 22(1): 36–71, 1990. ISSN 00100285. doi: 10.1016/0010-0285(90)90003-M.

• [118] Jonathan W. Schooler, Stellan Ohlsson, and Kevin Brooks. Thoughts Beyond Words: When Language Overshadows Insight. Journal of Experimental Psychology: General , 122(2):166–183, 1993. ISSN 00963445. doi: 10.1037/0096-3445.122.2.166.

• [119] Reva Schwartz, Leann Down, Adam Jonas, and Elham Tabassi. A proposal for identifying and managing bias in artificial intelligence. Draft NIST Special Publication 1270, National Institute of Standards and Technology, 2021.

• [120] Ramprasaath R Selvaraju, Michael Cogswell, Abhishek Das, Ramakrishna Vedantam, Devi Parikh, and Dhruv Batra. Grad-cam: Visual explanations from deep networks via gradient-based localization. In Proceedings of the IEEE International

• Conference on Computer Vision , pages 618–626, 2017.

• [121] Keng Siau and Weiyu Wang. Building trust in artificial intelligence, machine learning, and robotics. Cutter Business Technology Journal , 31(2):47–53, 2018. ISSN 24753742.

• [122] Leon Sixt, Maximilian Granz, and Tim Landgraf. When Explanations Lie: Why Many Modified BP Attributions Fail. دسامبر ۲۰۱۹ (آذر ۱۳۹۸ تا دی ۱۳۹۸). URL https://arxiv.org/abs/ 1912.09818v6.

• [123] Dylan Slack, Sorelle A. Friedler, Carlos Scheidegger, and Chitradeep Dutta Roy. Assessing the Local Interpretability of Machine Learning Models. arXiv:1902.03501 [cs, stat] , اوت ۲۰۱۹ (مرداد ۱۳۹۸ تا شهریور ۱۳۹۸). URL http://arxiv.org/abs/1902.03501. arXiv: 1902.03501.

• [124] Dylan Slack, Sophie Hilgard, Emily Jia, Sameer Singh, and Himabindu Lakkaraju. Fooling lime and shap: Adversarial attacks on post hoc explanation methods. In Proceedings of the AAAI/ACM Conference on AI, Ethics, and Society , AIES ’20, page 180–186, New York, NY, USA, 2020. Association for Computing Machinery. ISBN 9781450371100. doi: 10.1145/3375627.3375830. URL https://doi.org/10. 1145/3375627.3375830.

• [125] Chun Siong Soon, Marcel Brass, Hans Jochen Heinze, and John Dylan Haynes. Unconscious determinants of free decisions in the human brain. Nature Neuroscience , 11(5):543–545, 2008. ISSN 10976256. doi: 10.1038/nn.2112.

• [126] Siegfried Ludwig Sporer, Steven Penrod, Don Read, and Brian Cutler. Choosing, Confidence, and Accuracy: A Meta-Analysis of the Confidence-Accuracy Relation in Eyewitness Identification Studies. Psychological Bulletin , 118(3):315–327, 1995. ISSN 00332909. doi: 10.1037/0033-2909.118.3.315.

• [127] Brian Stanton and Theodore Jensen. Trust and artificial intelligence. Draft NISTIR 8332, National Institute of Standards and Technology, 2021.

• [128] Kevin Stine, Stephen Quinn, Gregory Witte, and Robert Gardner. Integrating Cybersecurity and Enterprise Risk Management (ERM). Technical Report NIST Internal or Interagency Report (NISTIR) 8286, National Institute of Standards and Technology, اکتبر ۲۰۲۰ (مهر ۱۳۹۹ تا آبان ۱۳۹۹). URL https://csrc.nist.gov/publications/detail/nistir/8286/final.

• [129] Leanne ten Brinke, Dayna Stimson, and Dana R. Carney. Some Evidence for Unconscious Lie Detection. Psychological Science , 2014.

• [130] Leanne ten Brinke, Kathleen D. Vohs, and Dana R. Carney. Can Ordinary People Detect Deception After All? Trends in Cognitive Sciences , 20(8):579–588, 2016. ISSN 13646613. doi: 10.1016/j.tics.2016.05.012. URL http://linkinghub.elsevier. com/retrieve/pii/S1364661316300547.

• [131] The Royal Society. Explainable AI: the basics policy briefing, 2019. URL https://royalsociety.org/-/media/policy/projects/explainable-ai/ AI-and-interpretability-policy-briefing.pdf.

• [132] Alexander Todorov. Face value: The irresistible influence of first impressions . Princeton University Press, 2017.

• [133] Alexander Todorov, Anesu N Mandisodza, Amir Goren, and Crystal C Hall. Inferences of competence from faces predict election outcomes. Science (New York,

N.Y.) , 308(5728):1623–6, 6 2005. ISSN 1095-9203. doi: 10.1126/science.1110589. URL http://www.ncbi.nlm.nih.gov/pubmed/15947187.

• [134] Ehsan Toreini, Mhairi Aitken, Kovila Coopamootoo, Karen Elliot, Carlos GonzalezZelaya, and Aad van Moorsel. The relationship between trust in AI and trustworthy machine learning technologies. In Conference on Fairness, Accountability, and Transparency (FAT ’20) , Barcelona, Spain, 2020. doi: 10.1145/3351095.3372834.

• [135] Alice Towler, David White, and Richard I Kemp. Evaluating the feature comparison strategy for forensic face identification. Journal of Experimental Psychology: Applied , 23(1):47, 2017.

• [136] Amos Tversky and Daniel Kahneman. The framing of decisions and the psychology of choice. Science , 211(4481):453–458, 1981. doi: 10.1126/science.7455683.

• [137] Amos Tversky and Eldar Shafir. The Disjunction Effect in Choice Under Uncertainty. Psychological Science , 3(5):305–309, 1992. ISSN 14679280. doi: 10.1111/j.1467-9280.1992.tb00678.x.

• [138] Berk Ustun, Alexander Spangher, and Yang Liu. Actionable Recourse in Linear Classification. In Proceedings of the Conference on Fairness, Accountability, and Transparency , FAT ’19, pages 10–19, New York, NY, USA, 2019. Association for Computing Machinery. ISBN 978-1-4503-6125-5. doi: 10.1145/3287560.3287566. URL https://doi.org/10.1145/3287560.3287566. event-place: Atlanta, GA, USA.

• [139] Ellen M Voorhees. System Explanations : A Cautionary Tale. In ACM CHI Workshop on Operationalizing Human-Centered Perspectives in Explainable AI , 2021.

• [140] Sandra Wachter, Brent Mittelstadt, and Chris Russell. Counterfactual explanations without opening the black box: Automated decisions and the GDPR. Harv. JL & Tech. , 31:841, 2017.

• [141] Adrian Weller. Transparency: Motivations and challenges. In Explainable AI: Interpreting, Explaining and Visualizing Deep Learning , pages 23–40. Springer, 2019.

• [142] James Wexler, Mahima Pushkarna, Tolga Bolukbasi, Martin Wattenberg, Fernanda Vi´egas, and Jimbo Wilson. The what-if tool: Interactive probing of machine learning models. IEEE Transactions on Visualization and Computer Graphics , 26(1):56–65, 2020. doi: 10.1109/TVCG.2019.2934619.

• [143] Timothy D. Wilson and Yoav Bar-Anan. The unseen mind. Science , 321(5892): 1046–1047, 2008. ISSN 00368075. doi: 10.1126/science.1163029.

• [144] Timothy D. Wilson and Johnathan Schooler. Thinking too much: Introspection can reduce the quality of preferences and decisions. Journal of Personality and Social Psychology , 60(2):181–192, 1991. ISSN 0003-066X. doi: 10.1037/h0021466.

• [145] John T. Wixted, Laura Mickes, and Ronald P. Fisher. Rethinking the Reliability of Eyewitness Memory. Perspectives on Psychological Science , 13(3):324–335, 2018. ISSN 17456924. doi: 10.1177/1745691617734878.

• [146] Allison Woodruff, Sarah E. Fox, Steven Rousso-Schindler, and Jeff Warshaw. A qualitative exploration of perceptions of algorithmic fairness. Conference on Human Factors in Computing Systems - Proceedings , 2018-April:1–14, 2018. doi: 10.1145/ 3173574.3174230.

• [147] Chih-Kuan Yeh, Cheng-Yu Hsieh, Arun Suggala, David I. Inouye, and Pradeep K. Ravikumar. On the (In)fidelity and Sensitivity of Explanations. pages 10967–10978, 2019. URL http://papers.neurips.cc/paper/ 9278-on-the-infidelity-and-sensitivity-of-explanations.

• [148] Nick Yeung and Christopher Summerfield. Metacognition in human decisionmaking: Confidence and error monitoring. Philosophical Transactions of the Royal Society B: Biological Sciences , 367(1594):1310–1321, 2012. ISSN 14712970. doi: 10.1098/rstb.2011.0416.

• [149] Qingyuan Zhao and Trevor Hastie. Causal Interpretations of Black-Box Models. Journal of Business & Economic Statistics , 0(0):1–10, ژوئن ۲۰۱۹ (خرداد ۱۳۹۸ تا تیر ۱۳۹۸). ISSN 0735-0015. doi: 10.1080/07350015.2019.1624293. URL https://doi.org/10.1080/ 07350015.2019.1624293.

• [150] Bolei Zhou, Aditya Khosla, Agata Lapedriza, Aude Oliva, and Antonio Torralba. Learning deep features for discriminative localization. In Proceedings of the IEEE conference on computer vision and pattern recognition , pages 2921–2929, 2016.

• [151] Jianlong Zhou, Amir H. Gandomi, Fang Chen, and Andreas Holzinger. Evaluating the Quality of Machine Learning Explanations: A Survey on Methods and Metrics. Electronics , 10(5):593, ژانویه ۲۰۲۱ (دی ۱۳۹۹ تا بهمن ۱۳۹۹). doi: 10.3390/electronics10050593. URL https://www.mdpi.com/2079-9292/10/5/593. Number: 5 Publisher: Multidisciplinary Digital Publishing Institute.

• [152] Xingchen Zhou and Rob Jenkins. Dunning–Kruger effects in face perception. Cognition , 203(January), 2020. ISSN 18737838. doi: 10.1016/j.cognition.2020.104345.

• [153] Luisa M. Zintgraf, Taco S. Cohen, Tameem Adel, and Max Welling. Visualizing Deep Neural Network Decisions: Prediction Difference Analysis. فوریه ۲۰۱۷ (بهمن ۱۳۹۵ تا اسفند ۱۳۹۵). URL https://arxiv.org/abs/1702.04595v1.