# Accountability, Reproducibility, and Traceability ## In brief {doc}`./L2.Accountability` and {doc}`./L2.Reproducibility` are two interrelated concepts, cornerstones of Trustworthy AI. Accoutable AI systems can contribute to reproducibility, and Reproducible AI systems can contribute to accountability. ## More in detail {doc}`./L2.Accountability` and {doc}`./L2.Reproducibility` are two cornerstones of Trustworthy AI {cite}`HLEG_Trust`. Accountability requires mechanisms be put in place to ensure that AI systems and their outcomes, both before and after their development, deployment and use, can be observed and analyzed. This ability to review AI systems involve technical and organisational logging processes {cite}`cobbe2021reviewable_accountability` to enable investigators to draw the same conclusions from an experiment by following provided guidelines. In this context, {doc}`./L2.Accountability` and {doc}`./L2.Reproducibility` are interrelated concepts. Developing reprodubicle AI systems can enable accountability over AI systems. On the other hand, the process of record-tracking and logging for accountability can support an increasing level of reproducibility. A third dimension strictly correlated with {doc}`./L2.Accountability` and {doc}`./L2.Reproducibility` is {doc}`./L2.Traceability`. We suggest to navigate in the appropriate section of this book for more detailed information about these three dimensions. ## Main Keywords - {doc}`./L2.Accountability`: **Accountability** is an ethical aspect studied in the TAILOR project to ensure that a given actor or actors can render an account of the actions of an AI system. The accountability concept is strictly related to the concept of responsibility. - {doc}`./L3.Problem_of_many_hands`: The **problem of many hands** aims to understand who is morally responsible in a situation with several actors. - {doc}`./L3.The_frame_problem`: The **frame problem** is the challenge of knowing and modeling the relevant features and context of situations, and getting an agent to act on those without consideration all the irrelevant facts as well. - {doc}`./L3.Wicked_problems`: A class of problems for which science provides insufficient or inappropriate resolution. - {doc}`./L2.Reproducibility`: **Reproducibility** is the ability of independent investigators to draw the same conclusions from an experiment by following the documentation shared by the original investigators. - {doc}`./L2.Traceability`: **Traceability** can be defined as the need to maintain a complete and clear documentation of the data, processes, artefacts and actors involved in the entire lifecycle of an AI model, starting from its design and ending with its production serving. - {doc}`./L3.Provenance_tracking`: **Provenance tracking** represents the tracking of “information that describes the production process of an end product, which can be anything from a piece of data to a physical object. […] Essentially, provenance can be seen as meta-data that, instead of describing data, describes a production process.” - {doc}`./L3.Continuous_performance_monitoring`: **Continuous performance monitoring** is the activity to track, log and monitor over time the behaviour and the performance of Artificial Intelligence and Machine Learning models. This activity is particularly relevant after in-production deployment in order to detect any performance drifts and outages of the model. ## Bibliography ```{bibliography} :style: unsrt :filter: docname in docnames ``` > This entry was written by Luciano C Siebert.