SAIA-2024: Symposium on Scaling AI Assessments Design Offices Dominium Cologne, Germany, September 30-October 1, 2024 |
Conference website | https://www.zertifizierte-ki.de/symposium-on-scaling-ai-assessments/ |
Submission link | https://easychair.org/conferences/?conf=saia2024 |
Abstract registration deadline | August 5, 2024 |
Submission deadline | August 5, 2024 |
Author notification (practitioner track) | August 19, 2024 |
Author notification (academic track) | August 26, 2024 |
Camera-ready version deadline | September 16, 2024 |
Conference Day 1 | September 30, 2024 |
Conference Day 2 | October 1, 2024 |
Trustworthy AI is considered a key prerequisite for Artificial Intelligence (AI) applications. Especially against the background of European AI regulation, AI conformity assessment procedures are of particular importance, both for specific use cases and for general-purpose models. But also in non-regulated domains, the quality of AI systems is a decisive factor as unintended behavior can lead to serious financial and reputation damage. As a result, there is a great need for AI audits and assessments and in fact, it can also be observed that a corresponding market is forming. At the same time, there are still (technical and legal) challenges in conducting the required assessments and a lack of extensive practical experience in evaluating different AI systems. Overall, the emergence of the first marketable/commercial AI assessment offerings is just in the process and a definitive, distinct procedure for AI quality assurance has not yet been established.
- AI assessments require further operationalization both at level of governance and related processes and at the system/product level. Empirical research is pending that tests/evaluates governance frameworks, assessment criteria, AI quality KPIs and methodologies in practice for different AI use cases.
- Conducting AI assessments in practice requires a testing ecosystem and tool support, as many quality KPIs cannot be calculated without tool support. At the same time automation of such assessments is a prerequisite to make the corresponding business model scale.
For detail information see https://www.zertifizierte-ki.de/symposium-on-scaling-ai-assessments/.
Submission Guidelines
All papers must be original and not simultaneously submitted to another journal or conference. The following paper categories are welcome:
Academic track:
- Length:We expect papers with a length of around 4.800 – 6000 words, excluding references.
- Submission Instructions:
- Papers must be written in English and the submission can be made using either the OASIcs LaTeX Template or the (initially provided) Springer LNCS template (LaTeX or Word). Please note that the proceedings will use the OASIcs template and the camera-ready version of all accepted papers shall therefore be formatted using the OASIcs template, see on our website section ‘Instruction for authors/templates’.
- The review will be double-blind, thus make sure you use the „anonymous article” template for submission (i.e., anonymous is added as argument of the \documentclass)
- We accept submissions of previously unpublished material as well as previously published papers that contain at least 30% new content.
Practitioner track:
- Length:We expect a brief abstract with a length of around 200 – 1000 words, excluding optional references.
- Submission Instructions:
- Practitioner abstracts must be written in English and the submission can be made using either the OASIcs Template or the (initially provided) Springer LNC Template. Please find the template on our website section ‘Instruction for authors/templates’. Please note that the proceedings will use the OASIcs template.
- A single-blind review is intended, but fully anonymized contributions are also accepted
- We accept submissions of previously unpublished material as well as new compilations of previously published work, e.g. white papers.
Submission Deadline
The submission deadline for papers of both tracks (academic full papers as well as practitioner short papers/abstracts) is July 22 August 5th (Extended deadline).
(Note: It is required by easychair to define a deadline for "abstract registration" and "full paper submission". This is set on the same date, since there is no two-step submission to the Symposium. For the academic track, there is only one deadline for the full paper (on 5th August) and for the practitioner track there is only one deadline for the practitioner abstract (on 5th August).)
Committees
Program Committee
- Bertrand Braunschweig Confiance.ai
- Lucy Flek University of Bonn, Lamarr Institute for AI and ML
- Antoine Gautier QuantPi
- Manoj Kahdan RWTH Aachen
- Foutse Khomh Polytechnique Montreal
- Julia Krämer Erasmus School of Law in Rotterdam
- Qinghua Lu CSIRO
- Jakob Rehof TU Dortmund, Lamarr Institute for AI and ML
- Franziska Weindauer TÜV AI.Lab
- Stefan Wrobel University of Bonn, Fraunhofer IAIS
- Jan Zawadzki Certif.AI
Organizing committee
- Anna Schmitz, Fraunhofer IAIS
- Elena Haedecke, Fraunhofer IAIS
- Fabian Malms, Fraunhofer IAIS
- Maximilian Poretschkin, Fraunhofer IAIS
- Rebekka Görge, Fraunhofer IAIS
Publication
- All accepted papers (both tracks) will be given the option to be included in the conference proceedings, which will be published in the OASIcs series. For this purpose, the camera-ready version of the submission must fulfill the requirements of the OASIcs series (e.g. style guide, LaTeX template, author agreements). The LaTeX template can be downloaded below.
- In addition to the LaTeX template, which can already be used for the submission of conference papers, authors will be sent further information on the publication process of the conference proceedings with the final notification regarding acceptance of the conference papers.
- Note regarding paper length: If authors want to pursue this option, their submitted paper should be formatted via the OASIcs template with a length of about 2-6 pages (practitioner track) and a length of about 10 to 15 pages (academic track). Excluded from this page limit are the bibliography, the title page(s) (authors, affiliation, keywords, abstract, ...) and a short appendix (up to 5 pages). Especially this is also possible after the initial submission. This means that the initial submission (brief abstract, short paper or regular paper) can then be extended to the required amount of pages (if this length is not already reached with the initial submission), if a contribution in the proceedings is desired.
- Note: Of course, authors also have the option of deciding against integration into the proceedings. In this case, the papers do not have to be adapted to the requirements of the proceedings.
Contact
All questions about submissions should be emailed to zki-symposium@iais.fraunhofer.de .