UCAAT 2022, hosted by Siemens Munich on 13-15 September, is currently calling for presentations.


UCAAT is the pinnacle in the calendar of ETSI’s Technical Committee Methods for Testing and Specification. This well-established event addresses the practical challenges of testing and test automation faced by industry today. UCAAT is dedicated to all aspects of automated testing and is not limited in scope. Rapid technical advances in application areas such as information and communication technology, industrial automation, transportation (automotive, avionics, rail), enterprise information technology, healthcare, and biotechnology, as well as shifting operational landscapes such as DevOps practices and machine learning techniques applied to software development are ever increasing the demands on testing.

UCAAT 2022: Testing of Trustworthy Systems

Our society becomes increasingly dependent on complex software systems and widely interconnected systems of systems that take over more and more crucial tasks of our daily lives. These systems will be only accepted by their users if they offer a high level of trust in various facets reaching from safety, availability, business integrity, to robustness, security, and other areas. Moreover, these large systems integrate many different technologies, such as Artificial Intelligence or semantic networks, that are challenging on their own. Testing and certifying them becomes therefore an urgent task that needs to be addressed through appropriate methods, tools, and processes. UCAAT 2022 aims at discussing particularly all aspects concerning trustworthiness of systems and how it can be tackled best in testing. UCAAT 2022 provides a unique opportunity for practitioners, tool vendors, test service providers and researchers from many different application domains to come together.

Attendees will be able to exchange on:

  • Experiences gained and lessons learned from the adoption of novel test automation techniques, methods, and tools
  • The long-term application and the latest advances in the industrial use of test automation.

Target audience

The event is of particular interest for:

  • Test engineers, designers or test automation experts
  • Engineers working in test specification, automation, DevOps and RPA
  • Software developers or architects
  • Project leaders or managers in digital transformation
  • Test tool or service providers
  • Test and quality assurance analysts
  • Academics and researchers in testing

Important dates

  • Call for Presentation Deadline: 2 May 2022
  • Notification of Acceptation: 30 May 2022
  • Programme online: 15 June 2022
  • Presentation submission: 29 August 2022


UCAAT 2022  PRELIMANARY AGENDA (13-15 September)

  • 13 September: Pre-Conference Tutorials and Conference Day 1


    09.00 - 12.30: TUTORIAL 1: Bughunt! An interactive workshop in Model-Based Testing with the Axini Modeling Platform
    Machiel Van der Bijl and Ulyana Tikhonova, Axini

    10.30 - 11.00: Networking Coffee Break

    11.00 - 12.30: TUTORIAL 2: Test Intelligence
    Elmar Juergens, CQSE

    12.30 - 14.00: Networking Lunch



    14.00 - 14.30: Conference Opening

    Andreas Ulrich, UCAAT PC Chair
    Philip Makedonski, ETSI TC MTS Chair
    Anthony Wiles

    14.30 - 15.45: SESSION 1: INDUSTRIAL SYSTEMS

    • 14.30 - 14.55: A New Way for Testing in the Autonomous Factory – Simulation Based Testing
      Matthias Eichenseher, Siemens AG
    • 14.55 - 15.20: Keyword-Driven Simulation Testing for Open-Source Robotics
      Niels Hoppe and Steffen Lüdtke, Fraunhofer FOKUS
    • 15.20 - 15.45: Back-to-Back Testing Applied on Distributed PLC
      Anais Guignard, Systerel

    15.45 - 16.15: Networking Coffee Break

    16.15 - 17.30: SESSION 2: FAILURE ANALYSIS

    • 16.15 - 16.40: Automatic Log Analysis: Expert Knowledge for Everyone!
      Graham Rawlings and Stephan Schulz, Giesecke+Devrient
    • 16.40 - 17.05: AI-Based Defect Analytics and Assignment
      Rajesh Kumar, Gabor Pal Csaki and Michael Schmidts, Siemens AG
    • 17.05 - 17.30: ML-Based Test Prioritization “To Fail First” as a Service
      Alexandre Vernotte and Aymeric Cretin, Smartesting, Femto-ST Institute
  • 14 September: Conference Day 2


    09.00 - 10.00: KEYNOTE SPEECH - Testing AI: A New Testing Specialism
    Stuart Reid, CTO, STA Consulting, Korea

    10.00 - 10.25: Posters Introduction
    5' per poster

    10.25 - 11.00: Networking Coffee Break

    11.00 - 12.15: SESSION 3 - AI SYSTEMS

    • 11.00 - 11.25: JanIA: Intelligent Practices for Automated Testing
      Pablo Manso García-Mauriño, MTP
    • 11.25 - 11.50: Automating Adversarial Robustness Testing of DNN Models
      Albert Negura and Kobus Grobler, NavInfo Europe B.V.
    • 11.50 - 12.15: Debugging Machine Learning Models
      Emmanuel Charleson Dapaah and Jens Grabowski, University of Göttingen

    12.15 - 13.45: Networking Lunch

    13.45 - 15.00: SESSION 4 - REAL-TIME SYSTEMS

    • 13.45 - 14.10: Identifying and Classifying Uncertainties to Support Testing of Industrial Elevators
      Ali Shaukat, Liping Han and Tao Yue, Simula Research Laboratory
    • 14.10 - 14.35: Benefits of Test Automation in Time Travel Testing
      Aritra Majumdar, EPAM Systems
    • 14.35 - 15.00: Increase Robustness with Time Travel – Is It Possible and Reasonable?
      Rosalinde Schuster, Victor Navratil and Stephan Schulz, Giesecke+Devrient

    15.00 - 15.30: Networking Coffee Break

    15.30 - 17.10: SESSION 5 - DEPENDABLE SYSTEMS

    • 15.30 - 15.55: Overview of Work in Progress to Update IEEE 982, Standard for Measures of the Software Aspects of Dependability
      Robert Binder
    • 15.55 - 16.20: Assessment of GNSS-Based Equipment in the Context of AEBS-UNECE R152
      Ernst Phillip Mrohs and Marcel Visser, NavCert GmbH
    • 16.20 - 16.45: Overview of the ETSI Electronic Signatures Testing Activities
      Laurent Velez, ETSI
    • 16.45 - 17.10: Continuous Quality Assurance Strategy of an NFVI
      Szilard Szell, Eficode Oy
  • 15 September: Conference Day 3


    09.00 - 10.00: KEYNOTE SPEECH - Testing Challenges for Cyber Physical Systems
    Jan Tretmans, Research fellow at ESI (TNO), Eindhoven

    Complex high-tech cyber physical systems increasingly depend on software: software controls, connects, and monitors almost every aspect of system operation, be it a car, a 'smart' factory, a printer, an airplane, or a wafer lithography system. Consequently, ever more system failures are due to software bugs. Moreover, we build ever larger, more complex, and increasingly connected software systems, with more and more options and features, and evolving ever faster. There is a serious threat that testing methods cannot keep pace with these developments, and will endanger the fast and thorough testing of future generations of complex systems, thus hampering innovation. In this presentation we discuss trends, challenges, and research directions for testing future generations of high-tech cyber physical systems.

    10.00 - 12.15: SESSION 6 - METHODOLOGY

    • 10.00 - 10.25: Holistic Model-Based Approach for Test Generation from Safety Models
      Philipp Dormeier, Stephan Storck, Marc Zeller and Stefan Rothbauer, Siemens AG


    10.25 - 11.00: Networking Coffee Break

    • 11.00 - 11.25: Towards the Absence of Bugs: An Intelligent Combination of Static and Dynamic Analysis to Identify Vulnerabilities in the Development Process
      Ramon Barakat, Martin A. Schneider, Steffen Lüdtke, Jasper von Blanckenburg, Roman Kraus and Fabian Jezuita
      Fraunhofer FOKUS
    • 11.25 - 11.50: Systematic Selection of Testing Methodology for Low-Code Development
      Shreyasi Warunkar and Baris Güldali, S&N CQM GmbH
    • 11.50 - 12.15: How to Make your Automation Last Forever
      Martin Gijsen, Sogeti

    12.15 - 13.30: Networking Lunch

    13.30 - 15.55: SESSION 7 - TEST AUTOMATION

    • 13.30 - 13.55: Isn’t Test Automation a Silver Bullet?
      Mesut Durukal, 
    • 13.55 - 14.20: Best Practices of Agile Testing in Cloud Software Products
      Gemmilyn Chu, Daniel Ardelean, Piotr Czermak and Mariusz Lont, Nokia
    • 14.20 - 14.45: A Spring in Tester’s Life Using SpringBoot
      Ashokkumar Rajendiran, PagoNxt

    14.45 - 15.05: Networking Coffee Break

    • 15.05 - 15.30: A Beginners Guide for Monkey Test Automation on Android & iOS Native Apps
      Lakshminarayanan Krishnamurthy, EPAM Systems
    • 15.30 - 15.55: Complementing GUI Testing Scripts with Smart Monkey Testing
      Pekka Aho, Tanja E. J. Vos, Fernando Pastor Ricos and Olivia Rodriguez Valdes
      Universitat Politecnica de Valencia, Open Universiteit

    Andreas Ulrich, UCAAT PC Chair
    Philip Makedonski, ETSI TC MTS Chair

The independent Programme Committee is composed mostly of industry stakeholders nominated by the appointed Programme Committee Chair.
The Programme Committee determines the call for presentations and evaluates the received presentation, poster, and tutorial proposals to select the best ones for the conference programme.

Programme Committee Chair:

  • Andreas Ulrich, Siemens AG

Programme Committee Members: 

  • Jorge Asensio, ARHS Developments
  • Sergio Borghese, NetResults Srl
  • Carlos Cárdenas, Dekra
  • Rémi Caudwell, Sogeti
  • Tibor Csöndes, Ericsson Hungary
  • Zhen Ru Dai, Hamburg University of Applied Sciences (HAW)
  • Alexis Despeyroux, Testing Solutions and Services
  • Muslim Elkotob, Vodafone
  • Baris Güldali, S&N Invent
  • Raquel Jimenez, MTP
  • Martti Käärik Elvior, LLC
  • Philip Makedonski, University of Göttingen
  • Ultan Mulligan, ETSI
  • Dejan Ničković , AIT
  • Jorge Pascal, Cariad Technology
  • Axel Rennoch, Fraunhofer FOKUS
  • Stephan Schulz, Giesecke + Devrient
  • Matthias Simon, Nokia
  • Szilard Szell, Eficode Oy
  • Dirk Tepelmann, Spirent
  • Peter Zimmerer, Siemens AG

The following companies will exhibit at UCAAT 2022:

AXINI logo RGB DONKERBLAUWAxini, the next step in test automation
At Axini we improve the way software is made, in particular the quality of software. We offer a platform in which your domain experts specify the requirements and functionality of your system and our platform fully automatically takes care of the testing. This approach fits perfect with Agile development. Don’t wait until the system integration for errors to manifest – detect problems as early as possible in the development process.
Powered by formal techniques developed over 35 years of academic research, Axini is the leading company on model-based engineering and model-based testing in The Netherlands. We have over 10 years of experience applying these formal techniques with great success in high-tech, finance and rail.

Logo Kalifast sans fond V2020 improve your quality100Kalifast is a software solution whose development began in 2010, sponsor of UCAAT since 2016, visitors will discover the advances of this solution always at the forefront of innovation.
Kalifast aims to be an all-integrated solution that goes from requirements management, to test automation, to project management.
On the automation side, Kalifast has a powerful scheduler allowing it to perform in particular:
- Scenarios requiring several devices, which makes it possible to test, for example: chat conversations, user / administrator interactions, etc.
- The use of robots of different technologies in the same scenario
- Adaptable scenarios according to the results
- Variabilizations that can use Excel files of thousands lines


MTP CMYKonly DBAMTP is a Spanish company founded in 1997 and it is offering Quality Assurance and Quality Control Professional Services for Digital Business. In MTP, there are more than 600 employees distributed across Spain, Mexico, Brazil, and the United States. MTP clients are National and International organizations from all industries. MTP is totally independent of development manufacturers and most of the employees are ISTQB/SCRUM Certified.
MTP Digital Business Assurance business comprehends the following services:
• Quality Assurance (QA): Functional and performance testing and test automation/regression
• Cybersecurity (CS): Audits for SW applications, mobile applications, and IoT
• User Experience (UX): usability and accessibility testing and user interface re-engineering
• DevOps and Agile Development (DA): support for agile methodologies deployment


logo Smartesting bleu rose rvbSMARTESTING develops cognitive test solutions that boost the efficiency of IT Quality Assurance teams.
Our products combine visual representations and AI technologies to facilitate the agile design of business relevant tests and accelerate their automation.
SMARTESITNG enjoys a worldwide reputation of expert in Model-Based Testing. In 2017, SMARTESTING launched YEST®, a visual and Agile test design tool. YEST® is the fruit of our team’s unique know-how, experience and unrelenting determination to offer a simple MBT tool to the IT testing community.
SMARTESTING also develops GRAVITY, a usage-driven automation testing solution. GRAVITY automatically creates automated regression tests from the identification of key customer journeys on the application under test.
SMARTESTING is present in France and Germany. www.smartesting.com - contact@smartesting.com


Should you also wish to exhibit at UCAAT 2022, and introduce your organization, company, product or service to people interested in advanced automated testing

Exhibition Stands are free of charge and consist of:

  • A 4sqm stand with 1 table, 2 chairs, electricity and internet connection
  • Possibility to display company’s own exhibition material on the stand (pop up, banner...)

Exhibitors Visibility

  • UCAAT exhibitors will be listed on the website
  • The exhibition area will be announced at the opening of conference
  • The Conference programme will promote the exhibition area
    • Encourage participants to visit the stands during coffee/lunch breaks
    • Exhibition stands plan available in printed programme
    • 10 lines company profile and logo in the printed programme

Should you need any further information, please contact events@etsi.org

GTD Digital regularGerman Testing Day Digital 2022
Be a part of the company-independent conference on software quality on 03 + 04 May 2022! For everyone involved in quality assurance of business IT systems as well as embedded systems, the German Testing Day Digital offers the perfect platform! The main focus is on the sharing of experiences & new trends as well as methods. Look forward to 25 cutting-edge sessions on testing including inside talks by Vodafone, Raiffeisen Bank, Siemens Healthineers and many more!
» More info


HUSTEF logoHUSTEF is one of Europe’s premier Software Testing & Quality conferences with 730+ attendees from 30+ countries preserving its very friendly and familiar atmosphere.This year we are coming back as a LIVE event on 4-6 October!
Would you like to join us as a Speaker? Submit your proposal and see you in Budapest, Hungary!



ASQF Logo 2016The ASQF is the network of experts for quality. With 1.200 members we have been developing and securing software and system quality for 25 years.
Upcoming event: The 7th ASQF Testing Day on April 7, 2022 invites you to discuss the effects on training, projects and day-to-day business.
» View all ASQF events

UCAAT 2022 is hosted by Siemens AG in Munich, Germany on 13 – 15 September 2022.

The conference will take place in the Siemens AG Conference Center 
Otto-Hahn-Ring 6, 81739 München
Location: Central site
Building: 12

U/S-Bahn station: Neuperlach Süd - Line U5

It is planned that the event takes place as a physical event in a large auditorium and will also include exhibitions.

UCAAT is an established series of annual events. Previous editions of the UCAAT have focused on different aspects of test automation following emerging trends through the years. Information about previous editions of the UCAAT, including the programmes and presentation slides, are available from the archived websites linked below. Browse through the archives and discover past experiences shared at UCAAT!

Any Questions? Contact us

Recognition & Thanks