ETSI is pleased to announce the 8th edition of UCAAT, the User Conference on Advanced Automated Testing, taking place in October 2021.

UCAAT 2021: Testing to the Edge

Test process automation has proven to increase productivity and product quality. As the COVID-19 pandemic has shifted and increased the demands on various IT systems and services in terms of interoperability, scalability, and adaptability, test automation is essential for delivering agile solutions in uncertain times. Sharing knowledge and learning from experience of others helps everyone to get better prepared for future challenges.

The annual ETSI User Conference on Advanced Automated Testing (UCAAT) is the pinnacle in the calendar of ETSI’s Technical Committee Methods for Testing and Specification (TC MTS). UCAAT 2021 will be a virtual event this year.

Overview

UCAAT is dedicated to the practical engineering and application aspects of automated testing, including experiences from the use of new techniques for test automation, advanced test automation processes, and standardised testing languages and methodologies for test automation in different application domains, such as IT services, telecommunications, transportation, healthcare, finance, and smart cities.

Should I attend?

If you are a:

  • Test engineer, designer or test automation expert
  • Engineer working in test specification, automation, DevOps and RPA
  • Software developer or architect
  • Project leader or manager in digital transformation
  • Test tool or service provider
  • Test and quality assurance analyst

… then UCAAT 2021 will provide you with a unique opportunity to get together with your peers and exchange on experiences gained and lessons learned, both from the adoption of novel test automation techniques, methods, and tools and from the long-term application of test automation.

UCAAT 2021 TENTATIVE AGENDA (19-21 October).

The detailed programme of the event is provided below. Times indicated are Central European Summer Time (CEST).

  • 19 October: Pre-event Tutorials
  •  
     

    TUTORIALS

    • 08.55 am - 09.00 am: Opening Address
      Philip Makedonski (Programme Committee Chair, University of Göttingen)
    • 09.00 am - 10.00 am: Session 1 - Model-Based Testing (MBT)
      Vahid Garousi (Software Engineering Consulting), Alper Buğra Keleş, Yunus Balaman and Zeynep Özdemir Güler  (Testinium A.S.)
    • 10.00 am - 10.30 am: Coffee Break & Meeting Hub
      Please use this opportunity to connect with other attendees via the Meeting Hub
    • 10.30 am - 11.30 am: Session 2 - Let's build a Continuous Quality Assurance Strategy around your CI/CD Pipelines
      Szilárd Széll (Eficode Oy)
    • 11.30 am - 01.00 pm: Lunch Break & Meeting Hub
      Please use this opportunity to connect with other attendees via the Meeting Hub
    • 01:00 pm - 02:00 pm: Session 3 - Autonomous Real-time Testing
      Thomas Fehlmann (Euro Project Office AG)
    • 02:00 pm - 02:30 pm: Coffee Break & Meeting Hub
      Please use this opportunity to connect with other attendees via the Meeting Hub
    • 02:30 pm - 03:30 pm: Session 4 - Introduction to a ‘Standard to Validation’ Methodology
      Yann Garcia (FSCOM)
    • 03:35 pm - 04:00 pm: Live Panel Discussion and Q&A
      Moderator: 
      Philip Makedonski – Panellists: Vahid Garousi and/or Alper Buğra Keleş and/or Yunus Balaman and/or Zeynep Özdemir Güler, Szilárd Széll , Thomas Fehlmann, Yann Garcia
  • 20 October
  •  
     

     OPENING and KEYNOTE

    • 09:00 am - 09:20 am: Conference Opening
    • Philip Makedonski (Programme Committee Chair, University of Göttingen) and Dirk Tepelmann (ETSI MTS Chair)
    • 09:20 am - 10:00 am: Keynote - Testing at the Edge of Reality - Virtual Prototyping and Opportunities for Test Automation: Virtual Prototyping is essential for many development processes. It is used on the whole scale from simple visualizations of concepts to automated testing of complex machinery. The processes may cover robustness tests of individual components, integration tests to evaluate construction issues, and system tests to assess potential issues at runtime. One important focus for every machinery is the user interface. With virtual prototypes, we can transfer established standards from usability engineering and user experience design to designing user interfaces of technical devices. This includes enhanced prototyping, remote evaluation and even static testing of design concepts. In this talk, we will have a look at the opportunities for testing and evaluating user interfaces of technical devices and larger machinery and we will briefly introduce a framework for efficient creation and evaluation of virtual prototypes.
      Prof. Dr. Patrick Harms (TU Nürnberg)
    • 10:00 am - 10:15 am: Coffee Break & Meeting Hub
      Please use this opportunity to connect with other attendees via the Meeting Hub

    SESSION:  5G and Networks

    • 10:15 am -  10:35 am:  Automated OTA Testing Needs and Challenges for 5G Devices
      Heinz Mellein (Rohde & Schwarz GmbH & Co.KG)
    • 10:35 am - 10:55 am: How to design a Cloud-Native Deployment and Test Pipeline for 5G
      Szilárd Széll (Eficode Oy)
    • 10:55 am - 11:15 am: Containerized Setup for Performance Tests of Communication Networks
      Valentin Egger, Christoph Uran and Helmut Wöllik (Carinthia University of Applied Sciences)
    • 11:15 am - 11:30 am: Coffee Break & Meeting Hub
      Please use this opportunity to connect with other attendees via the Meeting Hub 

    SESSION: AI and Regression Testing

    • 11:30 am - 11:50 am: AI-powered Testing: Generate Automated Regression Tests from Execution Traces
      Elizabeta Fourneret, Julien Botella and Bruno Legeard (Smartesting)
    • 11:50 am - 12:10 pm: ETSI Standardization Perspectives on Frameworks Using AI in Test Systems and Testing and Certification of AI-Enabled Systems
      Tayeb Ben Meriem, Andreas Ulrich, Muslim Elkotob and Ranganai Chaparadza (Orange)
    • 12:10 pm - 12:30 pm: Test Case Selection based on Text Analytics of Software Artifacts
      Rajesh Kumar, Gabor Pal Csaki, Tim Brachat and Shwetha Br (Siemens)
    • 12:30 pm - 12:50 pm: Live Panel Discussion and Q&A
      Moderator: 
      Philip Makedonski – Panellists: Heinz Mellein, Szilárd Széll, Valentin Egger and/or Christoph Uran and/or Helmut Wöllik, Elizabeta Fourneret and/or Julien Botella and/or Bruno Legeard, Tayeb Ben Meriem and/or Andreas Ulrich and/or Muslim Elkotob and/or Ranganai Chaparadza, Rajesh Kumar and/or Gabor Pal Csaki and/or Tim Brachat and/or Shwetha Br
    • 12.50 pm - 02:00 pm: Lunch Break & Meeting Hub
      Please use this opportunity to connect with other attendees via the Meeting Hub

    SESSION: Standards and Security

    • 02:00 pm - 02:20 pm: IoT, NFV or MEC, One Platform to Test them All
      Loic Baron, Federico Sismondi (runningcode.io), Michele Carignani and Miguel Angel Reina Ortega (ETSI)
    • 02:20 pm - 02:40 pm: Integrating Open Sources CyberSecurity Tools into an Automated Testing System
      Sergio Borghese, Francesco Oppedisano, Simona Rossi and Chiara Conflitti (NetResults S.r.l.)
    • 02:40 pm - 03:00 pm: 3 Things you Have Always Wanted to Know about the Test Description Language
      Martti Käärik (Estonia Elvior LLC), Finn Kristoffersen (University of Göttingen) and Philip Makedonski (Programme Committee Chair, University of Göttingen)
    • 03:00 pm - 03:15 pm: Live Panel Discussion and Q&A
      Moderator:
      Will be announced soon – Panellists: Loic Baron, Federico Sismondi and/or Michele Carignani and/or Miguel Angel Reina Ortega, Sergio Borghese and/or Francesco Oppedisano and/or Simona Rossi and/or Chiara Conflitti, Martti Käärik and/or Finn Kristoffersen and/or Philip Makedonski
    • 03:15 pm - 03:30 pm: Coffee Break & Meeting Hub
      Please use this opportunity to connect with other attendees via the Meeting Hub

     

    SESSION: Model and Process Testing

    • 03:30 pm - 03:50 pm: Automatic Testing of Business Processes
      Emmanuel Gaudin (PragmaDev)
    • 03:50 pm - 04:10 pm: TDL-Based Automatic Detection of Interaction Errors
      Nader Kesserwan and Jameela Al Jaroodi (Robert Morris University)
    • 04:10 pm - 04:25 pm: Poster Introduction
      1- Deployment of Keyword Testing for Vehicle Powertrain HIL Validation: Jean-Marie Quelin (Groupe Renault)
      2- A fully Automated Toolchain for Cross Browser UI Tests including AI-powered Reporting: Pascal Koenig (Siemens AG)
      3- How to Efficiently test RESTful Microservices with TTCN-3 - From Theory to Practice: Theofanis Vassiliou-Gioles (TU Berlin)
      4- Automated Conformance Testing of ETSI NFV APIs using Robot Framework: Giacomo Bernini (Nextworks), Sana Zulfiqar (xFlow Research), Hammad Zafar (XFlow Research Inc.), Elian Kraja (Nextworks), and Michele Carignani (ETSI)
    • 04:25 pm - 05:30 pm: Live Panel and Poster Discussion 
      Details will be announced soon

     

  • 21 October
  •  
     

    KEYNOTE

    • 09:00 am - 09:45 am: Keynote - Interoperability in CI/CD and Why it Matters? The emergence of virtualization and cloud-native has resulted in tremendous advances in the telecommunications industry, speeding up the introduction of new services and CI/CD is one of the prerequisites and enablers of success. Despite its many advantages, the CI/CD ecosystem has its challenges and interoperability is one of them. This session will discuss issues arising from the lack of interoperability across proliferating CI/CD technologies and what open source communities are doing to address them in a collaborative manner. We will also highlight the necessity, and greater sustainability, of a holistic approach to interoperability in the CI/CD ecosystem and invite attendees to join community efforts.
      Fatih Degirmenci (Ericsson Software Technology)
    • 09:45 am - 10:15 am: Coffee Break & Meeting Hub
      Please use this opportunity to connect with other attendees via the Meeting Hub

    SESSION: Model-Based Testing

    • 10:15 am - 10:35 am: Using Tabular Notation to Support Model-Based Testing
    • Rachid Kherrazi (Akka Technologies)
    • 10:35 am - 10:55 am: Traceability Links among UCM, TDL and TTCN-3
    • Nader Kesserwan (Robert Morris University), Jameela Al Jaroodi (Robert Morris University)
    • 10:55 am - 11:15 am: Evidence-Based Guidelines for Model-Based Testing: An Empirical Study
      Tomas Helmfridsson (Add Q), Emil Alégroth (Blekinge Institute of Technology)
    • 11:15 am - 11:30 am: Coffee Break & Meeting Hub
      Please use this opportunity to connect with other attendees via the Meeting Hub

    SESSION: Methodology 

    • 11:30 am - 11:50 am: 4 Pillars of Successful Agile Test Automation
      Mesut Durukal (Rapyuta Robotics)
    • 11:50 am - 12:10 am: Methodology for RESTful APIs Specifications and Testing
      Sana Zulfiqar (Flow Research Inc.), Michele Carignani (ETSI) - Philip Makedonski (Programme Committee Chair, University of Göttingen), and Martti Käärik (Estonia Elvior LLC)
    • 12:10 pm - 12:30 pm: Flow Model vs Page Object Pattern
      Péter Földházi (EPAM Systems USA)
    • 12:30 pm - 12:50 pm: Live Panel Discussion and Q&A
      Moderator:
      Will be announced soon – Panellists: Rachid Kherrazi, Nader Kesserwan and/or Jameela Al Jaroodi, Tomas Helmfridsson and/or Emil Alégroth
    • 12:50 pm - 02:00 pm: Lunch Break & Meeting Hub
      Please use this opportunity to connect with other attendees via the Meeting Hub

    SESSION: AI 

    • 02:00 pm - 02:20 pm: Using ComputerVision and Machine Learning to Measure No Reference Video Streaming Quality
      Sergio Borghese, Francesco Oppedisano, Stefano Aru and Silvia Vistoli (NetResults Srl)
    • 02:20 pm - 02:40 pm: Using AI to Prioritize Static Analysis Findings
      Leonid Borodaev and Rix Groenboom (Parasoft Netherlands BV)
    • 02:40 pm - 03:00 pm: Evolution & Future of Software Testing
      Mesut Durukal  (Rapyuta Robotics)
    • 03:00 pm - 03:15 pm: Coffee Break & Meeting Hub
      Please use this opportunity to connect with other attendees via the Meeting Hub

    SESSION: Model Verification and Simulation

    • 03:15 pm - 03:35 pm: A Framework for Cloud-based Testing of Multi-variant Cyber-physical Systems
      Holger Schlingloff and Niels Hoppe (Fraunhofer)
    • 03:35 pm - 03:55 pm: Basic Test Set - Testing PSI5 Sensors Made Easy
      Anna Neumann (iSyst Intelligente Systeme GmbH)
    • 03:55 pm - 04:15 pm: Live Panel Discussion and Q&A
      Moderator:
      Will be announced soon – Panellists: Sergio Borghese and/or Francesco Oppedisano and/or Stefano Aru and/or Silvia Vistoli, Leonid Borodaev and/or Rix Groenboom, Mesut Durukal
    • 04:15 pm - 04:30 pm:  Conference Closing and Best presentation Award
      Philip Makedonski (Programme Committee Chair, University of Göttingen)

The independent programme committee is composed mostly of industry stakeholders nominated by the appointed Programme Committee Chair. The programme committee determines the call for presentations and evaluates the received presentation, poster, and tutorial proposals to select the best ones for the conference programme.

Programme Committee Chair:

  • Philip Makedonski, University of Göttingen

Programme Committee Members: 

  • Alexis Despeyroux, Testing Solutions and Services
  • Andreas Ulrich, Siemens AG
  • Anne Kramer, sepp.med GmbH
  • Carlos Cardenas, DEKRA Testing and Certification, S.A.U
  • Ceren Şahin, University of Luxembourg
  • Dirk Tepelmann, Spirent
  • Gjore Zaharchev, Seavus
  • Jorge Asensio, ARHS Developments
  • Jorge Pascal, Audi AG
  • Mark Beierl, Canonical Ltd
  • Martin Schneider, Fraunhofer FOKUS
  • Martti Käärik Elvior, LLC
  • Michele Carignani, ETSI
  • Muslim Elkotob, Vodafone
  • Pierre Lynch, Keysight
  • Raquel Jimenez, MTP
  • Rémi Caudwell, Sogeti
  • Sergio Borghese, NetResults Srl
  • Stephan Schulz, Giesecke + Devrient
  • Szilard Szell, Eficode Oy
  • Tibor Csöndes, Ericsson Hungary
  • Václav Vidoň, Kiwi.com
  • Zhen Ru Dai, Hamburg University of Applied Sciences (HAW)

UCAAT is an established series of annual events. Previous editions of the UCAAT have focused on different aspects of test automation following emerging trends through the years. Information about previous editions of the UCAAT, including the programmes and presentation slides, are available from the archived websites linked below. Browse through the archives and discover past experiences shared at UCAAT!

Any Questions? Contact us