ETSI is pleased to announce the 8th edition of UCAAT, the User Conference on Advanced Automated Testing, taking place in October 2021.

UCAAT 2021: Testing to the Edge

Test process automation has proven to increase productivity and product quality. As the COVID-19 pandemic has shifted and increased the demands on various IT systems and services in terms of interoperability, scalability, and adaptability, test automation is essential for delivering agile solutions in uncertain times. Sharing knowledge and learning from experience of others helps everyone to get better prepared for future challenges.

The annual ETSI User Conference on Advanced Automated Testing (UCAAT) is the pinnacle in the calendar of ETSI’s Technical Committee Methods for Testing and Specification (TC MTS). UCAAT 2021 will be a virtual event this year.

Overview

UCAAT is dedicated to the practical engineering and application aspects of automated testing, including experiences from the use of new techniques for test automation, advanced test automation processes, and standardised testing languages and methodologies for test automation in different application domains, such as IT services, telecommunications, transportation, healthcare, finance, and smart cities.

Should I attend?

If you are a:

  • Test engineer, designer or test automation expert
  • Engineer working in test specification, automation, DevOps and RPA
  • Software developer or architect
  • Project leader or manager in digital transformation
  • Test tool or service provider
  • Test and quality assurance analyst

… then UCAAT 2021 will provide you with a unique opportunity to get together with your peers and exchange on experiences gained and lessons learned, both from the adoption of novel test automation techniques, methods, and tools and from the long-term application of test automation.

UCAAT 2021 TENTATIVE AGENDA (19-21 October).

The detailed programme of the event is provided below. Times indicated are Central European Summer Time (CEST).

  • 19 October: Pre-event Tutorials
  •  
     

    TUTORIALS

    • 08.55 am - 09.00 am: Opening Address
      Philip Makedonski (Programme Committee Chair, University of Göttingen)
    • 09.00 am - 10.00 am: Session 1 - Model-Based Testing (MBT) of Web and Mobile Applications: A Practical Tutorial
      Vahid Garousi (Software Engineering Consulting), Alper Buğra Keleş, Yunus Balaman (Testinium A.S.)
    • 10.00 am - 10.30 am: Coffee Break & Meeting Hub
      Please use this opportunity to connect with other attendees via the Meeting Hub
    • 10.30 am - 11.30 am: Session 2 - Let's build a Continuous Quality Assurance Strategy around your CI/CD Pipelines
      Szilárd Széll (Eficode Oy)
    • 11.30 am - 01.00 pm: Lunch Break & Meeting Hub
      Please use this opportunity to connect with other attendees via the Meeting Hub
    • 01:00 pm - 02:00 pm: Session 3 - Autonomous Real-time Testing
      Thomas Fehlmann (Euro Project Office AG)
    • 02:00 pm - 02:30 pm: Coffee Break & Meeting Hub
      Please use this opportunity to connect with other attendees via the Meeting Hub
    • 02:30 pm - 03:30 pm: Session 4 - A Practical Approach of ‘Standard to Validation’ Methodology
      Yann Garcia (FSCOM)
    • 03:35 pm - 04:00 pm: Live Panel Discussion and Q&A
      Moderator: 
      Philip Makedonski – Panellists: Vahid Garousi and/or Alper Buğra Keleş and/or Yunus Balaman and/or Zeynep Özdemir Güler, Szilárd Széll , Thomas Fehlmann, Yann Garcia
  • 20 October
  •  
     

     OPENING and KEYNOTE

    • 09:00 am - 09:20 am: Conference Opening
    • Philip Makedonski (Programme Committee Chair, University of Göttingen) and Dirk Tepelmann (ETSI MTS Chair)
    • 09:20 am - 10:00 am: Keynote followed by a Live Q&A - Testing at the Edge of Reality - Virtual Prototyping and Opportunities for Test Automation: Virtual Prototyping is essential for many development processes. It is used on the whole scale from simple visualizations of concepts to automated testing of complex machinery. The processes may cover robustness tests of individual components, integration tests to evaluate construction issues, and system tests to assess potential issues at runtime. One important focus for every machinery is the user interface. With virtual prototypes, we can transfer established standards from usability engineering and user experience design to designing user interfaces of technical devices. This includes enhanced prototyping, remote evaluation and even static testing of design concepts. In this talk, we will have a look at the opportunities for testing and evaluating user interfaces of technical devices and larger machinery and we will briefly introduce a framework for efficient creation and evaluation of virtual prototypes.
      Prof. Dr. Patrick Harms (Nürnberg Institute of Technology)
    • 10:00 am - 10:15 am: Coffee Break & Meeting Hub
      Please use this opportunity to connect with other attendees via the Meeting Hub

    SESSION:  5G and Networks

    • 10:15 am -  10:35 am:  Automated OTA Testing Needs and Challenges for 5G Devices
      Heinz Mellein (Rohde & Schwarz GmbH & Co.KG)
    • 10:35 am - 10:55 am: How to design a Cloud-Native Deployment and Test Pipeline for 5G
      Szilárd Széll (Eficode Oy)
    • 10:55 am - 11:15 am: Containerized Setup for Performance Tests of Communication Networks
      Valentin Egger (Carinthia University of Applied Sciences)
    • 11:15 am - 11:30 am: Coffee Break & Meeting Hub
      Please use this opportunity to connect with other attendees via the Meeting Hub 

    SESSION: AI and Regression Testing

    • 11:30 am - 11:50 am: Generate Automated Regression Tests from Execution Traces
      Julien Botella and Bruno Legeard (Smartesting)
    • 11:50 am - 12:10 pm: ETSI Standardization Perspectives on Frameworks Using AI in Test Systems and Testing and Certification of AI-Enabled Systems
      Tayeb Ben Meriem, Andreas Ulrich, Muslim Elkotob and Ranganai Chaparadza (Orange)
    • 12:10 pm - 12:30 pm: Test Case Selection based on Text Analytics of Software Artifacts
      Rajesh Kumar (Siemens)
    • 12:30 pm - 12:50 pm: Live Panel Discussion and Q&A
      Moderator: 
      Philip Makedonski – Panellists: Heinz Mellein, Szilárd Széll, Valentin Egger and/or Christoph Uran and/or Helmut Wöllik, Julien Botella and/or Bruno Legeard, Tayeb Ben Meriem and/or Andreas Ulrich and/or Muslim Elkotob and/or Ranganai Chaparadza, Rajesh Kumar
    • 12.50 pm - 02:00 pm: Lunch Break & Meeting Hub
      Please use this opportunity to connect with other attendees via the Meeting Hub

    SESSION: Standards and Security

    • 02:00 pm - 02:20 pm: One Platform to Test them All (IoT, NFV or MEC)
      Loic Baron (runningcode.io)
    • 02:20 pm - 02:40 pm: Integrating Open Sources CyberSecurity Tools into an Automated Testing System
      Sergio Borghese (NetResults S.r.l.)
    • 02:40 pm - 03:00 pm: 3 Things you Have Always Wanted to Know about the Test Description Language
      Martti Käärik (Estonia Elvior LLC)
    • 03:00 pm - 03:15 pm: Live Panel Discussion and Q&A
      Moderator:
      Will be announced soon – Panellists: Loic Baron, Sergio Borghese, Martti Käärik 
    • 03:15 pm - 03:30 pm: Coffee Break & Meeting Hub
      Please use this opportunity to connect with other attendees via the Meeting Hub

     

    SESSION: Model and Process Testing

    • 03:30 pm - 03:50 pm: Automatic Testing of Business Processes
      Emmanuel Gaudin (PragmaDev)
    • 03:50 pm - 04:10 pm: TDL-Based Automatic Detection of Interaction Errors
      Nader Kesserwan (Robert Morris University)
    • 04:10 pm - 04:25 pm: Poster Introduction
      1- Deployment of Keyword Testing for Vehicle Powertrain HIL Validation: Jean-Marie Quelin (Groupe Renault)
      2- A fully Automated Toolchain for Cross Browser UI Tests including AI-powered Reporting: Pascal Koenig (Siemens AG)
      3- How to Efficiently test RESTful Microservices with TTCN-3: Theofanis Vassiliou-Gioles (TU Berlin)
      4- Automated Conformance Testing of ETSI NFV APIs using Robot Framework: Giacomo Bernini (Nextworks)
    • 04:25 pm - 05:30 pm: Live Panel and Poster Discussion 
      Details will be announced soon

     

  • 21 October
  •  
     

    KEYNOTE

    • 09:00 am - 09:45 am: Keynote followed by a live Q&A - Interoperability in CI/CD and Why it Matters? The emergence of virtualization and cloud-native has resulted in tremendous advances in the telecommunications industry, speeding up the introduction of new services and CI/CD is one of the prerequisites and enablers of success. Despite its many advantages, the CI/CD ecosystem has its challenges and interoperability is one of them. This session will discuss issues arising from the lack of interoperability across proliferating CI/CD technologies and what open source communities are doing to address them in a collaborative manner. We will also highlight the necessity, and greater sustainability, of a holistic approach to interoperability in the CI/CD ecosystem and invite attendees to join community efforts.
      Fatih Degirmenci (Ericsson Software Technology)
    • 09:45 am - 10:15 am: Coffee Break & Meeting Hub
      Please use this opportunity to connect with other attendees via the Meeting Hub

    SESSION: Model-Based Testing

    • 10:15 am - 10:35 am: Using Tabular Notation to Support Model-Based Testing
    • Rachid Kherrazi (Akka Technologies)
    • 10:35 am - 10:55 am: Traceability Links among UCM, TDL and TTCN-3
    • Nader Kesserwan (Robert Morris University)
    • 10:55 am - 11:15 am: Evidence-Based Guidelines for Model-Based Testing: An Empirical Study
      Tomas Helmfridsson (Add Q), Emil Alégroth (Blekinge Institute of Technology)
    • 11:15 am - 11:30 am: Coffee Break & Meeting Hub
      Please use this opportunity to connect with other attendees via the Meeting Hub

    SESSION: Methodology 

    • 11:30 am - 11:50 am: 4 Pillars of Successful Agile Test Automation
      Mesut Durukal (Rapyuta Robotics)
    • 11:50 am - 12:10 am: Methodology for RESTful APIs Specifications and Testing
      Sana Zulfiqar (Flow Research Inc.), Michele Carignani (ETSI) - Philip Makedonski (Programme Committee Chair, University of Göttingen), and Martti Käärik (Estonia Elvior LLC)
    • 12:10 pm - 12:30 pm: Flow Model vs Page Object Pattern
      Péter Földházi (EPAM Systems USA)
    • 12:30 pm - 12:50 pm: Live Panel Discussion and Q&A
      Moderator:
      Will be announced soon – Panellists: Rachid Kherrazi, Nader Kesserwan, Emil Alégroth
    • 12:50 pm - 02:00 pm: Lunch Break & Meeting Hub
      Please use this opportunity to connect with other attendees via the Meeting Hub

    SESSION: AI 

    • 02:00 pm - 02:20 pm: Using ComputerVision and Machine Learning to Measure No Reference Video Streaming Quality
      Stefano Aru (NetResults Srl)
    • 02:20 pm - 02:40 pm: Using AI to Prioritize Static Analysis Findings
      Rix Groenboom (Parasoft Netherlands BV)
    • 02:40 pm - 03:00 pm: Evolution & Future of Software Testing
      Mesut Durukal  (Rapyuta Robotics)
    • 03:00 pm - 03:15 pm: Coffee Break & Meeting Hub
      Please use this opportunity to connect with other attendees via the Meeting Hub

    SESSION: Model Verification and Simulation

    • 03:15 pm - 03:35 pm: A Framework for Cloud-based Testing of Multi-variant Cyber-physical Systems
      Niels Hoppe (Fraunhofer)
    • 03:35 pm - 03:55 pm: Basic Test Set - Testing PSI5 Interfaces Made Easy
      Anna Neumann (iSyst Intelligente Systeme GmbH)
    • 03:55 pm - 04:15 pm: Live Panel Discussion and Q&A
      Moderator:
      Will be announced soon – Panellists: Stefano Aru, Rix Groenboom, Mesut Durukal, Niels Hoppe, Anna Neumann
    • 04:15 pm - 04:30 pm:  Conference Closing and Best presentation Award
      Philip Makedonski (Programme Committee Chair, University of Göttingen)

The independent programme committee is composed mostly of industry stakeholders nominated by the appointed Programme Committee Chair. The programme committee determines the call for presentations and evaluates the received presentation, poster, and tutorial proposals to select the best ones for the conference programme.

Programme Committee Chair:

  • Philip Makedonski, University of Göttingen

Programme Committee Members: 

  • Alexis Despeyroux, Testing Solutions and Services
  • Andreas Ulrich, Siemens AG
  • Anne Kramer, sepp.med GmbH
  • Carlos Cardenas, DEKRA Testing and Certification, S.A.U
  • Ceren Şahin, University of Luxembourg
  • Dirk Tepelmann, Spirent
  • Gjore Zaharchev, Seavus
  • Jorge Asensio, ARHS Developments
  • Jorge Pascal, Audi AG
  • Mark Beierl, Canonical Ltd
  • Martin Schneider, Fraunhofer FOKUS
  • Martti Käärik Elvior, LLC
  • Michele Carignani, ETSI
  • Muslim Elkotob, Vodafone
  • Pierre Lynch, Keysight
  • Raquel Jimenez, MTP
  • Rémi Caudwell, Sogeti
  • Sergio Borghese, NetResults Srl
  • Stephan Schulz, Giesecke + Devrient
  • Szilard Szell, Eficode Oy
  • Tibor Csöndes, Ericsson Hungary
  • Václav Vidoň, Kiwi.com
  • Zhen Ru Dai, Hamburg University of Applied Sciences (HAW)

UCAAT is an established series of annual events. Previous editions of the UCAAT have focused on different aspects of test automation following emerging trends through the years. Information about previous editions of the UCAAT, including the programmes and presentation slides, are available from the archived websites linked below. Browse through the archives and discover past experiences shared at UCAAT!

This short video will give you a quick overview of OnAir by EventsAir, the virtual platform used by ETSI for the 8th UCAAT - User Conference on Advanced Automated Testing.

For the best EventsAir experience, please use Google Chrome.


Watch the tutorial below:


tutorial 

 

GENERAL TROUBLESHOOTING

 
  • Devices that are not running on a windows Operating system (i.e. iPad, tablets) are not recommended. *Some up-to-date iPads may be able to connect via the Google Chrome app; however, it is still not recommended.  
  • Connect via Google Chrome or a chromium based web browser
  • Make sure your camera and microphone are set to "allow". See the Browser Settings Guide for instructions.
  • Your internet speed is important! A minimum of 4mbps is recommended. Check your internet speed
  • Disable ad-blockers or other browser extensions that may be interfering with the page
  • "Hard refresh" the page. This is done by pressing "Ctrl-F5" keys on Windows and "Cmd-Shift-R" on Mac
  • Close out of our browser completely, then relaunch the browser and try again
  • Clear your browser cache
  • Clear your browser's cookies.

SLOW VIDEO PLAYBACK

There could be several causes resulting in slow or interrupted video playback. In general, if you’re connecting over WiFi and experiencing constant rebuffering or other issues during playback, try moving your router to another location and away from other devices that may cause electrical interference. 

  • For optimal viewing experience, try running an Ethernet connection instead of WiFi
  • Move your wireless router to a more central location of your home/office
  • Move your wireless router to an elevated surface such as a desk or on top of a bookshelf
  • Clear clutter from the vicinity of your wireless router
  • Use a hardline internet connection if available.

Why Isn’t My Camera or Microphone Working? 




Refresh your OnAIR Portal. 

1. Click your initials/profile image in the top right corner of the portal. 

2. Select Refresh Data. 

or

Please reset or review your browser permissions for your camera and microphone. 

To check these settings have been allowed: 

1. Right click on the padlock icon in the URL bar and make sure Mic and Camera are both set to allow. 

2. Clicking on Site Permissions bring you to the full Site Permissions page for the Chrome browser. 

 

  

 

or

Let’s check your camera and microphone settings. In your Live Support Chat Box, please click on Check Camera & Mic in the lower right corner. This will let you select the correct camera and microphone. You know your video is correct when you can see your video preview. 

or

You may be having a browser issue. Are you using Google Chrome? That is our recommended browser. 

or

Your browser may not be allowing your audio or video. Are you able to go into your browser settings and make sure your browser is allowing use of your camera and microphone? (See Response One above for an illustration and steps). 

or

Are you on your office network? Some networks have firewalls that prevent these types of connections. One way to test this is to connect to a different network, even using your own mobile phone’s mobile hotspot. If you can use your microphone and camera, this will probably mean your office network is causing the issue.

 

Why Can’t I Hear any Audio? 

This can be caused by an office network with firewall or other restrictions. 

 

Are you using Chrome as your browser?
That is our recommended browser to use with OnAIR. 



Or refresh your OnAIR Portal. 

1. Click your initials/profile image in the top right corner of the portal. 

2. Select Refresh Data. 

or

Please go  out of the portal and clear your browser’s cache. 

or 

Are you on your office network? Some networks have firewalls that prevent these types of connections. One way to test this is to connect to a different network, even using your own mobile phone’s mobile hotspot. If you can use your microphone and camera, this will probably mean your office network is causing the issue. 

or

In AIRCast Studio, please click on the Audio/Video Issues link in the lower left corner. Once open, you can click on one of the two back up streams to see if that resolves your issue. 

or 

If you can’t hear any audio, try clicking on the MUTE/UNMUTE control on your video player. 

or

If you can’t hear any audio, make sure your computer’s audio control is NOT set to MUTE and the volume slider is NOT set to zero. 

or

check to see if your browser is using any extensions that may be blocking functionality in OnAIR. 

or

Let’s make sure your audio is not being played to a different audio device.

 

Why Can’t I See Any Video? 

 

Are you using Chrome as your browser? That is our recommended browser to use with OnAIR. 

Or 

Quickly refresh your OnAIR Portal. 

1. Click their initials/profile image in the top right corner of the portal. 

2. Select Refresh Data. 

 

How Do I Get to the Next Session? 

You should click on Back to Agenda in the top left corner of your screen. Once you are in the Timeline, you can join any other session, Meeting Hub, live Q&A Chat, On-demand videos and more. 

 

How do I mute my mic/video so I’m not visible to others in a session? 

If you have the option to be seen or heard then you will have a button with a picture of a mic or camera (for audio/video) that you can use to mute your mic or camera. 

If you don’t have these options visible to you then you aren’t able to share your mic or camera in the current session and won’t be heard or seen by the other attendees. 

 

Why Can’t I See My Name or Details in Meeting Hub? 

In the Meeting Hub users are not able to see their own profile. You can check the meeting hub and make a connection request with them to show they do appear in the hub. 

If they don’t appear in the hub it means they have opted out of the meeting hub, and this can be changed in their Profile Settings. 

 

How Do I Get My Notes from OnAIR? 

Any notes that you take throughout the event can be exported by selecting the Export icon in the top right of the screen near your Profile image. 

In addition, all Meeting Hub connections you have make with other OnAIR participants will save their contact information, that you can export using the Export option as well.

 

How Do I Add or Change my Profile Picture? 

When you first sign in to the OnAIR Portal, the Event Check In window displays, where you can update your profile, capture or add a profile photo and review your privacy settings. To edit or change these settings, please click on your profile photo at the top right of the screen and select My Settings. 

 

I’ve Changed My Profile Picture But It Isn’t Updating 

If an attendee has set a profile picture but aren’t able to see it first check that you’re able to see it (it should show on their virtual name badge in the live support window). 

If you’re able to see the image it’s likely that this is a caching issue.

 

How Do I Select Answers for the Meeting Hub Profile? 

When you first sign in to the OnAIR Portal, the Event Check In window displays, where you can answer the Meeting Hub Profile Questions. To return to your profile settings, please click on your profile photo at the top right of the screen and select My Settings.

 

Clearing the Browser Cache 

1. Open the Inspect option using one of these three options: a. Right click on the page and selecting inspect. 

b. Press F12 

c. Pressing Ctrl + Shift + i. 

 

2. A window will open in your browser. Right click on the refresh button, found to the left of the URL bar. 

3. Select Empty Cache and Hard Reload. 

4. Close the Inspect Window by clicking on the X in the top right corner of the Inspect Window. 

 

When advising an attendee to clear their cache to resolve an issue, we also recommend that they log out of the portal first, then clear their cache, then close their browser, then relaunch their browser and log back in to the OnAIR portal.

 

Any Questions? Contact us