UCAAT 2025 will be hosted by CERTH, the Center for Research & Technology - Hellas, in Thessaloniki, Greece, on 1-3 April 2025.

Overview

The annual ETSI User Conference on Advanced Automated Testing (UCAAT) is the most important point in the calendar of ETSI’s Technical Committee Methods for Testing and Specification (TC MTS).

ETSI's UCAAT conference, now in its eleventh edition, is dedicated to all aspects of automated testing, including model-based testing, cloud and mobile testing, security testing, agile test methodologies, test management, and standardized test specification, by focusing on the practical challenges that are often faced in industry and standardization as dictated by relevant policies and regulations.

UCAAT 2025: Automated Testing in a Digital Transformation World

As the world goes digital, rapidly evolving technology, policy, and regulation landscapes drive transformation across all industries. To stay competitive, facilitate swift market delivery, and meet escalating customer demands, organizations should prioritize customer-centric digital transformation while leveraging technologies such as AI, Big Data, IoT, and robotic operations and ensuring compliance with relevant policies and regulations.

The need for seamless, robust, and user-centered digital solutions highlights the critical role of automated testing in shaping future digital business operations or public services and improving customer and citizen satisfaction respectively. It is essential to ensure that systems operate reliably and are sufficiently scalable, secure and easily configurable to meet specific user requirements, which places additional demands on suitable testing methods, tools, and processes. Usability testing is essential in this context, as it ensures that the product is intuitive to use, ultimately leading to higher user satisfaction and reduced maintenance costs.

Additionally, ensuring cybersecurity becomes critical, considering the digital nature of services and products offered through digital transformation and the ever-increasing number of users relying on these services. Customers demand trustworthy and resilient systems, whose properties can only be guaranteed through vigorous security testing, quality assurance, and cyber resilience assessment that align well with policies and regulations such as the EU Cyber Resilience Act.

Similarly, the uptake of technologies related to big data and Artificial Intelligence poses additional challenges to digital solutions and products. The probabilistic nature of AI makes it particularly hard to use this technology in a safety-critical context. New testing techniques are therefore urgently needed. On a regulatory basis, the EU Artificial Intelligence Act plays a crucial role.

Another significant element, especially for digital public services, but not limited to them, is interoperability testing of digital systems even across borders, which has recently come into play with the enforcement of the Interoperable Europe Act, envisioning mandatory interoperability assessments for all public sector bodies. This will guarantee improved user experiences within and beyond the country of residence.

UCAAT 2025 will delve into the crucial role of automated testing in driving successful digital transformation. It will explore innovative solutions and best practices that empower organizations to thrive in an increasingly digital world while ensuring that user-centric and personalized approaches are central to testing strategies.

Target audience

The event is of particular interest for:

  • Test engineers, designers or test automation experts
  • Engineers working in test specification, automation, DevOps and RPA
  • Software developers or architects
  • Project leaders or managers in digital transformation
  • Test tool or service providers
  • Test and quality assurance analysts
  • Academics and researchers in testing

Important dates

  • Call for Presentation Deadline: 31 October 2024
  • Notification of Acceptation: 6 December 2024
  • Programme online: 13 December 2024
  • Presentation submission: 28 February 2025

 

  • Tuesday 1 April a.m.: Pre-Conference Tutorials, Workshops and Testhaton
  •  
     

    08:30 - 9.00: Registration

    09:00 - 12:30 TUTORIALS, WORKSHOPS & TESTATHON

    9:00 - 10:30 PARALLEL SESSION 1

    Tutorial 1: Beyond Software Automation: Real-Life Automation Solutions in Diverse Domains
    Dimitris Zikidis, Onelity

    Workshop 1: The Pipeline Game - an interactive game to learn CI/CD in practice
    Szilárd Széll, Eficode

    Workshop 2 - part 1: Build your own devicefarm
    Boris Wrubel and Adi Musilek

    SKILLAB Testathon - part 1
    Netcompany, CERTH, Eclipse, AUTH, UoM, DUTH

    10.30 - 11.00: Coffee Break

    11:00-12:30 PARALLEL SESSION 2

    Tutorial 2: Harnessing GenAI in Test Automation Frameworks
    Andreea Cosariu, FNT Software

    Workshop 2 - part 2: Build your own devicefarm
    Boris Wrubel and Adi Musilek

    SKILLAB Testathon - part 2
    Netcompany, CERTH, Eclipse, AUTH, UoM, DUTH

    12.30 - 14.00: Networking Lunch

  • Tuesday 1 April p.m.: Conference Day 1
  •  
     

    CONFERENCE DAY 1

    14.00 - 14.30: Conference Opening
    Philip Makedonski, ETSI TC MTS Chair
    Marija Jankovic, UCAAT 2025 Conference Chair

    14:30 - 15:15: KEYNOTE SPEECH
    Trends in Software Testing for Digital Transformation: Where DevOps Meets AI

    Zorica Bogdanovic, Faculty of Organizational Sciences, University of Belgrade

    15:15 - 16:15: SESSION 1 - DIGITALIZATION & INDUSTRIAL TESTING

    • 15:15 - 15:35: Test Environments for Decentralized Digital Product Passports
      Thomas Knothe and Patrick Gering, Fraunhofer IPK
    • 15:35 - 15:55: Automated Testing with Focus on Customer Needs
      Thomas Fehlmann and Eberhard Kranich, Euro Project Office AG
    • 15:55 - 16:15: Digital Twins and AI for Enhancing System Integration Testing
      Ana Madrid and Luis Redondo, MTP

    16.15 - 16.45: Coffee Break

    16:45 - 17:45: SESSION 2 - USER-CENTRIC TESTING

    • 16:45 - 17:05: Formative Usability Evaluation Techniques in User Interface Design: A Case Study from I4byDesign
      Anastasia Tsita, Christina Tsita, Fokion Tzourdas, Grigorios Matenoglou and Nikolaos Dimitriou, CERTH/ITI
    • 17:05 - 17:25: Automating Usability Testing for Scalable and User-Centric Digital Products
      Milovan Jovicic, Software Consultant
    • 17:25 - 17:45: Automated Accessibility Testing a showcase
      Boris Wrubel
  • Wednesday 2 April: Conference Day 2
  •  
     

    CONFERENCE DAY 2

    09.00 - 09.45: KEYNOTE SPEECH
    Intelligent Test Automation: Harnessing AI and Taming Human Error
    Baris Sarialioglu, TesterYou

     09:45 - 10:45: SESSION 3 - TESTING WITH AI & ML

    • 09:45 - 10:05: Generating Test Artifacts using Large Language Models
      Bassel Dib and Philip Makedonski, University of Gottingen
    • 10:05 - 10:25: Software Testing Leveraging AI
      Dušan Kostić, Milica Simić and Radovan Marković, University of Belgrade
    • 10:25-10:45: From Requirements to Tests: Automating Unit Test Generation for Test-Driven Development
      Benjamin Ledel and Lennard Strohmeyer, Digital Learning GmbH

    10:45 - 11:15 Coffee break

    11:15 - 12:15: SESSION 4 - TESTING OF AI & ML

    • 11:15 - 11:35: ETSI TR103910: Test Methodology and Test Specification for AI-enabled Systems
      Jürgen Großmann, Philip Makedonski and Taras Holoyad, Fraunhofer Fokus
    • 11:35 - 11:55: Overview of Methodologies for Testing AI Robustness and Explainability in Highly Dynamic and Scalable Environments
      Thanasis Kotsiopoulos, Alexandros Nizamis, Usman Wajid and Konstantinos Votis, CERTH/ITI
    • 11:55 - 12:15: Exploring the Landscape of Machine Learning Data Bugs: Frequency, Impacts, and Relationships for Enhanced Automation
      Emmanuel Charleson Dapaah and Jens Grabowski, University of Gottingen

    12:15 -12:30 POSTERS INTRODUCTION

    12.30 - 14:00: Networking Lunch

    14:00 - 15:00: SPECIAL SESSION - Evolution of TTCN3
    Jens Grabowski, University of Gottingen

    15:00 - 16:00: SESSION 5 - 5G & MOBILE TESTING

    • 15:00 - 15:20: Enhancing 5G Cloud Infrastructure Testing with Automated Custom Log Analyzers
      Adrian-Damian Dediu, Nokia Romania
    • 15:20 - 15:40: Automated Testing of Mobile-App and ΙοΤ Embedded Device Integration
      Apostolos Kroustallakidis, Theodoros Kyriakidis and Stefanos Skalistis, GWF
      15:40 - 16:00: Testing and Characterization of AI Model in STT and TTS for Phone Applications
      Annapia Rinaldi, Paolo Labruna and Sergio Borghese, NetResults S.r.l.

    16:00 - 16:30: Coffee break

    16:30 - 17:50: SESSION 6 - REGULATORY COMPLIANCE & STANDARDIZATION

    • 16:30 - 16:50: Towards a Harmonized Documentation Scheme for Trustworthy AI
      Gerhard Runze, imbus AG
    • 16:50 - 17:10: Documentation Approaches for AI/ML Systems
      Sonal Lakhotia and Philip Makedonski, University of Gottingen
    • 17:10 - 17:30: Enabling Cyber Resilience in Smart Cities
      Sofia Tsekeridou, Dimitrios Skias and Konstantinos Chisiridis, Netcompany
    • 17:30 - 17:50: TDL Takes on the Edge
      Martti Käärik, Philip Makedonski and Finn Kristoffersen, Elvior

     19:00 - 23.00: SOCIAL EVENT

  • Thursday 3 April: Conference Day 3
  •  
     

    CONFERENCE DAY 3

     09:00 - 09:45: KEYNOTE SPEECH

    Leveraging Large Language Models in Automated Testing: Navigating the Promise and Perils in Digital Transformation
    Predrag Skokovic, Quality House

    09:45 - 10:45: SESSION 7 - TEST AUTOMATION CHALLENGES

    • 09:45 - 10:05: The Three-Pillar, Balanced Quality Model of Business Agility
      Szilárd Széll, Eficode
    • 10:05 - 10:25: Test Automation Pitfalls and How to Avoid Them
      Pablo Garcia, Sharpness AB
    • 10:25 - 10:45: Ricochet Bugs – Why Discovery in Nightlies is Too Late to Catch Regressions
      Stephan Schulz, Giesecke & Devrient

    10:45 - 11:15: Coffee Break

    11:15 - 12:15: SESSION 8 - TEST AUTOMATION STRATEGIES

    • 11:15 - 11:35: Balancing Safety and Speed to Improve Software Delivery in Government Benefit Modernization Programs
      Sean Eddings and Rob Bayliss, Mighty Acorn Digital
    • 11:35 - 11:55: Shift Left, Test Right: The Art of Continuous Performance Testing
      Mesut Gunes, VNGRS
    • 11:55 - 12:15: Focus on the Failure
      Jozsef Panczel, SAP AG

    12:15 - 13:15: Lunch

    13:15 - 14:15 SESSION 9 - SECURITY TESTING

    • 13:15 - 13:35: Security Testing of IoT Protocols Using Grammar-based Genetic Fuzzing
      Roman Kraus, Steffen Lüdtke, Ramon Barakat and Martin Schneider, Fraunhofer FOKUS
    • 13:35 - 13:55: Driving Innovation in the Fight against Digital AI Threats
      Jaime Morales, Ciberso
    • 13:55 - 14:15: Continuous Security Testing in the Ever-Evolving API Landscape
      Dimitrios Papadimas, Panagiotis Saltaferas, Dimitris Bougioukos and Varvara Menta, Netcompany

    14:15 - 14.45: BEST PAPER AWARD and CONFERENCE CLOSING

The independent Programme Committee includes representatives from the testing industry, users, academia, and standardization bodies across different domains and different regions nominated by the appointed Programme Committee Chair.
The Programme Committee determines the call for presentations and evaluates the received presentations, posters, and tutorial proposals to select the best ones for the conference programme.

Programme Committee Chair:

Marija Jankovic, CERTH, Greece

Programme Committee Members: 

Nenad Anicic, Faculty of Organizational Sciences, University of Belgrade, Serbia
Daniel Ardelean, Nokia, Romania
Sergio Borghese, NetResults Srl, Italy
Michele Carignani, Autostrade per l’Italia, Italy
Rémi Caudwell, Sogeti, France
Theodore Chaikalis, Mysten Labs, Greece
Alexandros Chatzigeorgiou, University of Macedonia, Greece
Alexis Despeyroux, Testing Solutions and Services, France
Sascha Hackel, Fraunhofer Fokus, Germany
Dimosthenis Ioannidis, CERTH, Greece
Raquel Jimenez, MTP
Martti Käärik, Elvior, Estonia
Philip Makedonski, University of Göttingen, Germany
Sebastian Müller, ETSI, France
Maria-Olga Raimondo, Onelity, Greece
Stephan Schulz, Giesecke + Devrient, Germany
Pedrag Skokovic, Quality House, Serbia
Szilard Szell, Eficode Oy, Finland
Dirk Tepelmann, Gematik, Germany
Jan Tretmans TNO NL
Sofia Tsekeridou, Netcompany - Intrasoft, Greece
Andreas Ulrich, Siemens, Germany
Kyriaki Vadeska, GRTB/WeTest.Athens, Greece
Laurent Velez, ETSI, France

UCAAT 2025 is currently Calling for Exhibitors.

Should you wish to exhibit at UCAAT 2025, and introduce your organization, company, product or service to people interested in advanced automated testing,
complete and return the Exhibitor application form to events@etsi.org.

Exhibition Stands are free of charge and consist of:
• A 4sqm stand with 1 table, 2 chairs, 1 screen, electricity and internet connection
• Possibility to display company’s own exhibition material on the stand (pop up, banner...)

Exhibitors will be listed on the website, with Company logo linking to company website and 10 lines company profile

Should you need any further information, please contact events@etsi.org

UCAAT is an established series of annual events. Previous editions of the UCAAT have focused on different aspects of test automation following emerging trends through the years. Information about previous editions of the UCAAT, including the programmes and presentation slides, are available from the archived websites linked below. Browse through the archives and discover past experiences shared at UCAAT!

seetest 2024 002Get ready for SEETEST 2024, the renowned international software testing conference, happening on September 26-27, 2024, in Zagreb, Croatia, and online.
This year's hybrid event offers insightful keynotes, tutorials, and networking opportunities.
On September 26, attendees can participate in 8 tutorials, followed by keynotes and presentations on September 27. Pre-conference courses are available on September 25 for those seeking deeper learning. Don't miss SEETEST’s Social Event to unwind and network in a relaxed setting after a day of learning.

 

Wetest2020Logo

WeTest.Athens is an annual, non-profit software testing conference dedicated to fostering knowledge and networking opportunities within the software testing community. Organized by the community, for the community, our goal is to provide a vibrant, non-corporate event that combines informative sessions, engaging activities, and a fair price. Join us on 20th May 2025, to learn from industry experts, connect with peers, and enjoy the cool vibes of Athens! 

MAIN LOGOWeTest. Athens is organized by GRTB, the ISTQB representative for Greece, that aims to create a robust ISTQB-ready ecosystem in the country. Our mission is to accredit training providers and offer certification examinations for all available ISTQB certifications. With the support of the software community and academia, we aspire to build one of the strongest software testing communities in Europe. 

 

thessaloniki meetupThessaloniki Software Testing and QA Meetup is a local community interested in:
• Software Testing
• Quality Assurance
• Test Automation and
• QA Processes
Our mission is to build a strong community in the city of Thessaloniki, aiming to exchange experiences, discuss the latest trends in software testing, and get to know each other. We strive to create an environment where professionals and enthusiasts in the field can share their knowledge, get inspired, and develop their skills. We believe in the power of community and want to promote the exchange of ideas and mutual assistance through presentations, workshops, and networking events. Whether you are an experienced professional or just have an interest in software testing and QA, you are welcome to become a member of our community and actively participate in our meetings.

Come share your knowledge, get trained, and connect with other professionals in the field of software testing and quality assurance, all in a friendly and supportive environment. Join us here.

LOCATION

The 11th UCAAT will take place in the CERTH Conference Center

WELCOME TO THESSALONIKI!

Thessaloniki is the Greek capital of Balkans, and the country’s gastronomic and cultural capital. It is one of the largest student centers in South-Eastern Europe while 15 of its monuments are included on the UNESCO World Heritage List... (learn more)

AIRPORT

Thessalonili Airport Makedonia

HOTEL RECOMMENDATIONS

Hotels near CERTH

HOTEL NIKOPOLIS (5*)
reservations@hotel-nikopolis.com
tel.: +30 2310 401000
https://goo.gl/maps/d2CpnjPZhj92

HOTEL AVALON (4*)
info@avalonhotel.gr
tel.: +30 2310 462700 fax.: +30 2340 463898
https://goo.gl/maps/mtmQV6UBVNp

Hotels in the city center

ELECTRA PALACE HOTEL (5*)
infoskg@electrahotels.gr
tel.: +30 2310 294040 fax.: +30 2310 294001
https://goo.gl/maps/PocaLkotyS32

MAKEDONIA PALACE (5*)
info@makedoniapalace.gr
tel. +30 2310 897197
https://goo.gl/maps/KUbdq3ZQQUs

THE MET HOTEL (5*)
themethotel@chandris.gr
tel.: +30 2310 017000
https://goo.gl/maps/cXzyDy45HuG2

CITY HOTEL (4*)
info@cityhotel.gr
tel.: +30 2310 269421
https://goo.gl/maps/ikoCAixV29S2

HOTEL EGNATIA PALACE (4*)
reservation@egnatiapalace.gr
tel.: +30 2310 222900
https://goo.gl/maps/L2FQ6HHkzrQ2

ANATOLIA HOTEL (4*)
info@anatoliahotels.gr
tel.: +30 2310 522 422
https://goo.gl/maps/9MuSrDPK7fx

PARK HOTEL (3*)
info@parkhotel.com.gr
tel.: +30 2310 524121
https://goo.gl/maps/myzHX3C2XWk

HOTEL OLYMPIA (3*)
welcome@hotelolympia.gr
tel.: +30 2310 366 466
https://goo.gl/maps/KYWvLa1gkj72

The Mavili Urban Stay (3*)
T: +30 2310 53 00 63
https://maps.app.goo.gl/MH4iCZWigXQRfQNb6

Any Questions? Contact us

Recognition & Thanks