UCAAT 2025 will be hosted by CERTH, the Center for Research & Technology - Hellas, in Thessaloniki, Greece, on 1-3 April 2025.
Overview
The annual ETSI User Conference on Advanced Automated Testing (UCAAT) is the most important point in the calendar of ETSI’s Technical Committee Methods for Testing and Specification (TC MTS).
ETSI's UCAAT conference, now in its eleventh edition, is dedicated to all aspects of automated testing, including model-based testing, cloud and mobile testing, security testing, agile test methodologies, test management, and standardized test specification, by focusing on the practical challenges that are often faced in industry and standardization as dictated by relevant policies and regulations.
UCAAT 2025: Automated Testing in a Digital Transformation World
As the world goes digital, rapidly evolving technology, policy, and regulation landscapes drive transformation across all industries. To stay competitive, facilitate swift market delivery, and meet escalating customer demands, organizations should prioritize customer-centric digital transformation while leveraging technologies such as AI, Big Data, IoT, and robotic operations and ensuring compliance with relevant policies and regulations.
The need for seamless, robust, and user-centered digital solutions highlights the critical role of automated testing in shaping future digital business operations or public services and improving customer and citizen satisfaction respectively. It is essential to ensure that systems operate reliably and are sufficiently scalable, secure and easily configurable to meet specific user requirements, which places additional demands on suitable testing methods, tools, and processes. Usability testing is essential in this context, as it ensures that the product is intuitive to use, ultimately leading to higher user satisfaction and reduced maintenance costs.
Additionally, ensuring cybersecurity becomes critical, considering the digital nature of services and products offered through digital transformation and the ever-increasing number of users relying on these services. Customers demand trustworthy and resilient systems, whose properties can only be guaranteed through vigorous security testing, quality assurance, and cyber resilience assessment that align well with policies and regulations such as the EU Cyber Resilience Act.
Similarly, the uptake of technologies related to big data and Artificial Intelligence poses additional challenges to digital solutions and products. The probabilistic nature of AI makes it particularly hard to use this technology in a safety-critical context. New testing techniques are therefore urgently needed. On a regulatory basis, the EU Artificial Intelligence Act plays a crucial role.
Another significant element, especially for digital public services, but not limited to them, is interoperability testing of digital systems even across borders, which has recently come into play with the enforcement of the Interoperable Europe Act, envisioning mandatory interoperability assessments for all public sector bodies. This will guarantee improved user experiences within and beyond the country of residence.
UCAAT 2025 will delve into the crucial role of automated testing in driving successful digital transformation. It will explore innovative solutions and best practices that empower organizations to thrive in an increasingly digital world while ensuring that user-centric and personalized approaches are central to testing strategies.
Target audience
The event is of particular interest for:
- Test engineers, designers or test automation experts
- Engineers working in test specification, automation, DevOps and RPA
- Software developers or architects
- Project leaders or managers in digital transformation
- Test tool or service providers
- Test and quality assurance analysts
- Academics and researchers in testing
Important dates
- Call for Presentation Deadline: 31 October 2024
- Notification of Acceptation: 6 December 2024
- Programme online: 13 December 2024
- Presentation submission: 28 February 2025
- Tuesday 1 April a.m.: Pre-Conference Tutorials, Workshops and Testhaton
08:30 - 9.00: Registration
09:00 - 12:30 TUTORIALS, WORKSHOPS & TESTATHON
9:00 - 10:30 PARALLEL SESSION 1
Tutorial 1: Beyond Software Automation: Real-Life Automation Solutions in Diverse Domains
Dimitris Zikidis, OnelityWorkshop 1: The Pipeline Game - an interactive game to learn CI/CD in practice
Szilárd Széll, EficodeWorkshop 2 - part 1: Build your own devicefarm
Boris Wrubel and Adi MusilekSKILLAB Testathon - part 1
Netcompany, CERTH, Eclipse, AUTH, UoM, DUTH10.30 - 11.00: Coffee Break
11:00-12:30 PARALLEL SESSION 2
Tutorial 2: Harnessing GenAI in Test Automation Frameworks
Andreea Cosariu, FNT SoftwareWorkshop 2 - part 2: Build your own devicefarm
Boris Wrubel and Adi MusilekSKILLAB Testathon - part 2
Netcompany, CERTH, Eclipse, AUTH, UoM, DUTH12.30 - 14.00: Networking Lunch
- Tuesday 1 April p.m.: Conference Day 1
CONFERENCE DAY 1
14.00 - 14.30: Conference Opening
Philip Makedonski, ETSI TC MTS Chair
Marija Jankovic, UCAAT 2025 Conference Chair14:30 - 15:15: KEYNOTE SPEECH
Trends in Software Testing for Digital Transformation: Where DevOps Meets AI
Zorica Bogdanovic, Faculty of Organizational Sciences, University of Belgrade15:15 - 16:15: SESSION 1 - DIGITALIZATION & INDUSTRIAL TESTING
- 15:15 - 15:35: Test Environments for Decentralized Digital Product Passports
Thomas Knothe and Patrick Gering, Fraunhofer IPK - 15:35 - 15:55: Automated Testing with Focus on Customer Needs
Thomas Fehlmann and Eberhard Kranich, Euro Project Office AG - 15:55 - 16:15: Digital Twins and AI for Enhancing System Integration Testing
Ana Madrid and Luis Redondo, MTP
16.15 - 16.45: Coffee Break
16:45 - 17:45: SESSION 2 - USER-CENTRIC TESTING
- 16:45 - 17:05: Formative Usability Evaluation Techniques in User Interface Design: A Case Study from I4byDesign
Anastasia Tsita, Christina Tsita, Fokion Tzourdas, Grigorios Matenoglou and Nikolaos Dimitriou, CERTH/ITI - 17:05 - 17:25: Automating Usability Testing for Scalable and User-Centric Digital Products
Milovan Jovicic, Software Consultant - 17:25 - 17:45: Automated Accessibility Testing a showcase
Boris Wrubel
- 15:15 - 15:35: Test Environments for Decentralized Digital Product Passports
- Wednesday 2 April: Conference Day 2
CONFERENCE DAY 2
09.00 - 09.45: KEYNOTE SPEECH
Intelligent Test Automation: Harnessing AI and Taming Human Error
Baris Sarialioglu, TesterYou09:45 - 10:45: SESSION 3 - TESTING WITH AI & ML
- 09:45 - 10:05: Generating Test Artifacts using Large Language Models
Bassel Dib and Philip Makedonski, University of Gottingen - 10:05 - 10:25: Software Testing Leveraging AI
Dušan Kostić, Milica Simić and Radovan Marković, University of Belgrade - 10:25-10:45: From Requirements to Tests: Automating Unit Test Generation for Test-Driven Development
Benjamin Ledel and Lennard Strohmeyer, Digital Learning GmbH
10:45 - 11:15 Coffee break
11:15 - 12:15: SESSION 4 - TESTING OF AI & ML
- 11:15 - 11:35: ETSI TR103910: Test Methodology and Test Specification for AI-enabled Systems
Jürgen Großmann, Philip Makedonski and Taras Holoyad, Fraunhofer Fokus - 11:35 - 11:55: Overview of Methodologies for Testing AI Robustness and Explainability in Highly Dynamic and Scalable Environments
Thanasis Kotsiopoulos, Alexandros Nizamis, Usman Wajid and Konstantinos Votis, CERTH/ITI - 11:55 - 12:15: Exploring the Landscape of Machine Learning Data Bugs: Frequency, Impacts, and Relationships for Enhanced Automation
Emmanuel Charleson Dapaah and Jens Grabowski, University of Gottingen
12:15 -12:30 POSTERS INTRODUCTION
12.30 - 14:00: Networking Lunch
14:00 - 15:00: SPECIAL SESSION - Evolution of TTCN3
Jens Grabowski, University of Gottingen15:00 - 16:00: SESSION 5 - 5G & MOBILE TESTING
- 15:00 - 15:20: Enhancing 5G Cloud Infrastructure Testing with Automated Custom Log Analyzers
Adrian-Damian Dediu, Nokia Romania - 15:20 - 15:40: Automated Testing of Mobile-App and ΙοΤ Embedded Device Integration
Apostolos Kroustallakidis, Theodoros Kyriakidis and Stefanos Skalistis, GWF
15:40 - 16:00: Testing and Characterization of AI Model in STT and TTS for Phone Applications
Annapia Rinaldi, Paolo Labruna and Sergio Borghese, NetResults S.r.l.
16:00 - 16:30: Coffee break
16:30 - 17:50: SESSION 6 - REGULATORY COMPLIANCE & STANDARDIZATION
- 16:30 - 16:50: Towards a Harmonized Documentation Scheme for Trustworthy AI
Gerhard Runze, imbus AG - 16:50 - 17:10: Documentation Approaches for AI/ML Systems
Sonal Lakhotia and Philip Makedonski, University of Gottingen - 17:10 - 17:30: Enabling Cyber Resilience in Smart Cities
Sofia Tsekeridou, Dimitrios Skias and Konstantinos Chisiridis, Netcompany - 17:30 - 17:50: TDL Takes on the Edge
Martti Käärik, Philip Makedonski and Finn Kristoffersen, Elvior
19:00 - 23.00: SOCIAL EVENT
- 09:45 - 10:05: Generating Test Artifacts using Large Language Models
- Thursday 3 April: Conference Day 3
CONFERENCE DAY 3
09:00 - 09:45: KEYNOTE SPEECH
Leveraging Large Language Models in Automated Testing: Navigating the Promise and Perils in Digital Transformation
Predrag Skokovic, Quality House09:45 - 10:45: SESSION 7 - TEST AUTOMATION CHALLENGES
- 09:45 - 10:05: The Three-Pillar, Balanced Quality Model of Business Agility
Szilárd Széll, Eficode - 10:05 - 10:25: Test Automation Pitfalls and How to Avoid Them
Pablo Garcia, Sharpness AB - 10:25 - 10:45: Ricochet Bugs – Why Discovery in Nightlies is Too Late to Catch Regressions
Stephan Schulz, Giesecke & Devrient
10:45 - 11:15: Coffee Break
11:15 - 12:15: SESSION 8 - TEST AUTOMATION STRATEGIES
- 11:15 - 11:35: Balancing Safety and Speed to Improve Software Delivery in Government Benefit Modernization Programs
Sean Eddings and Rob Bayliss, Mighty Acorn Digital - 11:35 - 11:55: Shift Left, Test Right: The Art of Continuous Performance Testing
Mesut Gunes, VNGRS - 11:55 - 12:15: Focus on the Failure
Jozsef Panczel, SAP AG
12:15 - 13:15: Lunch
13:15 - 14:15 SESSION 9 - SECURITY TESTING
- 13:15 - 13:35: Security Testing of IoT Protocols Using Grammar-based Genetic Fuzzing
Roman Kraus, Steffen Lüdtke, Ramon Barakat and Martin Schneider, Fraunhofer FOKUS - 13:35 - 13:55: Driving Innovation in the Fight against Digital AI Threats
Jaime Morales, Ciberso - 13:55 - 14:15: Continuous Security Testing in the Ever-Evolving API Landscape
Dimitrios Papadimas, Panagiotis Saltaferas, Dimitris Bougioukos and Varvara Menta, Netcompany
14:15 - 14.45: BEST PAPER AWARD and CONFERENCE CLOSING
- 09:45 - 10:05: The Three-Pillar, Balanced Quality Model of Business Agility
The independent Programme Committee includes representatives from the testing industry, users, academia, and standardization bodies across different domains and different regions nominated by the appointed Programme Committee Chair.
The Programme Committee determines the call for presentations and evaluates the received presentations, posters, and tutorial proposals to select the best ones for the conference programme.
Programme Committee Chair:
Marija Jankovic, CERTH, Greece
Programme Committee Members:
Nenad Anicic, Faculty of Organizational Sciences, University of Belgrade, Serbia
Daniel Ardelean, Nokia, Romania
Sergio Borghese, NetResults Srl, Italy
Michele Carignani, Autostrade per l’Italia, Italy
Rémi Caudwell, Sogeti, France
Theodore Chaikalis, Mysten Labs, Greece
Alexandros Chatzigeorgiou, University of Macedonia, Greece
Alexis Despeyroux, Testing Solutions and Services, France
Sascha Hackel, Fraunhofer Fokus, Germany
Dimosthenis Ioannidis, CERTH, Greece
Raquel Jimenez, MTP
Martti Käärik, Elvior, Estonia
Philip Makedonski, University of Göttingen, Germany
Sebastian Müller, ETSI, France
Maria-Olga Raimondo, Onelity, Greece
Stephan Schulz, Giesecke + Devrient, Germany
Pedrag Skokovic, Quality House, Serbia
Szilard Szell, Eficode Oy, Finland
Dirk Tepelmann, Gematik, Germany
Jan Tretmans TNO NL
Sofia Tsekeridou, Netcompany - Intrasoft, Greece
Andreas Ulrich, Siemens, Germany
Kyriaki Vadeska, GRTB/WeTest.Athens, Greece
Laurent Velez, ETSI, France
UCAAT 2025 is currently Calling for Exhibitors.
Should you wish to exhibit at UCAAT 2025, and introduce your organization, company, product or service to people interested in advanced automated testing,
complete and return the Exhibitor application form to events@etsi.org.
Exhibition Stands are free of charge and consist of:
• A 4sqm stand with 1 table, 2 chairs, 1 screen, electricity and internet connection
• Possibility to display company’s own exhibition material on the stand (pop up, banner...)
Exhibitors will be listed on the website, with Company logo linking to company website and 10 lines company profile
Should you need any further information, please contact events@etsi.org
UCAAT is an established series of annual events. Previous editions of the UCAAT have focused on different aspects of test automation following emerging trends through the years. Information about previous editions of the UCAAT, including the programmes and presentation slides, are available from the archived websites linked below. Browse through the archives and discover past experiences shared at UCAAT!
- UCAAT 2023
- UCAAT 2022
- UCAAT 2021
- UCAAT 2020 (cancelled)
- UCAAT 2019
- UCAAT 2018
- UCAAT 2017
- UCAAT 2016
- UCAAT 2015
- UCAAT 2014
- UCAAT 2013
Get ready for SEETEST 2024, the renowned international software testing conference, happening on September 26-27, 2024, in Zagreb, Croatia, and online.
This year's hybrid event offers insightful keynotes, tutorials, and networking opportunities.
On September 26, attendees can participate in 8 tutorials, followed by keynotes and presentations on September 27. Pre-conference courses are available on September 25 for those seeking deeper learning. Don't miss SEETEST’s Social Event to unwind and network in a relaxed setting after a day of learning.
WeTest.Athens is an annual, non-profit software testing conference dedicated to fostering knowledge and networking opportunities within the software testing community. Organized by the community, for the community, our goal is to provide a vibrant, non-corporate event that combines informative sessions, engaging activities, and a fair price. Join us on 20th May 2025, to learn from industry experts, connect with peers, and enjoy the cool vibes of Athens!
WeTest. Athens is organized by GRTB, the ISTQB representative for Greece, that aims to create a robust ISTQB-ready ecosystem in the country. Our mission is to accredit training providers and offer certification examinations for all available ISTQB certifications. With the support of the software community and academia, we aspire to build one of the strongest software testing communities in Europe.
Thessaloniki Software Testing and QA Meetup is a local community interested in:
• Software Testing
• Quality Assurance
• Test Automation and
• QA Processes
Our mission is to build a strong community in the city of Thessaloniki, aiming to exchange experiences, discuss the latest trends in software testing, and get to know each other. We strive to create an environment where professionals and enthusiasts in the field can share their knowledge, get inspired, and develop their skills. We believe in the power of community and want to promote the exchange of ideas and mutual assistance through presentations, workshops, and networking events. Whether you are an experienced professional or just have an interest in software testing and QA, you are welcome to become a member of our community and actively participate in our meetings.
Come share your knowledge, get trained, and connect with other professionals in the field of software testing and quality assurance, all in a friendly and supportive environment. Join us here.
LOCATION
The 11th UCAAT will take place in the CERTH Conference Center
WELCOME TO THESSALONIKI!
Thessaloniki is the Greek capital of Balkans, and the country’s gastronomic and cultural capital. It is one of the largest student centers in South-Eastern Europe while 15 of its monuments are included on the UNESCO World Heritage List... (learn more)
AIRPORT
Thessalonili Airport Makedonia
HOTEL RECOMMENDATIONS
Hotels near CERTH
HOTEL NIKOPOLIS (5*)
reservations@hotel-nikopolis.com
tel.: +30 2310 401000
https://goo.gl/maps/d2CpnjPZhj92
HOTEL AVALON (4*)
info@avalonhotel.gr
tel.: +30 2310 462700 fax.: +30 2340 463898
https://goo.gl/maps/mtmQV6UBVNp
Hotels in the city center
ELECTRA PALACE HOTEL (5*)
infoskg@electrahotels.gr
tel.: +30 2310 294040 fax.: +30 2310 294001
https://goo.gl/maps/PocaLkotyS32
MAKEDONIA PALACE (5*)
info@makedoniapalace.gr
tel. +30 2310 897197
https://goo.gl/maps/KUbdq3ZQQUs
THE MET HOTEL (5*)
themethotel@chandris.gr
tel.: +30 2310 017000
https://goo.gl/maps/cXzyDy45HuG2
CITY HOTEL (4*)
info@cityhotel.gr
tel.: +30 2310 269421
https://goo.gl/maps/ikoCAixV29S2
HOTEL EGNATIA PALACE (4*)
reservation@egnatiapalace.gr
tel.: +30 2310 222900
https://goo.gl/maps/L2FQ6HHkzrQ2
ANATOLIA HOTEL (4*)
info@anatoliahotels.gr
tel.: +30 2310 522 422
https://goo.gl/maps/9MuSrDPK7fx
PARK HOTEL (3*)
info@parkhotel.com.gr
tel.: +30 2310 524121
https://goo.gl/maps/myzHX3C2XWk
HOTEL OLYMPIA (3*)
welcome@hotelolympia.gr
tel.: +30 2310 366 466
https://goo.gl/maps/KYWvLa1gkj72
The Mavili Urban Stay (3*)
T: +30 2310 53 00 63
https://maps.app.goo.gl/MH4iCZWigXQRfQNb6