ETSI Conformance Testing

Introduction

Conformance testing is done to determine whether a system meets a specified standard. ETSI has over ten years' experience producing conformance test specifications for UMTS, IPv6, HiperMAN, WiMAX, GSM, DECT, TETRA, ISDN, VoIP and other key technologies. These test specifications are used by manufacturers as a basis for internal development testing.

ETSI test specifications are usually developed by a Specialist Task Force (STF), which is a group of experts recruited from the ETSI membership and managed by the Centre for Testing and Interoperability.

Conformance Testing for Interoperability

ETSI test specifications are designed to concentrate on areas critical to interoperability, including testing an implementation's reaction to erroneous behaviour. The goal is conformance testing for interoperability. This should not be confused with interoperability testing, which is a useful, but different, activity. The two approaches are complementary rather than competitive, which is why ETSI also provides a Plugtests Service for interoperability events for standards and product validation. A focused set of conformance tests can provide an excellent framework for subsequent interoperability testing.

Conformance Testing feedback into Standards Making Process

In many cases, development of the test specifications gives valuable feedback to the base standards. The test specifiers make a special effort to ensure that their experiences are fed back to the relevant ETSI technical committee. However, development of the base standard and of test specifications must be done in a coordinated and timely manner for this input to be effective.

Download the Methods for testing and Specification technology leaflet
Download the Global Testing Language (TTCN3) technology leaflet
Download the IMS Network Testing technology leaflet



Our Role & Activities

Testing Methodology Respected by ETSI

ETSI follows the well-proven testing methodology defined in ISO/IEC 9146. This standard, which covers the entire testing process, provides an excellent basis for the development of high-quality test specifications.

The following diagram shows the development of test specifications process, acronyms are explained below.

Diagram showing development of test specifications process

Test specifications development process

The Implementation Conformance Statement (ICS) is a checklist of the capabilities supported by the Implementation Under Test (IUT). It provides an overview of the features and options that are implemented. The ICS can be used to select and parameterise test cases and as an indicator for basic interoperability between different products.

The Test Suite Structure and Test Purpose (TSS&TP) are derived from the relevant base standards. They provide an informal, easy-to-read description of each test, concentrating on the meaning of the test rather than detailing how it may be achieved. Test Purposes are grouped into a logical Test Suite Structure according to suitable criteria (basic interconnection, error handling, functionality etc.).

The Abstract Test Suite (ATS) is the entire collection of Test Cases. Each Test Case specifies the detailed coding of the Test Purposes, written in the standardized test specification language TTCN.

The Implementation eXtra Information for Testing (IXIT) contains additional information (specific adresses, timer values etc.) necessary for testing.

The Executable Test Suite (ETS) can be quickly and easily implemented from the ATS using the TTCN compilers available on most modern test tool platforms.

Standards

The following is a list of the 20 latest published ETSI standards on conformance testing.

A full list of related standards in the public domain is accessible via the ETSI standards search. Via this interface you can also subscribe for alerts on updates of ETSI standards.

Keywords related to testing:

  • ATS (Abstract Test Suite)
  • TTCN
  • TTCN-3
  • PICS (Protocol Implementation Conformance Statement)
  • ICS (Implementation Conformance Statement)
  • TSS&TP (Test suite structure and Test purposes)
  • Testing
  • Conformance

For work in progress see the ETSI Work Programme on the Portal.

Standard No. Standard title.
TS 134 123-3 Universal Mobile Telecommunications System (UMTS); User Equipment (UE) conformance specification; Part 3: Abstract test suite (ATS) (3GPP TS 34.123-3 version 13.0.0 Release 13)
TS 134 123-3 Universal Mobile Telecommunications System (UMTS); User Equipment (UE) conformance specification; Part 3: Abstract test suite (ATS) (3GPP TS 34.123-3 version 12.5.0 Release 12)
TS 134 108 Universal Mobile Telecommunications System (UMTS); LTE; Common test environments for User Equipment (UE); Conformance testing (3GPP TS 34.108 version 12.3.0 Release 12)
TS 136 508 LTE; Evolved Universal Terrestrial Radio Access (E-UTRA) and Evolved Packet Core (EPC); Common test environments for User Equipment (UE) conformance testing (3GPP TS 36.508 version 13.0.1 Release 13)
TS 131 124 Universal Mobile Telecommunications System (UMTS); LTE; Mobile Equipment (ME) conformance test specification; Universal Subscriber Identity Module Application Toolkit (USAT) conformance test specification (3GPP TS 31.124 version 13.5.0 Release 13)
TS 137 571-5 Universal Mobile Telecommunications System (UMTS); LTE; Universal Terrestrial Radio Access (UTRA) and Evolved UTRA (E-UTRA) and Evolved Packet Core (EPC); User Equipment (UE) conformance specification for UE positioning; Part 5: Test scenarios and assistance data (3GPP TS 37.571-5 version 13.0.0 Release 13)
TS 134 229-3 Universal Mobile Telecommunications System (UMTS); LTE; Internet Protocol (IP) multimedia call control protocol based on Session Initiation Protocol (SIP) and Session Description Protocol (SDP); User Equipment (UE) conformance specification; Part 3: Abstract test suite (ATS) (3GPP TS 34.229-3 version 11.5.0 Release 11)
TS 136 521-3 LTE; Evolved Universal Terrestrial Radio Access (E-UTRA); User Equipment (UE) conformance specification; Radio transmission and reception; Part 3: Radio Resource Management (RRM) conformance testing (3GPP TS 36.521-3 version 10.5.0 Release 10)
TR 136 905 LTE; Evolved Universal Terrestrial Radio Access (E-UTRA) and Evolved Universal Terrestrial Radio Access Network (E-UTRAN); Derivation of test points for radio transmission and reception conformance test cases (3GPP TR 36.905 version 12.3.0 Release 12)
TS 136 508 LTE; Evolved Universal Terrestrial Radio Access (E-UTRA) and Evolved Packet Core (EPC); Common test environments for User Equipment (UE) conformance testing (3GPP TS 36.508 version 12.10.0 Release 12)
TS 103 106 Speech and multimedia Transmission Quality (STQ); Speech quality performance in the presence of background noise: Background noise transmission for mobile terminals-objective test methods
TS 131 121 Universal Mobile Telecommunications System (UMTS); LTE; UICC-terminal interface; Universal Subscriber Identity Module (USIM) application test specification (3GPP TS 31.121 version 13.4.0 Release 13)
TS 137 145-1 Universal Mobile Telecommunications System (UMTS); LTE; Active Antenna System (AAS) Base Station (BS) conformance testing; Part 1: conducted conformance testing (3GPP TS 37.145-1 version 13.0.0 Release 13)
TS 151 010-4 Digital cellular telecommunications system (Phase 2+) (GSM); Mobile Station (MS) conformance specification; Part 4: Subscriber Identity Module (SIM) application toolkit conformance test specification (3GPP TS 51.010-4 version 12.3.0 Release 12)
TS 151 010-4 Digital cellular telecommunications system (Phase 2+) (GSM); Mobile Station (MS) conformance specification; Part 4: Subscriber Identity Module (SIM) application toolkit conformance test specification (3GPP TS 51.010-4 version 13.1.0 Release 13)
TS 137 145-2 Universal Mobile Telecommunications System (UMTS); LTE; Active Antenna System (AAS) Base Station (BS) conformance testing; Part 2: radiated conformance testing (3GPP TS 37.145-2 version 13.0.0 Release 13)
TS 137 571-1 Universal Mobile Telecommunications System (UMTS); LTE; Universal Terrestrial Radio Access (UTRA) and Evolved UTRA (E-UTRA) and Evolved Packet Core (EPC); User Equipment (UE) conformance specification for UE positioning; Part 1: Conformance test specification (3GPP TS 37.571-1 version 13.1.0 Release 13)
TS 137 571-1 Universal Mobile Telecommunications System (UMTS); LTE; Universal Terrestrial Radio Access (UTRA) and Evolved UTRA (E-UTRA) and Evolved Packet Core (EPC); User Equipment (UE) conformance specification for UE positioning; Part 1: Conformance test specification (3GPP TS 37.571-1 version 12.8.0 Release 12)
TS 137 571-4 Universal Mobile Telecommunications System (UMTS); LTE; Universal Terrestrial Radio Access (UTRA) and Evolved UTRA (E-UTRA) and Evolved Packet Core (EPC); User Equipment (UE) conformance specification for UE positioning; Part 4: Test suites (3GPP TS 37.571-4 version 13.0.0 Release 13)
TS 137 571-5 Universal Mobile Telecommunications System (UMTS); LTE; Universal Terrestrial Radio Access (UTRA) and Evolved UTRA (E-UTRA) and Evolved Packet Core (EPC); User Equipment (UE) conformance specification for UE positioning; Part 5: Test scenarios and assistance data (3GPP TS 37.571-5 version 12.6.0 Release 12)