CoAP 4 Plugtests

  • 7-9 March 2014Add this to my calendar
  • London, UKexpand

The fourth Constrained Application Protocol (CoAP) Plugtests™ event was held in London, UK, from 7-9 March 2014. This event was organized by ETSI and supported by the IPSO Alliance. Representatives from the Open Mobile Alliance were on site to assist with the OMA Lightweight M2M tests. This event was collocated with the 89th IETF meeting.
This event aimed to assess the interoperability of multivendor CoAP implementations including the additional coverage of OMA LWM2M, DTLS and 6LoWPAN for participants who wish to bring implementations.

CoAP


Interoperability test scenarios based on the IETF and OMA standards for M2M were performed. The test scenarios were mainly focused on server and client CoAP end-point implementations and products focusing on the base CoAP specification, CoAP Block Transfer, CoAP Observation and the CoRE Link Format.
The testing included an improvement of scenarios performed at previous CoAP events along with new tests on CoAP standards, OMA Lightweight M2M, Security DTLS and 6LoWPAN.
This is in line with the standardization work of the oneM2M Partnership Project, where CoAP, DTLS and OMA LWM2M are considered as key components of the future global standardized M2M architecture.

Participation at this interoperability event was open to everyone with an implementation to test and was free of charge.

As this event finished just two weeks prior to the Interim Report being submitted the results of the tests and the experience gained are not fully available. However some preliminary findings and achievements are mentioned below.
During this event it was found that:

  • all implementations have been compatible on a basic level,
  • CoAP standards are clearly mature,
  • the last changes in the Block and Observe specifications have been tested with success, and
  • the level of Interoperability of OMA LWM2M is excellent. As the scenarios were basic, it shows a good maturity at the basic level. The testing now needs to be extended with more indepth testing scenarios.

Following a technical discussion during the CoRE Working Group meeting at the IETF#89 on Friday 7 March the need for further test cases was raised. This has lead to a new test description being written immediately (TD_COAP_OBS_12) and it was all hands on deck to ensure that the tests could be carried out just two days later during the ongoing Plugtests event. The results will be provided to the IETF CoRE WG with the least possible delay.
This highlights once again the synergy between Plugtests event and standardization bodies and shows the advantage of having the event so closely linked to standardization meetings.

This event had small but significant participation of ten companies who provided various CoAP clients and servers, DTLS and OMA LWM2M implementations. This was a higher participation than the previous event in 2013. Being collocated with the IETF meeting may have been a boost to the participation.

There was also a representative from OMA present to assist with the OMA lightweight M2M testing activities.

Karen Hughes
09 March 2014

The final wrap-up session was the opportunity to give a debrief on the status of testing and highlight its excellent results.

wrap-up01

wrap-up02

All work, no play -the participants nevertheless enjoy a nice break from time to time!

coffee

2935 Hits
Karen Hughes
09 March 2014

As in every Plugtests event, the ETSI team is always ready to give a helping hand.

Day3

3169 Hits
Karen Hughes
09 March 2014

Following a technical debate during the CoRE Working Group meeting at the IETF#89 on Friday 07 March the need for further test cases was raised.

This has lead to a new test description being written immediately and it was all hands on deck to ensure that the tests could be carried out just 2 days later during the current Plugtests event and the results will be provided to the IETF CoRE WG with the least possible delay. 

This highlights once again the synergy between Plugtests event and standardization bodies and shows the advantage of having the event so closely linked to standardization meetings.

4085 Hits
Karen Hughes
08 March 2014

During each Plugtests event it has proven useful to hold regular 'Wrap-Up' sessions where results and progress of the testing thus far may be discussed.

Wrapup1

The first Wrap-Up session for this event was held on Saturday 08 March just before the lunch break.
Carsten Bormann had prepared some slides showing the preliminary results of the first testing sessions and together with Laurent Velez and Zach Shelby discussed these slides with the participants.

Wrapup2

All participants are encouraged to be present and to take part. This can result in lively discussions.

Wrapup3

3401 Hits
Karen Hughes
08 March 2014

The testing activities on Day 2 of the CoAP event started with all participants in the room and connected by 09:30.

 Day2-Testing2

Joaquin Prado from OMA was on hand to discuss the OMA lightweight M2M specification.

Day2-testing

 

3895 Hits
Karen Hughes
08 March 2014

First day of testing went very well and the participants finished at 20.15pm. For this 4th IoT CoAP event, the following tools are being used:

ETSI Test Reporting Tool

This enables the participants to enter the results of their tests. Once the tests have been carried out the tool will provide statistics and will enable us to see which tests have been successfully carried out. It should be noted that all results are anonymous and participants can only see the restults of the test sessions in which they have participated. No participating company will see the results of any other participating company.

Lossy Gateway

ETSI has provided a UDP lossy gateway which drops UDP packets in order to simulate a real constrained environment.

UDP Gateway IPV4 - IPV6

ETSI has also provided a UDP gateway which allows pairing between IPV4 only devices towards IPV6 only devices.

26486 Hits
Karen Hughes
07 March 2014

Etsi-team

Following the welcome presentation the testing gets underway in London

Day1 testing

The room is buzzing and there is a lot of energy as the first tests are being run.

Day1 testing2

 

6144 Hits
Karen Hughes
06 March 2014

Preparations for the 4th IoT CoAP Plugtests event are under way at the Marriott Hotel Marble Arch, London, UK. The ETSI team have been busy setting up the room in preparation for the participants to start their testing on Friday morning.

P3060065

The testing room will be open from 09:00 on Friday 07 March for equipment set-up and pre testing. 

7071 Hits