Version 3.6.0 April 24, 2018 Sigfox Verified TM Test Procedure RSA-SDR-DONGLE for RC1-UDL-ENC Public Use Note: Only the last version of this document available on the Sigfox web sites is official and applicable. This document is the property of Sigfox. It shall not be copied and / or disclosed to third parties, in any form without Sigfox written permission.
IMPORTANT NOTICE The device proposed in Sigfox Certification has to be representative of the ones present in the field. To succeed in your Sigfox certification, you need to : Read carefully the Radio_Signal_Analyzer User Guide (available on https://build.sigfox.com ). Have a Sigfox Checklist (available on https://build.sigfox.com ) properly filled in (all information in the checklist will be used all tests long). 1
Contents 1 Introduction 3 1.1 Scope...................................................... 3 1.2 Acronyms and abbreviations......................................... 3 1.3 Radio_Signal_Analyzer............................................ 4 1.3.1 User guide............................................... 4 1.3.2 Verdict Type............................................... 4 1.3.3 Checklist Information.......................................... 4 2 Sigfox Verified Tests 5 2.1 Test Setup.................................................... 5 2.2 Tests Execution................................................. 5 2.2.1 Execute with Test Mode : TX-BPSK................................. 5 2.2.1.a Nominal Voltage Configuration........................... 5 2.2.1.b Minimum Voltage Configuration........................... 6 2.2.1.c Maximum Voltage Configuration.......................... 7 2.2.2 Execute with Test Mode : TX-PROTOCOL.............................. 8 2.2.2.a Protocol........................................ 8 2.2.2.b Uplink Encrypted Payload.............................. 9 2.2.2.c NVM.......................................... 10 2.2.2.d Public Key...................................... 11 2.2.2.e Frequencies Distribution............................... 11 2.2.3 Execute with Test Mode : RX-PROTOCOL.............................. 11 2.2.3.a Downlink....................................... 11 2.2.3.b Downlink Encrypted................................. 12 2.2.3.c Downlink Window : Start of Listening....................... 12 2.2.3.d Downlink Window : End of Listening........................ 12 2.2.4 Execute with Test Mode : RX-GFSK................................. 13 2.2.5 Execute with Test Mode : RX-SENSITIVITY............................. 13 2.2.6 Execute with Test Mode : TX-SYNTH................................ 13 3 Results 14 2
1 Introduction This document describes the test procedure compliant with the Sigfox Ultra Narrow Band Modem Test Plan ( PTP- UNB-MODEM ). 1.1 Scope This document is delivered to Device Makers to help them execute Sigfox tests before the official Certification. 1.2 Acronyms and abbreviations - 2GFSK: 2-Level Gaussian Frequency Shift Keying - ACK: Acknowledgement - AES: Advanced Encryption Standard - Att: Attenuator - CAB: Client Application Board - CBC: Cipher Block Chaining - CS: Carrier Sense - Cold Test: Test executed in initial condition (wait till the DUT come back to the initial system between two tests) - DBPSK: Differential Binary Phase-Shift Keying - DUT: Device Under Test - ENC: Encrypted - Fd: DUT Frequency - Fe: Equipment Frequency - Legacy Uplink: initial payload format of Sigfox Uplink without encryption - LBT: Listen Before Talk - NVM: Non Volatile Memory - OOB: Out Of Band - PAC: Porting Authorization Code - PER: Packet Error Rate - PMR: Private Mobile Radio - RC: Radio Configuration - RF: Radio Frequency - RSA: Radio_Signal_Analyzer - RSSI_dut: DUT RSSI - RSSI_eq: Equipment RSSI - SMIQ: Vector Signal Generator - SOC: System On Chip - Sigfox Message: Three frames with payload 303132333435363738393A3B - UNB_MODEM: Ultra Narrow Band MODEM - UNBT: Ultra Narrow Band Transceiver 3
1.3 Radio Signal Analyzer 1.3.1 User guide Before starting test, read carefully the Radio_Signal_Analyzer User guide (available on https://build.sigfox.com ), it will be easier to use Radio_Signal_Analyzer and to find all things after that. 1.3.2 Verdict Type EVALUATION All requirements are manual verdict and have to be updated by the operator. Check each "Covered requirement" table to know the manual verdict and the "Manual Verdict" explanation to know if this verdict is "FAILED" or "PASSED". TOOL-ANALYSIS All requirements are automatic verdict and will be updated automatically by Radio_Signal_Analyzer. MEASUREMENT All measurement are automatic and will be updated automatically by RSA. 1.3.3 Checklist Information All information from the checklist have to be filled in properly before starting test. Radio_Signal_Analyzer should be configured according to this checklist (RCx, modem type, ID/KEY values,...). Some checklist information will be needed all test long. 4
2 Sigfox Verified Tests All tests below are described to help to validate some requirements for the Sigfox Verified TM during the development, but it s not a certification. certification. It could help 2.1 Test Setup Test Setup : Connect DUT to SDR-DONGLE (with 40dB attenuator) Launch Radio_Signal_Analyzer Populate the "device Configuration" window "Device STATIC Configuration" : choose the Modem Type, Radio Configuration, Payload Encryption This configuration should not be modified after starting the certification. "Device DYNAMIC Configuration" : Configure your ID/KEY Select "SDR DONGLE" in the "Tester" part Click "Open" Click "Start" Before starting your tests, fill in all DUT information in "Info / Prereq / Equipment / Verdicts" window ("Information" subwindow) Before starting your tests, fill in all equipment information according to your setup in "Info / Prereq / Equipment / Verdicts" window ("Equipment" subwindow), or load your equipment information file (if already saved) 2.2 Tests Execution 2.2.1 Execute with Test Mode : TX-BPSK TEST CONDITION Cold tests have to be done to validate all RF requirements, the goal is to validate the device in worst condition (before established system). 2.2.1.a Nominal Voltage Configuration 5
Ensure that your DUT is in cold test condition (Remove all USB cables and power supply) Select "Test Mode TX-BPSK" in "Device" part Select "Nominal Voltage" Click "Raw IQ File" to start the record in the "Device" part Run the Sigfox Test Mode TX-BPSK (with config 3, if Sigfox library older than V2.2.0) with your DUT Click "Raw IQ File" again to stop the record Check the record size (value should be different from 0 MB) Manual Verdict : I/Q Wave record : This test is PASSED only if the Operator has recorded properly the TX-BPSK in nominal voltage. Static Frequency Tolerance : This test is PASSED only if the (Static Frequency accuracy given by RSA (or frequency tolerance if TCXO without calibration) + aging (on 5 years) + max temperature tolerance) < 20 ppm. Add all values in the "comment" line. DBPSK Modulation envelop : This test is PASSED only if the signal is modulated with amplitude level when a 0 occurs (Check the "envelope" window). The "Narrow Band Power Distribution" requirement cannot be validated due to equipment limitations. PRS-UNB-MODEM-13 Static Frequency Tolerance EVALUATION PRS-UNB-MODEM-20 DBPSK Modulation envelop EVALUATION PRS-UNB-MODEM-21 Phase Measurement TOOL-ANALYSIS PRS-UNB-MODEM-22 Extra symbols before the first Sigfox bit of the frame TOOL-ANALYSIS PRS-UNB-MODEM-23 Extra symbols after the last Sigfox bit of the frame TOOL-ANALYSIS PRS-UNB-MODEM-30 TX Max Symbol duration TOOL-ANALYSIS PRS-UNB-MODEM-31 Max TX Baudrate Cumulated Error TOOL-ANALYSIS PRS-UNB-MODEM-40 Power Spectral Density TOOL-ANALYSIS PRS-UNB-MODEM-41 Narrow Band Power Distribution TOOL-ANALYSIS PRS-UNB-MODEM-50 Transitional Frequency Dynamic Drift TOOL-ANALYSIS PRS-UNB-MODEM-51 Established Frequency Dynamic Drift TOOL-ANALYSIS PRS-UNB-MODEM-110 Modulated Conducted Output Power MEASUREMENT PRS-UNB-MODEM-130 I/Q Wave record EVALUATION 2.2.1.b Minimum Voltage Configuration Ensure that your DUT is in cold test condition (Remove all USB cables and power supply) Select "Test Mode TX-BPSK" in "Device" part Select "Minimum Voltage" Power up the DUT in Minimum Voltage Run the Sigfox Test Mode TX-BPSK (with config 3, if Sigfox library older than V2.2.0) with your DUT 6
Manual Verdict : Static Frequency Tolerance : This test is PASSED only if the (Static Frequency accuracy given by RSA (or frequency tolerance if TCXO without calibration) + aging (on 5 years) + max temperature tolerance) < 20 ppm. Add all values in the "comment" line. DBPSK Modulation envelop : This test is PASSED only if the signal is modulated with amplitude level when a 0 occurs (Check the "envelope" window). The "Narrow Band Power Distribution" requirement cannot be validated due to equipment limitations. PRS-UNB-MODEM-13 Static Frequency Tolerance EVALUATION PRS-UNB-MODEM-20 DBPSK Modulation envelop EVALUATION PRS-UNB-MODEM-21 Phase Measurement TOOL-ANALYSIS PRS-UNB-MODEM-22 Extra symbols before the first Sigfox bit of the frame TOOL-ANALYSIS PRS-UNB-MODEM-23 Extra symbols after the last Sigfox bit of the frame TOOL-ANALYSIS PRS-UNB-MODEM-30 TX Max Symbol duration TOOL-ANALYSIS PRS-UNB-MODEM-31 Max TX Baudrate Cumulated Error TOOL-ANALYSIS PRS-UNB-MODEM-40 Power Spectral Density TOOL-ANALYSIS PRS-UNB-MODEM-41 Narrow Band Power Distribution TOOL-ANALYSIS PRS-UNB-MODEM-50 Transitional Frequency Dynamic Drift TOOL-ANALYSIS PRS-UNB-MODEM-51 Established Frequency Dynamic Drift TOOL-ANALYSIS PRS-UNB-MODEM-110 Modulated Conducted Output Power MEASUREMENT PRS-UNB-MODEM-130 I/Q Wave record EVALUATION 2.2.1.c Maximum Voltage Configuration Ensure that your DUT is in cold test condition (Remove all USB cables and power supply) Select "Test Mode TX-BPSK" in "Device" part Select "Maximum Voltage" Power up the DUT in Maximum Voltage Run the Sigfox Test Mode TX-BPSK (with config 3, if Sigfox library older than V2.2.0) with your DUT Manual Verdict : Static Frequency Tolerance : This test is PASSED only if the (Static Frequency accuracy given by RSA (or frequency tolerance if TCXO without calibration) + aging (on 5 years) + max temperature tolerance) < 20 ppm. Add all values in the "comment" line. DBPSK Modulation envelop : This test is PASSED only if the signal is modulated with amplitude level when a 0 occurs (Check the "envelope" window). 7
The "Narrow Band Power Distribution" requirement cannot be validated due to equipment limitations. PRS-UNB-MODEM-13 Static Frequency Tolerance EVALUATION PRS-UNB-MODEM-20 DBPSK Modulation envelop EVALUATION PRS-UNB-MODEM-21 Phase Measurement TOOL-ANALYSIS PRS-UNB-MODEM-22 Extra symbols before the first Sigfox bit of the frame TOOL-ANALYSIS PRS-UNB-MODEM-23 Extra symbols after the last Sigfox bit of the frame TOOL-ANALYSIS PRS-UNB-MODEM-30 TX Max Symbol duration TOOL-ANALYSIS PRS-UNB-MODEM-31 Max TX Baudrate Cumulated Error TOOL-ANALYSIS PRS-UNB-MODEM-40 Power Spectral Density TOOL-ANALYSIS PRS-UNB-MODEM-41 Narrow Band Power Distribution TOOL-ANALYSIS PRS-UNB-MODEM-50 Transitional Frequency Dynamic Drift TOOL-ANALYSIS PRS-UNB-MODEM-51 Established Frequency Dynamic Drift TOOL-ANALYSIS PRS-UNB-MODEM-110 Modulated Conducted Output Power MEASUREMENT PRS-UNB-MODEM-130 I/Q Wave record EVALUATION 2.2.2 Execute with Test Mode : TX-PROTOCOL 2.2.2.a Protocol Select "Test Mode TX-PROTOCOL" in "Device" part Select the Test Configuration "Protocol" 1. If your Sigfox Library version is older than V2.2.0 Send a Sigfox Message with your DUT (payload 1 bit only : "1") Send a Sigfox Message with your DUT (payload 1 bit only : "0") Send a Sigfox Message with your DUT (payload 1 byte only : "40") Send a Sigfox Message with your DUT (payload 2 bytes only : "4041") Send a Sigfox Message with your DUT (payload 3 bytes only : "404142") Send a Sigfox Message with your DUT (payload 4 bytes only : "40414243") Send a Sigfox Message with your DUT (payload 5 bytes only : "4041424344") Send a Sigfox Message with your DUT (payload 6 bytes only : "404142434445") Send a Sigfox Message with your DUT (payload 7 bytes only : "40414243444546") 8
Send a Sigfox Message with your DUT (payload 8 bytes only : "4041424344454647") Send a Sigfox Message with your DUT (payload 9 bytes only : "404142434445464748") Send a Sigfox Message with your DUT (payload 10 bytes only : "40414243444546474849") Send a Sigfox Message with your DUT (payload 11 bytes only : "404142434445464748494A") Send a Sigfox Message with your DUT (payload 12 bytes only : "404142434445464748494A4B") Send a OOB Sigfox Message with your DUT 2. If your Sigfox Library version is at least V2.2.0 Run the Sigfox Test Mode TX-PROTOCOL (with config 1, if Sigfox library older than V2.2.0) with your DUT 2.2.2.b Uplink Encrypted Payload Select "Test Mode TX-PROTOCOL" in "Device" part Select the Test Configuration "Protocol" Check "Activate Payload Encryption" Switch your device in encrypted mode 1. If your Sigfox Library version is older than V2.2.0 Send a Sigfox Message with your DUT (payload 1 bit only : "1") Send a Sigfox Message with your DUT (payload 1 bit only : "0") Send a Sigfox Message with your DUT (payload 1 byte only : "40") Send a Sigfox Message with your DUT (payload 2 bytes only : "4041") Send a Sigfox Message with your DUT (payload 3 bytes only : "404142") Send a Sigfox Message with your DUT (payload 4 bytes only : "40414243") Send a Sigfox Message with your DUT (payload 5 bytes only : "4041424344") Send a Sigfox Message with your DUT (payload 6 bytes only : "404142434445") Send a Sigfox Message with your DUT (payload 7 bytes only : "40414243444546") Send a Sigfox Message with your DUT (payload 8 bytes only : "4041424344454647") Send a Sigfox Message with your DUT (payload 9 bytes only : "404142434445464748") Send a Sigfox Message with your DUT (payload 10 bytes only : "40414243444546474849") Send a Sigfox Message with your DUT (payload 11 bytes only : "404142434445464748494A") Send a Sigfox Message with your DUT (payload 12 bytes only : "404142434445464748494A4B") 9
Send a OOB Sigfox Message with your DUT 2. If your Sigfox Library version is at least V2.2.0 Run the Sigfox Test Mode TX-PROTOCOL (with config 1, if Sigfox library older than V2.2.0) with your DUT Uncheck "Activate Payload Encryption" in "Device" part Switch your device in not-encrypted mode 2.2.2.c NVM Select "Test Mode TX-PROTOCOL" in "Device" part Select the Test Configuration "Protocol" Send a Sigfox Message with your DUT (payload 1 byte only) : FIRST MESSAGE with Freq1 for frame 1, freq2 for frame 2 and freq3 for frame 3 in the "demodulation window" in RSA Power down (remove all USB cables and power supply) the DUT Send a Sigfox Message with your DUT (payload 1 byte only) : SECOND MESSAGE with Freq4 for frame 1, freq5 for frame 2 and freq6 for frame 3 in the "demodulation window" in RSA Manual Verdict : NVM Frequency Storage : After Power down/up, in the "demodulation window", the verdict should be : PASSED if freq1 is not egal to freq4 +/-100Hz, freq2 is not egal to freq5 +/-100Hz, freq3 is not egal to freq6 +/-100Hz. ("PASSED Verdict" example below). In "Demodulation" window, after power down/up, the Device (picture below) had not the same Sequence Number and same Frequencies as before. All NVM requirements should be "passed" in the "Info / Prereq / Equipment / Verdicts" window ("verdicts" subwindow). FAILED if freq1=freq4 +/-100Hz, freq2=freq5 +/-100Hz, freq3=freq6 +/-100Hz. 10
2.2.2.d Public Key Select "Test Mode TX-PROTOCOL" in "Device" part Select the Test Configuration "Protocol" Switch in "public Key" in "Device Configuration", DYNAMIC part Configure the DUT in public Key Send a Sigfox Message with your DUT (payload 1 byte only) Wait for the end of the Sigfox message Switch in "private Key" in "Device Configuration", DYNAMIC part Configure the DUT in private Key 2.2.2.e Frequencies Distribution Select "Test Mode TX-PROTOCOL" in "Device" part Select the Test Configuration "Frequency Distribution" Run the Sigfox Test Mode TX-FREQ-DISTRIBUTION (the Sigfox Test Mode TX-PROTOCOL with config 34 if Sigfox library older than V2.2.0) with your DUT PRS-UNB-MODEM-11 Operational Frequencies Range TOOL-ANALYSIS PRS-UNB-MODEM-12 Operational Frequencies Distribution TOOL-ANALYSIS PRS-UNB-MODEM-80 AES TOOL-ANALYSIS PRS-UNB-MODEM-81 NVM Frequency Storage EVALUATION PRS-UNB-MODEM-82 NVM Sequence Number Storage TOOL-ANALYSIS PRS-UNB-MODEM-83 Public Key switch TOOL-ANALYSIS PRS-UNB-MODEM-84 Number of frames per message in Uplink mode TOOL-ANALYSIS PRS-UNB-MODEM-85 Legacy Uplink TOOL-ANALYSIS PRS-UNB-MODEM-86 Uplink Encrypted payload TOOL-ANALYSIS PRS-UNB-MODEM-100 TX Interframe Timing in Uplink mode TOOL-ANALYSIS PRS-UNB-MODEM-121 DUT Temperature level MEASUREMENT PRS-UNB-MODEM-122 DUT Voltage level MEASUREMENT 2.2.3 Execute with Test Mode : RX-PROTOCOL 2.2.3.a Downlink Select "Test Mode RX-PROTOCOL" in "Device" part Select the Test Configuration "Standard Downlink" 11
Run the Sigfox Test Mode RX-PROTOCOL (with config 1, if Sigfox library older than V2.2.0) with your DUT We recommand to keep a margin (middle of the allowed timings : between 1.4 and 4 )as the measurement with the SDR-DONGLE is not really accurate. 2.2.3.b Downlink Encrypted Select "Test Mode RX-PROTOCOL" in "Device" part Select the Test Configuration "Standard Downlink" Check "Activate Payload Encryption" Switch your device in encrypted mode Run the Sigfox Test Mode RX-PROTOCOL (with config 1, if Sigfox library older than V2.2.0) with your DUT Uncheck "Activate Payload Encryption" in "Device" part Switch your device in not-encrypted mode 2.2.3.c Downlink Window : Start of Listening Select "Test Mode RX-PROTOCOL" in "Device" part Select the Test Configuration "Start of Listening Window" Run the Sigfox Test Mode RX-PROTOCOL (with config 1, if Sigfox library older than V2.2.0) with your DUT 2.2.3.d Downlink Window : End of Listening Select "Test Mode RX-PROTOCOL" in "Device" part Select the Test Configuration "End of Listening Window" Run the Sigfox Test Mode RX-PROTOCOL (with config 1, if Sigfox library older than V2.2.0) with your DUT PRS-UNB-MODEM-88 Downlink Encrypted Payload TOOL-ANALYSIS PRS-UNB-MODEM-90 Number of repeated Uplink frame in bi-directional mode TOOL-ANALYSIS PRS-UNB-MODEM-101 TX Interframe Timing in Bi-directional mode TOOL-ANALYSIS PRS-UNB-MODEM-102 RX Start Of Listening TOOL-ANALYSIS PRS-UNB-MODEM-103 RX End Of Listening TOOL-ANALYSIS PRS-UNB-MODEM-104 RX to OOB(ack) Timing TOOL-ANALYSIS PRS-UNB-MODEM-120 RSSI level TOOL-ANALYSIS 12
2.2.4 Execute with Test Mode : RX-GFSK The "static Drift (Hz)" will be updated automatically by RSA according to the Test Mode : TX-BPSK static drift result. Select "Test Mode RX-GFSK" in "Device" part Click "Start Send GFSK" in "Device" part Run the Sigfox Test Mode RX-GFSK (with config 30, if Sigfox library older than V2.2.0) with your DUT Check the GFSK reporting and the RSSI value returned Click "Stop Send GFSK" in "Device" part The RX-GFSK level cannot be tested with the SDR-DONGLE (fixed level) but this test allow to validate the test mode RX-GFSK functionality. Manual Verdict : Downlink Only : This test is PASSED only if the DUT receives GFSK sent by Radio_Signal_Analyzer and reports the test result (as mentioned in the Sigfox Checklist ). Downlink Only-rssi : This test is PASSED only if the RSSI value displayed is GFSK RSSI +/- 2 db. PRS-UNB-MODEM-60 2GFSK 600bps TOOL-ANALYSIS PRS-UNB-MODEM-87 Downlink Only EVALUATION PRS-UNB-MODEM-89 Downlink Only-rssi EVALUATION 2.2.5 Execute with Test Mode : RX-SENSITIVITY Select "Test Mode RX-SENSI" in "Device" part Run the Sigfox Test Mode RX-SENSI (with config 100, if Sigfox library older than V2.2.0) with your DUT The sensitivity cannot be tested with the SDR-DONGLE (fixed level) but this test allow to validate the test mode RX-SENSITIVITY functionality. PRS-UNB-MODEM-70 Sigfox Link Budget TOOL-ANALYSIS 2.2.6 Execute with Test Mode : TX-SYNTH Select "Test Mode TX-SYNTH" in "Device" part Run the Sigfox Test Mode TX-SYNTH (with config 0, if Sigfox library older than V2.2.0) with your DUT 13
PRS-UNB-MODEM-10 Frequency Steps TOOL-ANALYSIS 3 Results Be careful, when saving the measurement, the result folder will be cleared. If the manual verdict is fail, add a note in the comment part to explain why (for example : The command doesn t work). Choose the proper verdict and fill in all "comments" line for all Pre-requisites in the "Info / Prereq / Equipment / Verdicts" window ("Prerequisites" subwindow). All commands have to be validated to have a "PASS" verdict and written in the comment part if it works properly. Export results when all requirements have been tested (all verdicts should be "FAIL", "INFO" or "PASS") : In "Info / Prereq / Equipment / Verdicts" window, Choose "Export Results" Open the result folder Select your DUT picture Select the I/Q record The SigfoxVerifiedCertification.tar.gz will contain all information (verdicts, comments, information) and shouldn t be modified in any way. All verdicts : "INCONCLUSIVE", cannot be validate with this equipment (due to the equipment s limitation). 14