Open Nettest

Open Nettest is a platform for measurement of the Internet connection over fixed, mobile or WiFi networks.

It places a strong focus on quality and reliability. Besides usual indicators like upload and download speed, Open Nettest performs unique measurements aimed to assess the quality of the connection and net neutrality.

Open Nettest provides a way to check your current connection speed and quality, not only in case of trouble, but at any moment and everywhere. Furthermore, Open Nettest enables a more extensive diagnostic test, including other parameters as signal strength, and quality in terms of network neutrality – e.g. blocked content, presence of middleboxes, etc.

It is an independent tool, improved with the expertise of Regulatory Authorities across Europe and the contributions of thousands of users and collected measurements.

The transparency of the methodology and the aggregation of the results, translated to statistics and offered as open data, always respecting privacy and anonymity of the data, makes Open Nettest a unique measurement platform for end users, operators, regulators and data analysts with the aim of improving the quality of Internet connection worldwide.

Open Nettest is an open-source platform, which measures the Internet connection with a strong focus on quality and reliability. Besides usual indicators like upload and download speed, Nettest performs over 70 unique tests aimed to assess the quality of connection and net neutrality. With more than 80 parameters measured, Nettest is probably the most holistic measurement tool available in the market. Nettest is currently being used by several European regulators. It is vendor-independent, based on crowd-sourcing, open sourced and able to output anonymised open data.

Nettest is a proven solution which has been tested and fine-tuned in several implementations, thus reaching status of maturity comparable to or even outreaching proprietary commercial systems. The system can be deployed within a few weeks enabling us to prototype the platform very early and add features iteratively according to the actual priorities. The discussion about priorities and deployed features happens regularly among the product owner and the stakeholders as the project progresses.

Nettest is in full compliance with BEREC reports from 2014 and 2016 that recommends parameters of IAS quality monitoring system. Open Nettest is a complex tool offering reliable and credible testing of internet connection. It offers complex information regarding connection quality of all users. It is possible to compare results between end users of all operators. It offers the possibility to determine the level of user satisfaction with their internet connection, as well as with their internet provider. It allows for detailed comparison of real results with outputs of testing applications of mobile operators. The platform is based on the principles of crowd sourcing – very effective data collection method using smartphones and other devices with web browsers. It provides well-organised, detailed graphical and statistical depiction of results, as well as mapping of testing processes for all users.

It enables rapid implementation due to its open source and fast deployment nature. It uses open-source and open data principles to maximize benefits for both regulators and end users.

The platform reduces regulator’s operation costs. It enables easy measurements of the internet connection quality. It provides reliable documentation in case of a litigation.

It promotes the end user enablement through the availability of real internet quality data, the data for efficient complaints resolution. It also enables the user to make informed purchasing decision when selecting ISP and thus increases market competition, leading to an increased level of user satisfaction.

Open Source

Open source means that the source code of Open Nettest software is publicly accessible and that Specure has put the components it has developed under an open source licence. This is for transparency and reliability reasons to make it possible to understand the test methodology by viewing the actual source-code, and to ensure that measurements are correct and reliable.

Open Data

Open Nettest comes with a JSON interface to publish all measurement details. Any interested party is allowed to use these data for any reason. This guarantees independency and reliability of the measurements details. Of course, all data is anonymized before putting it publicly to open-data.

Easy to Use

Open Nettest allows users to obtain information on the current service quality of their Internet connection in the context of net neutrality and provides them with comprehensive information, including statistical data. Open Nettest provides:

  • a speed test for download speed, upload speed and round trip time (ping);
  • several quality of service tests, which determines net neutrality. This includes testing of TCP-/UDP-ports, a VOIP/jitter test, proxy tests, DNS tests, etc.;
  • a map view of all test results with filter options for test parameters, statistics, operator, device and time of day;
  • several in-depth statistics;
  • a red/yellow/green evaluation of the test result (“traffic-light”-system);
  • the option to synchronise results of various devices and display them in the browser;
  • the user’s own test history,
  • representative, comparable test results, statistical analysis and visual illustration via heat map.

Privacy and security

All public available test results are exclusively providing anonymously data.

By anonymization personal data will not be available online. In particular, the following parameters will not be published: Measure ID of the client, sync code and sync group of the clients, the complete IP address, Wi-Fi network name (SSID) and Wi-Fi numeric identifier (BSSID).

The end user confirms the privacy policy prior to measurements. This also contains the information in detail, which data is collected 

and stored. The data protection regulations will be drawn up by a lawyer who is specialized in privacy.

All personal data, even those that are not publicly displayed will be anonymized after a certain period of time. E.g. after 6 months. This anonymization also has to be performed in backups.

The transmission of the data provided by the test client is only possible through HTTPS respectively TLS secured connections.

On all platforms the user receives upon location tracking an announcement which he has to approve or reject.

If an open data interface is desired, the client can accurately determinate the date to be accessible by the public.

Platform

With wide support of devices and deployment scenarios, Open Nettest is a holistic measurement platform.

Open Nettest measures the connection from your device – the client device – and a measurement server. The client device and the measurement server will exchange data, letting us measure the quality of your Internet connection.

Open Nettest measurement platform

To support the measurements, the platform includes several measurement servers at different locations, control servers, databases and all the infrastructure to ensure a reliable service.

Mobile Apps

Open Nettest provides native applications for both iOS and Android. They are readily available from the respective app store on your smartphone or tablet.

[appbox appstore compact id965195186]

[appbox googleplay compact com.specure.nettest]

Start Page

On the start page, end-users can see several information. On the top, there is a graphic symbolising the connection method (mobile, WiFi), the signal strength and the name of the operator respectively the WiFi-SSID. Below that, you can find information about the actual usage of the CPU and of the memory, the actual background-traffic, the usage of IPv4 or IPv6 and the according IP-addresses, as well as the location. Below that, there is a button to start a new measurement.

Test Page

The test page is shown during a measurement visualizing all values and showing the actual process of the measurement. After finishing the measurement, the end-user will be transferred to detailed results.

History

The history page includes a list of all past measurements done by this client or synchronized to this client.

Synchronization

If you want to synchronize measurements between two different devices (e.g. a browser and a mobile device), you can request a synchronization code on each of these devices and fill in this synchronization code on the second device. This could be done with more than two devices as well. As a result, you can see all measurement details ever made from all synchronized devices on each single device.

Detailed Results

This page shows all detailed results, which were collected in one single measurement.

DETAILED SPEED/THROUGHPUT RESULTS

This section holds information of median download speed, median upload speed, median latency and signal strength.
Furthermore, it shows all secondary parameters collected during the measurement (e.g. durations, coordinates, autonomous system names, amount of transferred data, etc.)

DETAILED QOS RESULTS

This page and all sub-pages include all results, which were collected during the QoS measurements. It shows the technical values and an explanation of the specific result.

DETAILED GRAPHS

Detailed graphs showing download speeds, upload speeds, signal strength and latency values over time.

LOCATION

A small map is showing the location where the measurement was done. If client was moving it shows the movement too.

Map View

This page holds a map showing a specific area based on the current position of the device, and on top several layers visualizing the aggregated and/or detailed measurement results.

BASE MAP

The MoQoS Open Nettest is using Google Maps as the base layer. This includes road view, satellite view and hybrid view.

HEAT MAP

Two dimensions: colour (speed), opacity (nr. of tests in the defined area)

POINTS

Each measurement is displayed as a point on the map. Own measurements are displayed as a triangle. It is possible to click on a point or triangle to see all anonymized results of this single measurement in detail.

SHAPES

Defined areas, could be political districts, squares of free defined size (e.g. 100 x 100 m) of 1 colour and 1 opacity. Colour is defined by the median value (download, upload, signal, latency) of all measurements in that area.

FILTER

It is possible to filter measurements which are shown on the map by connection technology (mobile measurements, WIFI measurements and browser measurements), by mobile radio technology (2G, 3G, 4G) in case of mobile measurements, by measurement parameter (download, upload, signal strength and latency), by time period (e.g. last week, last month, etc.; free configurable) and by statistical values (e.g. 80% percentile, median, etc.; free configurable)

Web version

Open Nettest is also available from a web browser. The HTML5 web version supports Google Chrome, Mozilla Firefox, Apple Safari, Microsoft Edge and Opera and it is independent of the device. There are no prerequisites, such as Java or Flash plugin to be installed.

You can start a test now, explore the heat map based on other users’ measurements, view statistics or search for measurement data that meet certain criteria.

Start Page

On the start page, you can find the navigation area and a button to start a new measurement. As the selection of a measurement server is done automatically based on IP address of client, there is no graphical user interface confusing end-users by showing them different servers, which cannot be selected. On the other hand there could be scenarios where end-users should have the right to choose a measurement server. In that case we will deliver such a graphical user interface. Nevertheless this topic has to be discussed in the requirements analysis phase.

Test Page

The test page is shown during a measurement visualizing all values and showing the actual process of the measurement. After finishing the measurement, the end-user will be transferred to detailed results.
The MoQoS Open Nettest is implemented in HTML5 using Javascript with Websockets. This is because other alternatives like Java or Flash will not be supported in the future. Whereas HTML5 and Javascript are already the technologies for the future. One downside is the fact that it is not possible to send UDP-packets. Especially the measurement for Delay variation (sometimes called Jitter) and packet loss will make sense only when using UDP. For that reason these two parameters cannot be measured in browsers. However it is possible to measure TCP Ping Delay Variation, which is not a very significant parameter, but could be a hint for a weak internet connection.
As an alternative there is also a Java client for browsers implemented in MoQoS Open Nettest, which is capable of measuring UDP Jitter and packet loss as well as a lot of many other QoS parameters, too. But as there are a lot of drawbacks of using Java in browsers the decision to use this technology should be discussed in the requirements analysis phase in depth.

History

The history page includes a list of all past measurements done by this client or synchronized to this client.

Synchronization

If you want to synchronize measurements between two different devices (e.g. a browser and a mobile device), you can request a synchronization code on each of these devices and fill in this synchronization code on the second device. This could be done with more than two devices as well. As a result, you can see all measurement details ever made from all synchronized devices on each single device.

Detailed Results

This page shows all detailed results, which were collected in one single measurement.

Detailed Speed/Throughput Results

This section holds information of median download speed, median upload speed, median latency and signal strength (if available).
Furthermore, it shows all secondary parameters collected during the measurement (e.g. durations, coordinates, autonomous system names, amount of transferred data, etc.)

Detailed Graphs

Detailed graphs showing download speeds, upload speeds, signal strength and latency values over time.

Location

A small map is showing the location where the measurement was done. If client was moving it shows the movement too.

Map View

This page holds a map showing a specific area and on top several layers visualizing the aggregated and/or detailed measurement results.

Base Map

By default, the MoQoS Open Nettest is using Google Maps as the base layer. This includes road view, satellite view and hybrid view. It is possible to use other base maps like bing maps or local base maps.

Heat Map

The heat map layer draws a coloured cloud showing aggregated measurement results. For that reason, speeds are displayed as a range from green to red colour and the amount of measurements changes the opacity value.

Points

Each measurement is displayed as a point on the map. Own measurements are displayed as a triangle. It is possible to click on a point or triangle to see all anonymized results of this single measurement in detail.

Shapes

Defined areas, could be political districts, squares of free defined size (e.g. 100 x 100 m) of 1 colour and 1 opacity. Colour is defined by the median value (download, upload, signal, latency) of all measurements in that area.

Filter

It is possible to filter measurements which are shown on the map by connection technology (mobile measurements, WIFI measurements and browser measurements), by mobile radio technology (2G, 3G, 4G) in case of mobile measurements, by measurement parameter (download, upload, signal strength and latency), by time period (e.g. last week, last month, etc.; free configurable) and by statistical values (e.g. 80% percentile, median, etc.; free configurable)

Search

The search page shows by default a list of the last 100 measurements. Clicking on a single row leads to a detailed view of the results of this measurement similar like described above.

Additionally, there is an advanced search functionality to search and filter specific measurements by choosing various parameters.

Search

The search field provides functionality to search an address to focus and zoom the map.

Statistics

The statistics page brings some statistical information about averages from different operators and different devices.

Additionally, there are filters to select the country of measurements, a time span, the device type, statistical parameters and location accuracy.

This page should give an overview how the results could be processed statistically. It is no intention to compare operators.

Open Data

All measurements are available as Open Data in JSON, CSV or XML format. The data is downloadable on a monthly basis.

Open Nettest Hardware Probes

Nettest Probes enable regular, non-biased, end-to-end measurement of the network quality. The methodology and the metrics measured are compatible with our established mobile and desktop apps.

Low set up cost and an attractive monthly pricing make Nettest Probes a viable option to any scenario: from ISPs looking for better understanding of their network from the end user perspective, through researcher institutions and researchers who are able to benefit from the open data, to the regulators whos job is to monitor the market and resolve customer complaints and other inqires.

New generation of the hardware probes

Nettest Probes are a part of the Open Nettest platform.

Open Nettest Widget

Implement Nettest Widget on your own website for free. The free subscription provides a universal speed measurement widget working with a global Specure measurement server network.

Get the premium version if you require specific branding and other customisation, and if you want to utilise your own measurement servers.

Nettest Widget is a part of the Open Nettest platform.

Open Nettest Deep Data

Get the understanding of ISPs’ and mobile network operators’ performance in different regions and countries. Nettest Deep Data provides a comprehensive database of crowdsourced measurements of internet speed and quality for both fixed-line and mobile measurements.

Due to the cooperation with many European national telecom market regulators, the main focus of our tool has been on European countries, but high-quality data is available for all regions around the world.

Nettest Deep Data is a part of the Open Nettest  platform.

Let us know if you have more questions or comments.