Ookla Benchmark

download Ookla Benchmark

of 13

Embed Size (px)

Transcript of Ookla Benchmark

  • 7/28/2019 Ookla Benchmark

    1/13

    Vodafone C3V.1.O

    1 November 20, 2012

    Group Latency Status Oct.12

    VTN-Access Performance

    Vodafone Group Services

    20th November 2012

    Group Latency Status Sept.12

  • 7/28/2019 Ookla Benchmark

    2/13

    Vodafone C3V.1.O

    Executive Summary

    Our best network latency for top-tier devices is below 70ms whilelatency across all devices is 93ms.

    Contributing factors are not all network related but external factorsinfluence overall rating e.g. terminals, connectivity to public servers, etc

    To present latest update on latency across markets

    To present highlights from a deep dive analysisTo give a good insight on the key influencing factors

    For Information

    Purpose

    Decisions Sought

    Topic

    November 20, 20122 Group Latency Status Sept.12

  • 7/28/2019 Ookla Benchmark

    3/13

    Vodafone C3V.1.O

    Group Latency where we stand today

    Speedtestsfrom any

    customer in fieldusing Android or

    iOS device -

    Crowd sourced

    data

    P3 Benchmark

    latency usingHSPA+ high end

    USB dongle.

    3 Group Latency Status Sept.12 November 20, 2012

    Latency Weight

    55ms 29%

    109ms 39%

    98ms 32%

    Latency Weight

    55ms 20%

    111ms 51%*

    88ms 29%

    90

    ms93

    ms

    All servers

    All servers All servers

    All servers

    All servers

    (82ms VF servers)

    All servers* Android penetration has changed from18% (2011) to 50%!

    Latency targets 90 ms (Mar.12) (Oct.12) 70 ms (Mar.13)

    Latency Weight

    (83ms VF servers)

  • 7/28/2019 Ookla Benchmark

    4/13

    Vodafone C3V.1.O

    4 November 20, 2012Group Latency Status Sept.12

    Group Latency Last year trend

    P3 reflect closer our BEST NETWORK latency status with a top end device

    Ookla Latency reflects real customer experience from smartphones/ tablets users.

    Ookla Android Latency is static due to low-end legacy devices and worse performance vs iOS.

    * Ookla VF only servers

    *

    100 msTarget

  • 7/28/2019 Ookla Benchmark

    5/13

    Vodafone C3V.1.O

    5 November 20, 2012

    Best Network Latency E2E Latency Budget break-down

    Group Latency Status Sept.12

    Access RTT: 20 100ms

    E2E RTT 25-140ms,

    Core RTT: 3 13ms

    E2E RTT Source: P3 measurements

    Internet RTT: 2 27ms

    Radio Access Core Internet

    HSUPA 2ms

    BEP 2.0 (Ethernet Microwave)

    Fibre to the node

    Load & congestion

    PiP Features

    Parameter optimisation

    Iu over IP

    Iu Flex

    Direct tunnel & Fast Path

    Interconnections to Gn/Gi

    Transmission paths within CPN

    IP Packet Management

    BEP1.0 (All IP backhaul)

    ISP Internet Connection

    IP Packet Management

    Generic case

    VF NL case,break down

    Estimated Access + SGSN RTT : 49ms Estimated Core + Internet: 13 ms

    P3 Server

    Key Network Factors

  • 7/28/2019 Ookla Benchmark

    6/13

    Vodafone C3V.1.O

    6 November 20, 2012

    Latency Speedtest Ookla Market Trends

    AndroidmainlystaticduetodifferentperformanceindevicesGroup Latency Status Sept.12

    88ms

    111ms

    105ms

    111ms

    2G/3G

    3G

  • 7/28/2019 Ookla Benchmark

    7/13

    Vodafone C3V.1.O

    7 November 20, 2012

    Latency Speedtest Ookla Vodafone vs Best Competitor

    Group Latency Status Sept.12

    Period: Jul-Aug-Sep 12

    All Ookla servers

    Number

    ofspeedtests

    Latency

    (ms)

    Latency

    (ms)

    VF better than Best Competitor

    Numberofspeedtests

    VF worse than Best Competitor

  • 7/28/2019 Ookla Benchmark

    8/13

    Vodafone C3V.1.O

    8 November 20, 2012

    Latency Speedtest Ookla - Key Factors

    Certain devices score better on latency due to high-endcapabilities and higher processing power

    Group Latency Status Sept.12

    Source: Ookla

    Mar12 data

    Terminal Influence

    Serverandterminalperformancearekeyfactorsinenduserexperience

    Poor and inconsistent server performance impact UKlatency. During May 12 there were 25 servers with latency

    > 150ms. Actions taken with Ookla and VF UK.

    Source: Ookla

    Sept.12 data

    *

    * server name (% of usage)

    Server Influence

  • 7/28/2019 Ookla Benchmark

    9/13

    Vodafone C3V.1.O

    9 November 20, 2012

    Latency Speedtest Ookla Terminal Influence

    Group Latency Status Sept.12

    Source: Ookla Sep12 data, All VF OpCos

    UL (Mbps)

    DL (Mbps)

    Key observations

    iPAD3/iPhone5 are best performing (20ms

    better than best Android) thanks to better

    processor and HS dual carrier.

    20% of Android speedtest come from low

    end devices with poor latency >100ms

    Latency in Android devices 21.6Mbps isimpacted due to poor latency in Samsung SIII,

    Samsung SII and HTC One X (see next slide

    and backup).

    *

    UL (Mbps)

    DL (Mbps)

    Model

  • 7/28/2019 Ookla Benchmark

    10/13

    Vodafone C3V.1.O

    10 November 20, 2012

    Latency Speedtest Ookla High-end capability Smartphones/Tablets

    Group Latency Status Sept.12

    Samsung S+ Samsung SII Samsung SIII HTC One X iPhone 4 iPhone 4S iPhone5 iPad3

    UL Mbps 5.76 5.76 5.76 5.76 5.76 5.76 5.76 5.76

    DL Mbps 14.4 21.6 21.6 21.6 7.2 14.4 43.2 43.2

    Latency(ms)

    Source: Ookla Sept. 2012 data,

    All VF OpCos, All servers

    samples in backup

    Thereis

    abig

    gap

    (up

    to

    40ms)

    between

    latest

    Android

    and

    iOS devices

    See also

    backup

  • 7/28/2019 Ookla Benchmark

    11/13

  • 7/28/2019 Ookla Benchmark

    12/13

    Vodafone C3V.1.O

    12 November 20, 2012

    Total view of the customer for Best Network Latency Sept.12

    Group Latency Status Sept.12

    55 ms (P3)

    67ms (Ookla)

    +89 ms (Ookla)

    +102 ms (Ookla)

    TopCapability

    Devices

    High -endDevices

    AllDevices

    USB modem

    iPad3

    iPhone5 + iPad 3 + Android 5.7/21.6 Mbps

    5.7/21.6

    P3 server

    All Ooklaservers

    All Ooklaservers

    All Ooklaservers

    iPhone5

    +

    + estimate weighted by speedtests

    5.7/43.2

    5.7/21.6

  • 7/28/2019 Ookla Benchmark

    13/13

    Vodafone C3V.1.O

    13 November 20, 2012

    Latency Targets

    Group Latency Status Sept.12

    Average (mathematical Median) across all devices