Echtzeit-Analyse von Social Media Daten mit Jedox und GPU ... · Business Driven Intelligence,...

Post on 23-May-2020

2 views 0 download

Transcript of Echtzeit-Analyse von Social Media Daten mit Jedox und GPU ... · Business Driven Intelligence,...

Business Driven Intelligence, Analytics & Performance Management. www.jedox.com - @JedoxAG - @PSJedox

Echtzeit-Analyse von Social Media Daten mit Jedox

und GPU-beschleunigten OLAP Datenbanken

Peter Strohm, Offenburg, 05.03.2015

Business Driven Intelligence, Analytics & Performance Management. www.jedox.com - @JedoxAG - @PSJedox

Jedox: In-Memory OLAP Database

2002 Gegründet in Freiburg

Heute 100+ Mitarbeiter Standorte in Freiburg,

Frankfurt, Düsseldorf, Paris, Boston

120+ int. Business Partner 100.000+ Jedox Users

Version 5.1

Business Driven Intelligence Self-Service BI & Performance Management ExcelPLUS Jedox Web & Mobile GPU Accelerator

Business Driven Intelligence, Analytics & Performance Management. www.jedox.com - @JedoxAG - @PSJedox

In-Memory OLAP-Database

Alle Daten im Arbeitsspeicher 1

Multi-dimensionale Datenbank-Struktur

2

Jan

Feb

Mar

Q

1

Ap

r

May

Jun

Jul

Q2

Au

g

Sep

Q3

O

ct

No

v

Dec

Q4

Yea

r

All regions Europe France

Italy UK

North America USA

Canada Mexico

Count TweetID Longitude

Business Driven Intelligence, Analytics & Performance Management. www.jedox.com - @JedoxAG - @PSJedox

In-Memory OLAP-Database

Jan Feb Mar Apr May Jun Jul Aug Sep Dec Nov Oct

Q1 Q2 Q3 Q4

Year

Hierarchische Struktur der konsolidierten Elemente

3

Berechnung “on-the-fly” 4 Jan

Feb

Mar

Q

1

Ap

r

May

Jun

Jul

Q2

Au

g

Sep

Q3

O

ct

No

v

Dec

Q4

Yea

r

All regions Europe France

Italy UK

North America USA

Canada Mexico

Count TweetID Longitude

Business Driven Intelligence, Analytics & Performance Management. www.jedox.com - @JedoxAG - @PSJedox

In-Memory OLAP-Database

Nur Basis-Elemente speichern 5

Keine Null-Werte speichern 6

Speicher sparen, “up to date” !

Jan

Feb

Mar

Q

1

Ap

r

May

Jun

Jul

Q2

Au

g

Sep

Q3

O

ct

No

v

Dec

Q4

Yea

r

All regions Europe France

Italy UK

North America USA

Canada Mexico

Count TweetID Longitude

Multi-dimensional & In-Memory i

Business Driven Intelligence, Analytics & Performance Management. www.jedox.com - @JedoxAG - @PSJedox

Twitter: Big Data in Real-time

Business Driven Intelligence, Analytics & Performance Management. www.jedox.com - @JedoxAG - @PSJedox

Persistente Twitter Daten in OLAP

add

Update „trending“ mit

Web+ETL

update

Einfügen der Tweets

in ETL

Jedox Social Analytics Workflow

filtering

Streaming via php in . Web

Public Twitter Stream

streaming

analyzing

www

Mobile

SA App

Web

ExcelPLUS

Business Driven Intelligence, Analytics & Performance Management. www.jedox.com - @JedoxAG - @PSJedox

Jedox Social Analytics Showcase

Business Driven Intelligence, Analytics & Performance Management. www.jedox.com - @JedoxAG - @PSJedox

Jedox Social Analytics Showcase

Business Driven Intelligence, Analytics & Performance Management. www.jedox.com - @JedoxAG - @PSJedox

Jedox Social Analytics Demo

Business Driven Intelligence, Analytics & Performance Management. www.jedox.com - @JedoxAG - @PSJedox

Social Media Analytics: HeatMap

Business Driven Intelligence, Analytics & Performance Management. www.jedox.com - @JedoxAG - @PSJedox

Social Media Analytics: Trending

Top 100 Trending Faktor: 1

# Alle vorherigen Tage

# Aktueller Tag ___________________

~28.000 Wörter 2

Business Driven Intelligence, Analytics & Performance Management. www.jedox.com - @JedoxAG - @PSJedox

Jedox Social Analytics with GPU

System: 2 x K40 mit 2 GB GPURAM

Xeon CPU mit 128 GB RAM 1

Datensätze mit > 400 Millionen Einträgen 2

Berechnung findet auf allen Daten statt 3

Speed-up bis zu 50x (und mehr)! 4

Business Driven Intelligence, Analytics & Performance Management. www.jedox.com - @JedoxAG - @PSJedox

Jedox BI Open Source

Open Source Download: http://sf.net/projects/palo 1

Jedox Base Version unter: www.jedox.com 2

Social Analytics App unter: www.jedox.com/de/jedox-social-analytics

oder im Windows 8.1/Phone Store

3

Business Driven Intelligence, Analytics & Performance Management. www.jedox.com - @JedoxAG - @PSJedox

Ausblick

Features:

- HeatMap ausbauen

- Trending-/Cooling-Faktoren

- Tonalität von Tweets

1

Input Stream:

- GPU beschleunigt

- Asynchron

2

Business Driven Intelligence, Analytics & Performance Management. www.jedox.com - @JedoxAG - @PSJedox

VIELEN

DANK