Olivia Klose | Technical Evangelist, Microsoft...
34
Olivia Klose | Technical Evangelist, Microsoft @oliviaklose blogs.technet.com/ oliviaklose
Transcript of Olivia Klose | Technical Evangelist, Microsoft...
Olivia Klose | Technical Evangelist, Microsoft
@oliviaklose
blogs.technet.com/oliviaklose
Meet Olivia | @oliviaklose
• Microsoft Technical Evangelist– Fokus: Big Data, Hadoop, Hive, etc.
• Machine Learning– Informatik mit Mathematik an der University of Cambridge, TU
München und dem IIT Bombay
– Medizinische Bildgebung
– Nuklearmedizinische Klinik in München
• IT Erfahrungen in Großunternehmen
Agenda
Modul Inhalt
1 Intro & Big Data Buzzwords
- Big Data, Hadoop, MapReduce, HDInsight
2 Big Data Szenario: Twitter-Analyse
3 Manage: Daten extrahieren und speichern
- Windows Azure Blob Storage, Windows Azure SQL Database, VM
4 Analyse: Daten analysieren
- HDInsight, Hive
5 Insights: Erkenntnisse aus Daten gewinnen
- ODBC Treiber, PowerPivot & PowerView
Modul 3
Manage: Daten extrahieren und speichern
• Windows Azure (Blob) Storage
• Windows Azure SQL Database
• Virtuelle Maschine
• Demo
Analyse
Hive Tables
…
Mash Up & Visualise
Manage
Extract
StreamInsight
SQL Azure
Azure BlobStorage
Real-Time Dashboard
Windows Azure (Blob) Storage
Modul 3 – Manage: Daten extrahieren und speichern
Extract
StreamInsight
Analyse
Hive Tables
…
Mash Up & Visualise
Windows Azure Blob Storage
SQL Azure
Azure BlobStorage
Real-Time Dashboard
Windows Azure Storage Account
South Central US
West US East US
Western Europe
Windows Azure Storage Abstractions
Blob Storage Concepts
• Store large amounts of unstructured text or binary data with the fastest read performance
• Highly scalable, durable, and available file system
• Blobs can be exposed publically over HTTP
• Securely lock down permissions to blobs
Windows Azure Storage
Tools
• CloudXplorer
• CloudBerry
Explorer
• Azure
Storage
Explorer
DEMOWindows Azure Blob Storage
Windows Azure SQL Database
Modul 3 – Manage: Daten extrahieren und speichern
Extract
StreamInsight
Analyse
Hive Tables
…
Mash Up & Visualise
Windows Azure SQL Database
SQL Azure
Azure BlobStorage
Real-Time Dashboard
Windows Azure SQL Database
Windows Azure SQL Database
DEMOWindows Azure SQL Database
Virtuelle Maschine
Modul 3 – Manage: Daten extrahieren und speichern
Analyse
Hive Tables
…
Mash Up & Visualise
Manage
Extract
StreamInsight
SQL Azure
Azure BlobStorage
Real-Time Dashboard
VMs
VMs
Virtuelle Maschine: Datenextrahierung
• IIS, WebSockets, HTTP activation for WCF
• StreamInsight
• Visual Studio Solution
• Twitter Streaming
DEMOVirtuelle Maschine erstellen
DEMOIIS, WebSockets, HTTP activation for WCF
Temporale Semantik
• Query Processor: Gefühl für
Anwendungszeit
• StreamInsight LINQ: Temporale
Abfragen leicht zu schreiben.
Stream Data Processing
• Nimmt unbegrenzte Event-
Streams auf
• Wertet Abfragen über diese
Streams aus.
• Produziert Event-Stream.
StreamInsight
26
DEMOStreamInsight
DEMOVisual Studio Solution
DEMOTwitter Streaming Einstellungen
Datenextrahierung in Action!
Modul 3 – Manage: Daten extrahieren und speichern
Analyse
Hive Tables
…
Mash Up & Visualise
Manage
Extract
StreamInsight
SQL Azure
Azure BlobStorage
Real-Time Dashboard
DEMODatenextrahierung in Action!
Agenda
Modul Inhalt
1 Intro & Big Data Buzzwords
- Big Data, Hadoop, MapReduce, HDInsight
2 Big Data Szenario: Twitter-Analyse
3 Manage: Daten extrahieren und speichern
- Windows Azure Blob Storage, Windows Azure SQL Database, VM
4 Analyse: Daten analysieren
- HDInsight, Hive
5 Insights: Erkenntnisse aus Daten gewinnen
- ODBC Treiber, PowerPivot & PowerView
©2013 Microsoft Corporation. All rights reserved. Microsoft, Windows, Office, Azure, System Center, Dynamics and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.
