Robotics in Silicon Valley - Automationspraxis...2018/06/19  · •Current focus on developing ROS...

Post on 16-Jul-2020

4 views 0 download

Transcript of Robotics in Silicon Valley - Automationspraxis...2018/06/19  · •Current focus on developing ROS...

KIT – Die Forschungsuniversität in der Helmholtz-Gemeinschaft

Intelligente Prozessautomation und Robotik (IPR) ––– Institut für Anthropomatik und Robotik (IAR) ––– Fakultät für Informatik

www.kit.edu

Robotics in Silicon Valley

Prof. Dr.-Ing. Torsten Kröger

Institute for Anthropomatics and Robotics (IAR)

Intelligent Process Control and Robotics (IPR)

2

Content

• Non-exhaustive overview of US robotics

activities

• Mostly based on personal experience

Institute for Anthropomatics and Robotics (IAR)

Intelligent Process Control and Robotics (IPR)

3

Outline

(Un)related Stories from Silicon Valley

Robot Arms and Grasping

Robots in Logistics

Institute for Anthropomatics and Robotics (IAR)

Intelligent Process Control and Robotics (IPR)

4

Open Source Robotics Foundation (OSRF)

• Willow Garage spinoff (May 2012)

• Non-profit organization

• Maintains ROS and Gazebo

• CEO: Brian Gerkey

• Current focus on developing ROS 2.0

• No safety, no proper real-time

Institute for Anthropomatics and Robotics (IAR)

Intelligent Process Control and Robotics (IPR)

5

Open Source Robotics Corporation (OSRC)

• Taxable subsidiary of OSRF (Sep 2016)

• For-profit

• Initially funded by Toyota Research Institute

• OSRF will keep holding software copyright

• New website: http://www.openrobotics.org

Institute for Anthropomatics and Robotics (IAR)

Intelligent Process Control and Robotics (IPR)

6

Southwest Research Institute

• Initiated ROS industrial (ROS-I)

• Non-safe, non-real-time connection to COTS

industrial robots

• Head of ROS-I: Shaun Edwards

Institute for Anthropomatics and Robotics (IAR)

Intelligent Process Control and Robotics (IPR)

7

RTI – Real-Time Innovations

RTI Connext DDS

Distributed real-time middleware

Institute for Anthropomatics and Robotics (IAR)

Intelligent Process Control and Robotics (IPR)

8

Toyota Research Institute (TRI)

• R&D in multiple robtoics domains:

• Self-driving

• Production and manufacturing

• Autonomous mobile manipulation

• CEO: Gil Pratt

• CTO: James Kuffner

Institute for Anthropomatics and Robotics (IAR)

Intelligent Process Control and Robotics (IPR)

9

Toyota Research Institute (TRI)

• HSR, Human Support

Robot

Institute for Anthropomatics and Robotics (IAR)

Intelligent Process Control and Robotics (IPR)

10

Huawei Technologies

• Mobile robot for kids and education

• Strong emphasis on social human-robot

interaction

Institute for Anthropomatics and Robotics (IAR)

Intelligent Process Control and Robotics (IPR)

11

Mayfield Robotics (Bosch)

• Kuri

• Home robot

• Announced price: $699

• Inherently safe

• Focus on social human-

robot interaction

Institute for Anthropomatics and Robotics (IAR)

Intelligent Process Control and Robotics (IPR)

12

Mayfield Robotics (Bosch)

Institute for Anthropomatics and Robotics (IAR)

Intelligent Process Control and Robotics (IPR)

13

Mayfield Robotics (Bosch)

Institute for Anthropomatics and Robotics (IAR)

Intelligent Process Control and Robotics (IPR)

14

Mayfield Robotics (Bosch)

Institute for Anthropomatics and Robotics (IAR)

Intelligent Process Control and Robotics (IPR)

15

Mayfield Robotics (Bosch)

Institute for Anthropomatics and Robotics (IAR)

Intelligent Process Control and Robotics (IPR)

16

Mayfield Robotics (Bosch)

Institute for Anthropomatics and Robotics (IAR)

Intelligent Process Control and Robotics (IPR)

17

Mayfield Robotics (Bosch)

Institute for Anthropomatics and Robotics (IAR)

Intelligent Process Control and Robotics (IPR)

18

Mayfield Robotics (Bosch)

Institute for Anthropomatics and Robotics (IAR)

Intelligent Process Control and Robotics (IPR)

19

Savioke

• Delivery robot: Relay

• Hotels, logistics, home

• Founder and CEO: Steve Cousins

Institute for Anthropomatics and Robotics (IAR)

Intelligent Process Control and Robotics (IPR)

20

Savioke

Institute for Anthropomatics and Robotics (IAR)

Intelligent Process Control and Robotics (IPR)

21

Silicon Valley Robotics

Institute for Anthropomatics and Robotics (IAR)

Intelligent Process Control and Robotics (IPR)

22

Verb Surgical

• F(o)unded by J&J and Alphabet

• „Surgery 4.0“: digital surgery platform

• Robotics

• Visualization

• Advanced instrumentation

• Data analytics

• Connectivity

Institute for Anthropomatics and Robotics (IAR)

Intelligent Process Control and Robotics (IPR)

23

Auris Health (formerly Surgical Robotics)

• Founded by Fed Moll

• Monarch: Auris Robotic

Endoscopy System

• Out of stealth in 2018

• Acquisition of Hansen

Medical

• Device FDA approved

Institute for Anthropomatics and Robotics (IAR)

Intelligent Process Control and Robotics (IPR)

24

Intuitive Surgical

• da Vinci Surgical System is still the sole product

• „Major“ product upgrade announced

Institute for Anthropomatics and Robotics (IAR)

Intelligent Process Control and Robotics (IPR)

25

SRI International

Institute for Anthropomatics and Robotics (IAR)

Intelligent Process Control and Robotics (IPR)

26

SRI International

Institute for Anthropomatics and Robotics (IAR)

Intelligent Process Control and Robotics (IPR)

27

openAI

• F(o)unded by Elon Musk in 2015

• Non-profit

• Mission: „Friendly artificial intelligence“

Institute for Anthropomatics and Robotics (IAR)

Intelligent Process Control and Robotics (IPR)

28

• Learning robot motions from human

demonstrations in VR

• Founder: Pieter Abbeel

Covariant.AI

Institute for Anthropomatics and Robotics (IAR)

Intelligent Process Control and Robotics (IPR)

29

• On-demand supply-chains that enable

profitable, one-hour delivery for online

grocers.

• Based in Israel

• Investors from California

Commonsense Robotics

Institute for Anthropomatics and Robotics (IAR)

Intelligent Process Control and Robotics (IPR)

30

Symb.io

• Machine learning for robotics

• Still in stealth mode

Institute for Anthropomatics and Robotics (IAR)

Intelligent Process Control and Robotics (IPR)

31

Magic Leap

• Augmented realty devices and eco system

• Based in FL, CA, ,Switzerland, and Israel

Institute for Anthropomatics and Robotics (IAR)

Intelligent Process Control and Robotics (IPR)

32

ARRAIY

• Content creation for AR and VR using computer

vision and deep learning

• Still in stealth phase

Institute for Anthropomatics and Robotics (IAR)

Intelligent Process Control and Robotics (IPR)

33

Lighthouse

• Part of the Playground Global incubator

• Deep learning for visual object recognition

Institute for Anthropomatics and Robotics (IAR)

Intelligent Process Control and Robotics (IPR)

34

Lighthouse

Institute for Anthropomatics and Robotics (IAR)

Intelligent Process Control and Robotics (IPR)

35

Suitable Technologies

• F(o)under: Scott Hassan

• Tele-presence robots

• Beam Pro

• Beam Plus

Institute for Anthropomatics and Robotics (IAR)

Intelligent Process Control and Robotics (IPR)

36

Outline

(Un)related Stories from Silicon Valley

Robot Arms and Grasping

Robots in Logistics

Institute for Anthropomatics and Robotics (IAR)

Intelligent Process Control and Robotics (IPR)

37

Institute for Anthropomatics and Robotics (IAR)

Intelligent Process Control and Robotics (IPR)

38

Institute for Anthropomatics and Robotics (IAR)

Intelligent Process Control and Robotics (IPR)

39

Alphabet

• Robotics acquisitions 2013 and 2014

Holomni

Institute for Anthropomatics and Robotics (IAR)

Intelligent Process Control and Robotics (IPR)

40

Interview from Dec 2016

Institute for Anthropomatics and Robotics (IAR)

Intelligent Process Control and Robotics (IPR)

41

June 2017

Institute for Anthropomatics and Robotics (IAR)

Intelligent Process Control and Robotics (IPR)

42

X

Institute for Anthropomatics and Robotics (IAR)

Intelligent Process Control and Robotics (IPR)

43

Learning Hand-Eye Coordination

Input

512x512 pixels

Finger position

Output

Task space

gripper motion

Institute for Anthropomatics and Robotics (IAR)

Intelligent Process Control and Robotics (IPR)

44

800,000 attempts

14 robot arms

Two months

CNNs for deep

reinforcement learning

Shared models

Learning Hand-Eye Coordination

Institute for Anthropomatics and Robotics (IAR)

Intelligent Process Control and Robotics (IPR)

45

Data Driven Robotics

Institute for Anthropomatics and Robotics (IAR)

Intelligent Process Control and Robotics (IPR)

46

Different Objects, Different Grasping Strategies

Institute for Anthropomatics and Robotics (IAR)

Intelligent Process Control and Robotics (IPR)

47

Different Objects, Different Grasping Strategies

Institute for Anthropomatics and Robotics (IAR)

Intelligent Process Control and Robotics (IPR)

48

Different Objects, Different Grasping Strategies

Institute for Anthropomatics and Robotics (IAR)

Intelligent Process Control and Robotics (IPR)

49

New (Unknown) Objects

Institute for Anthropomatics and Robotics (IAR)

Intelligent Process Control and Robotics (IPR)

50

X, Google Research

Next Generation Arm Farm

Institute for Anthropomatics and Robotics (IAR)

Intelligent Process Control and Robotics (IPR)

52

DexNet 2.0 (UC Berkeley)

Institute for Anthropomatics and Robotics (IAR)

Intelligent Process Control and Robotics (IPR)

53

Outline

(Un)related Stories from Silicon Valley

Robot Arms and Grasping

Robots in Logistics

Institute for Anthropomatics and Robotics (IAR)

Intelligent Process Control and Robotics (IPR)

54

RightHand Robotics

• Based in Massachusetts

• Autonomous picking for e-commerce order

fulfillment

Institute for Anthropomatics and Robotics (IAR)

Intelligent Process Control and Robotics (IPR)

55

Kinema Systems

• Robot paletizing

• 3D vision using deep learning

• Founder: Sachin Chitta

Institute for Anthropomatics and Robotics (IAR)

Intelligent Process Control and Robotics (IPR)

56

Kinema Systems

Institute for Anthropomatics and Robotics (IAR)

Intelligent Process Control and Robotics (IPR)

57

Fetch Robotics

• Autonomous mobile robots for warehouses

• Founder: Melonee Wise

• ROS

Institute for Anthropomatics and Robotics (IAR)

Intelligent Process Control and Robotics (IPR)

59

Fetch Robotics

Institute for Anthropomatics and Robotics (IAR)

Intelligent Process Control and Robotics (IPR)

61

Outline

(Un)related Stories from Silicon Valley

Robot Arms

Robots in Logistics

Thank you!

torsten@kit.edu

Institute for Anthropomatics and Robotics (IAR)

Intelligent Process Control and Robotics (IPR)

63

De-hyping AI

1. Machine learning means learning from data; AI

is a buzzword

2. Machine learning is about data and algorithms,

but mostly data

3. Unless you have a lot of data, you should stick

to simple models

Prof. Dr.-Ing. Torsten Kröger

Institute for Anthropomatics and Robotics (IAR)

Intelligent Process Control and Robotics (IPR)

64

Simplified: The “Four Revolutions”

1. Mechanical hardware

2. Electrical hardware

3. Software

4. Data

Prof. Dr.-Ing. Torsten Kröger

Institute for Anthropomatics and Robotics (IAR)

Intelligent Process Control and Robotics (IPR)

65

Simplified: The “Four Revolutions”

1. Mechanical hardware

2. Electrical hardware

3. Software

4. Data

Prof. Dr.-Ing. Torsten Kröger

Institute for Anthropomatics and Robotics (IAR)

Intelligent Process Control and Robotics (IPR)

66

Simplified: The “Four Revolutions”

1. Mechanical hardware

2. Electrical hardware

3. Software

4.Data

Prof. Dr.-Ing. Torsten Kröger

Institute for Anthropomatics and Robotics (IAR)

Intelligent Process Control and Robotics (IPR)

67

Simplified: The “Four Revolutions”

1. Mechanical hardware

2. Electrical hardware

3. Software

4.Data

Prof. Dr.-Ing. Torsten Kröger