Open in TheBrain

RAMAMOORTHY, Subramanian, Collaborative Robotics, Edinburgh, June 10, 2016

<p class="MsoNormal" >also see private.</p>

<p>

RAMAMOORTHY, Subramanian, Collaborative Robotics, Edinburgh, June 10, 2016

(also see his YouTubes on collab robotics (soccer match) and using

Baxter for assistance)</p>

<p>

This is a noon seminar at Stanford.&nbsp; He is on sabbatical here for 6 months.</p>

<p>

robotics at Edinburgh...</p>

<p>

shows video of Freddy... a robot in Scotland Museum.</p>

<p>

from the 1960s.</p>

<p>

did pick and place task on objects on a moving table.</p>

<p>

and shows Shakey&nbsp; (SRI)&nbsp; famous robot from the 60s...</p>

<p>

what might be next...</p>

<p>

Collaborative&nbsp; Intelligent Robotics...</p>

<p>

coordinated interaction with others...</p>

<p>

shows collab&nbsp; robot&nbsp; from&nbsp; fraunhofer...</p>

<p>

intention aware collab with Baxter...</p>

<p>

an experiment from his lab...</p>

<p>

Baxter works an intel asst.</p>

<p>

baxter infers intention from workers gaze.</p>

<p>

"I think her needs the scissors"</p>

<p>

he's going to need the forceps….</p>

<p>

(I think&nbsp; of my appendectomy with the Filipina nurse)</p>

<p>

intention awareness...</p>

<p>

heeds the script but perhaps the surgeon changes his mind.</p>

<p>

from his lab&nbsp; in&nbsp; Edinburgh...&nbsp;&nbsp; Informatics Lab</p>

<p>

intention aware collab with the Baxter... get this video&nbsp; => AI/robo.</p>

<p>

driving forces and implications</p>

<p>

tasks can be ill-specified and environments are complex...</p>

<p>

interaction can help resolve incompleteness...</p>

<p>

&nbsp;

and&nbsp; interaction variability and redundancy...</p>

<p>

hidden vars...</p>

<p>

</p>

<p>

Thinking fast and slow&nbsp; (like Daniel Kahnemann book)</p>

<p>

policies for dynamic and highly var. environs...</p>

<p>

1)&nbsp; can use prior experience and human demonstrations...</p>

<p>

and might there be a simpler template&nbsp; (like a script)</p>

<p>

so&nbsp; ... fast&nbsp; context-specific&nbsp; adaption of policies</p>

<p>

and slower... unsupervised learning of categories and concepts...</p>

<p>

and need to know properties of the system...</p>

<p>

eg&nbsp; are you working on a one gram part or&nbsp; a&nbsp; 150 kg&nbsp; engine.</p>

<p>

programming by demo&nbsp; (using&nbsp; Baxter)</p>

<p>

MIT... Rod Brooks&nbsp; company...</p>

<p>

easy to program by normal people.</p>

<p>

human&nbsp; just&nbsp; grabs&nbsp; the arm and moves it thru&nbsp; range of motion&nbsp; for the task&nbsp; (eg pick and place)</p>

<p>

Q... what is the task&nbsp; (inferring it)</p>

<p>

woman... wiping off dining room table.</p>

<p>

Manifold learning for generalizing motion...</p>

<p>

Havoutis&nbsp; IJRR 2013...</p>

<p>

robot&nbsp; carrying a tray&nbsp; like a waiter...&nbsp; despite being jostled.</p>

<p>

keeping tray stable and flat.</p>

<p>

representing&nbsp; motion:&nbsp; graphs&nbsp; probabilistic roadmap</p>

<p>

shows path planning... eg&nbsp; getting an arm into a tight engine space under the hood.</p>

<p>

not explicitly in the graph...</p>

<p>

topolog&nbsp; problem...&nbsp; do you go around object&nbsp; or take a direct path.</p>

<p>

&nbsp;

he calls this homotopy...</p>

<p>

homology ... where are the holes in the 3d space...</p>

<p>

constructing filtration from samples</p>

<p>

where did the robot actually go...</p>

<p>

Cech&nbsp; complex...</p>

<p>

an abstract&nbsp; simplicial complex&nbsp; which is homotopy&nbsp; equivalent...</p>

<p>

and&nbsp; a Delaunay-Cech Complex...</p>

<p>

(obey&nbsp; properties&nbsp; like transitivity)</p>

<p>

can do trajectory classificaion in simplicial complex...</p>

<p>

&nbsp;

is this path like this other one...</p>

<p>

shows a&nbsp; large filtration interval with only two cases&nbsp; (with a planar robot)</p>

<p>

either go&nbsp; to the R or the L around the solid object...</p>

<p>

gets samples in joint space in 4d.</p>

<p>

shows video of&nbsp; two different paths&nbsp; (that both&nbsp; go under an object...</p>

<p>

baxter&nbsp; expt&nbsp; in 3d&nbsp; with 97 trajectoires...</p>

<p>

can use&nbsp; hierarchical agglomerative clustering to combine&nbsp; classes.</p>

<p>

shows&nbsp;&nbsp; baxter&nbsp; grabbing a long&nbsp; cardboard&nbsp; cylinder...</p>

<p>

both&nbsp; arms&nbsp; go together to the L of the obstruction or&nbsp; L arm

&nbsp;goes to the L and R arm goes to the R of the obstruction...</p>

<p>

so...&nbsp; this is useful for planning...</p>

<p>

PR2&nbsp; object handover...</p>

<p>

are objects on the red table or on the nearby blue table...</p>

<p>

want to make prediction...</p>

<p>

eg people moving toward the door...</p>

<p>

can coarsen the path&nbsp; by making increasingly large blobs&nbsp; around the path to the door.</p>

<p>

(he is on sabbatt. here for the year)</p>

<p>

Expt 1&nbsp; qualitat&nbsp; behavior...</p>

<p>

eg&nbsp; indoor navigaiton...</p>

<p>

we building a particle filter&nbsp; (like a Kalman filter)</p>

<p>

coarse&nbsp; cloud&nbsp; and&nbsp; fine cloud&nbsp; (of trajecs)</p>

<p>

so can accept evidence from a fatter cloud of trajectories.</p>

<p>

suppose,&nbsp; someone says he's on the R side of the building...</p>

<p>

then that gives you evidence of a fat cloud of trajecs that&nbsp; go to the R.</p>

<p>

which bundle of paths is he in?</p>

<p>

and can run these at multiple scales of coarseness.</p>

<p>

Expt 2:</p>

<p>

understanding performance...</p>

<p>

MPF&nbsp; =&nbsp; particle filter...</p>

<p>

.. it helps...</p>

<p>

&nbsp;

*</p>

<p>

decision making context...</p>

<p>

working together with unknown partners...</p>

<p>

&nbsp;

with SV Albrect... see AIJ in 2016&nbsp; eg.</p>

<p>

Ad Hoc coordination...</p>

<p>

robo interacts with person... but... is it gramma or a small child or roboticist.</p>

<p>

&nbsp;

eg&nbsp; have a library of types&nbsp; (that could be&nbsp; FSM = fin state machines)</p>

<p>

stochastic&nbsp; bayesian game model...</p>

<p>

this is end player&nbsp; markov&nbsp; decn process.</p>

<p>

try to computer&nbsp; posterior beleif&nbsp; of the type</p>

<p>

(say have a library of types&nbsp; )</p>

<p>

but the true type space&nbsp; may be unknown... ie need to smapel fromt he true space)</p>

<p>

Bellman optical decn making...</p>

<p>

Harsanyi-Bellman Ad Hoc&nbsp; coord.</p>

<p>

eg&nbsp; consider a game&nbsp; with 2 or 3 players&nbsp; trying to get foods&nbsp; (with 5&nbsp; vs 8 difft foods)</p>

<p>

did this at Royal Society summer science exhibition 201 2 in London...</p>

<p>

427 partic... from age 9 to age 72...</p>

<p>

human played against their agent...</p>

<p>

Prisoners dilemma</p>

<p>

vs&nbsp; rock paper scissors...</p>

<p>

&nbsp;

we do much better in terms of&nbsp; total welfare

&nbsp;(ie&nbsp; combo of human and machine... get higher total score)</p>

<p>

but what if type space is wrong?</p>

<p>

&nbsp;

&nbsp; summary </p>

<p>

policies for dynamic and high var&nbsp; enviro...</p>

<p>

and slow changing policy AND&nbsp; fast changing&nbsp; dynamics...</p>

<p>

so... difft time scales...</p>

<p>

and analysis of properties eg safety of&nbsp;&nbsp; a path.</p>

<p>

&nbsp;

conclusion..</p>

<p>

collab robos&nbsp; bring up new opportunities.</p>

<p>

can also do programming by discussion... let use it to describe task</p>

<p>

and humans can help the&nbsp; robo get past barriers for learning...</p>

<p>

and&nbsp; abstract concepts that we wish to impart eg

&nbsp; like&nbsp; bubble wrap protects objects from breaking during a fall.</p>

<p>

&nbsp;

*</p>

<p>

&nbsp;</p>

<p>

&nbsp;</p>

Attachments