VLAB Affective Computing May 21 2015
<p class="MsoNormal" >VLAB AFFECTIVE Computing, May 21 2015</p>
<p>
This is at 7PM on Thursday at the Biz School, Stanford.
This is in the VLAB series spons by MIT and Stfd. see link.</p>
<p>
Moderator is <b>Zavain Dar</b> (a senior assoc) at Lux Capital.</p>
<p>
There are 4 panelists:</p>
<p>
<b>Yuval Mor</b>: co-founder and CEO of Beyond Verbal</p>
<p>
<b>Rana El Kaliouby</b> (former student of Rosalind Picard at MIT (founder of this field)
co-fndr and Science CSO of Affectiva</p>
<p>
<b>Ken Denman</b> Pres and CEO of Emotient</p>
<p>
and <b>Mary Czerwinski </b>Resch Mgr of MSFT Research.</p>
<p>
*</p>
<p>
Zavain begins: (intro by Tom) </p>
<p>
he was invited to be a panelist and at the last minute invited to be the moderator.</p>
<p>
Affective Computing: the power of emotion analytics...</p>
<p>
zavain.dar@luxcapital.com</p>
<p>
<b>technology that knows how you feel</b>...</p>
<p>
AC = Affective comp 1) digests 2) processes and 3) displays it or mimics it...</p>
<p>
begun a long time ago...</p>
<p>
Carl-Herman Hjortsjo: FACS facial action coding system </p>
<p>
then went to Paul Ekman UCSF Atlas of Emotions (coding emotions)</p>
<p>
then on to Rosalind Picard (Affective Comp at MIT)</p>
<p>
emotions are uniform across cultures.</p>
<p>
Rosalind 1997 book called AC.</p>
<p>
what are emotions?</p>
<p>
reductionist models vs data driven model</p>
<p>
(there are terms in Urdu that don't exist in Palo Alto (and that are different in East PA))</p>
<p>
are there 7 genl human emotions?..</p>
<p>
like basketball positions see Alagappan</p>
<p>
mid-range big men..etc. (in bball).</p>
<p>
capturing pop culture imagination</p>
<p>
like Wall E;</p>
<p>
play chess but not a clue as to what's going on emotionally...</p>
<p>
Ex Machine eg... emotions part of Turing Test...</p>
<p>
novel sensors eg check diam fo pupils...</p>
<p>
big data; Deep Learning and ML.
microexpressions (cutting edge: breaking down emotions)</p>
<p>
Vocal, gestural, and facial;
but also heart EMG; brain eeg; muscle EMG; skin GSR.
eg <b>Sensum sensor</b>.</p>
<p>
see Sensum; Eyeris;; EmoVu etc.</p>
<p>
apps: focus groups; educaiton; market res;
mental health; advertising; crinimal investig;
entertainment;</p>
<p>
shows face of dtr of RANA at Khan Acad... bewildered; etc. understanidng etc.</p>
<p>
Viral ship my pants Kmart... vs not viral...</p>
<p>
How homo economicus went extinct in WSJ...</p>
<p>
Carol Tavris article in WSJ.</p>
<p>
Dan Ariely irrationality book;</p>
<p>
the market...</p>
<p>
32B in consumer mkt research
<b>Greenfield </b>and whitespace in the apps</p>
<p>
we can imagine the possibs but v early.</p>
<p>
first speaker is Yuval Mor *</p>
<p>
YUVAL MOR *</p>
<p>
co-fndr and CEO of BEYOND VERBAL.....</p>
<p>
voice-based emotion...</p>
<p>
friend offered him basketball tickets....</p>
<p>
asked wife if it was ok... she said "fine (?)"</p>
<p>
but the WAY she said it!!! that betrayed her true feelings.</p>
<p>
voice delivers msg beyond words...</p>
<p>
like babies understanding parents in another country (adoptng parents)</p>
<p>
are parents happy and relaxed or stressed out...</p>
<p>
tone of voice can be understood by the baby.</p>
<p>
shows obama and putin... it's all in how you say it!</p>
<p>
SIRI...</p>
<p>
fear, excitement, desire, dominance,</p>
<p>
want machine to have the ability to truly listen...</p>
<p>
science of emotion (at Beyond Verbal)</p>
<p>
5 patents; major awards; 20 yrs res; 1.5M samples and 40+ langages;
major awards; commercial proven.</p>
<p>
use it for HC = healthcare; wellness; customer service; entertainment;</p>
<p>
use it in CC = call centers;</p>
<p>
where to focus our attn (panelists will focus on this)</p>
<p>
we are a start up... we need a collab platform
cloud based API service...</p>
<p>
license the tech; can be difft from mobile vs CC.</p>
<p>
next phase... listening to the body...</p>
<p>
say to friend... you don't sound so well...</p>
<p>
moving on to continuous and passiv emonitoring for QS quant self...</p>
<p>
start with biosensing devies like fitbit;</p>
<p>
eg sensing parkinsons thru the voice!!</p>
<p>
see Apple's ResearchKit keynote on Mar 9 2015...</p>
<p>
say "Aaaah" into microphone as long as you can.. (to dx Pkson Ds)</p>
<p>
pronounced you VAHL...</p>
<p>
he is the presenter......</p>
<p>
moderator <b>Zavain Dar</b> continues (Zava says that they have 700M under mgmt... early stage investments)
</p>
<p>
rest of panel... in order is</p>
<p>
my far right is <b>Mary Czerwinksi</b> Res Mgr at MSFT Res</p>
<p>
next <b>Ken Denman</b>..(a VC; also CEO of. Emotient.)</p>
<p>
<b>Rana El Kaliouby</b> (from Egypt) PhD from Cambridge , MIT Media Lab...
CSO = cheif strategic officer at Affectiva.</p>
<p>
RANA goes first...</p>
<p>
<b>Affectiva </b>she shows it... aims it at Zavain and picks up eyebrows</p>
<p>
and it does SMILE; brow raise; brow furrow;</p>
<p>
frown; valence; engagement....</p>
<p>
she steps Zavain thru emotions and we see it in RT.</p>
<p>
one of our main use cases...</p>
<p>
how does the user respond to content...(eg a new ad)</p>
<p>
Doritos commercial... high emotional engagement...</p>
<p>
see RT emotionaljounery</p>
<p>
v funny commercial...</p>
<p>
great demo !!!! get that commerical...</p>
<p>
</p>
<p>
Mary Czerwinski next....</p>
<p>
only in this area for 4 years... (she is a psych by trainign)</p>
<p>
MSFT started on STRESS... CV probs , GI probs;</p>
<p>
people are not used to doing anything abt this...</p>
<p>
what do u do abt your stress...</p>
<p>
want to give u tools that will help u get better...
want to teach u + coping skills...</p>
<p>
she had a debate with her boyfriend (in our aud)</p>
<p>
we would use instruments</p>
<p>
going to Whistler to ski... big argument....</p>
<p>
she exploded and then he got a msg from the cloud "your friend Mary is upset"</p>
<p>
big laugh... and they forgot argument...</p>
<p>
v empowering for kids...</p>
<p>
<b>KEN DENMAN</b> next</p>
<p>
blue pants were a gift from his dtr....(v jazzy turquoise pants)</p>
<p>
Seth Diamond is his biz partner.... get the timing right... that's where the risk is.</p>
<p>
camera tech, processing power etc.</p>
<p>
<b>Emotient </b>is his company Pres CEO; UCSD team of 6 PhDs... profs...</p>
<p>
want to understand tigers... don't go to zoo.. go to the wild...</p>
<p>
we don't nec tell people the truth...(when they ask, eg, what we thoughtof something)</p>
<p>
50% of ad dollars are wasted (and I don't know which 50%) well... WE KNOW.</p>
<p>
Which ads work really really well...</p>
<p>
how to assess efficacy of ads....</p>
<p>
RANA goes next...</p>
<p>
privacy issue... 5 yrs ago there was just 3 of us...</p>
<p>
emotions are personal... as team.. we will respect.. so all is OPT IN...</p>
<p>
gender diffs,culture, age diffs;; camera will turn on... u can opt in before recording from your phone.</p>
<p>
as a team... so much data we cannot watch videos anymore...</p>
<p>
Ken we are NOW recording the audience in RT = realtime !!! we'll show u later.</p>
<p>
privacy impt...</p>
<p>
anonymized, aggregated faces. once we process data...</p>
<p>
how do large groups of people react to media... but need due care.</p>
<p>
Zavain... tech that is creepy at time zero is ok at time 5.</p>
<p>
must deliver value to the market...</p>
<p>
like credit cards on internet... at first, a creepy thing but it is v high value...</p>
<p>
Mary says... we forget emotions pretty quickly... in ab 24 hours...
but if someone bums u out, u avoid them....</p>
<p>
monitor changes over time...</p>
<p>
why haven't these taken off? asks Zavain...</p>
<p>
Rana... still learning with the algos... now we have the sensing down.
our tech is in SDKs and APIs...</p>
<p>
but we need to spark the imagination of people...</p>
<p>
so, whats intial app? asks Z.</p>
<p>
people ask... training actors... dating application; sales training; (before and after)</p>
<p>
Ken D: big digital screens... butt seats...
want to measure attn and engagement...
we can lift ad revs in these venues by verifying real engagement and attn..</p>
<p>
impt to measure....</p>
<p>
Rana was first with her company (raising money)
she was with Roz Picard at MIT in Affect comp...
director of Media Lab said... it's time to spin out!
(when Rana wanted more money from her for more fte's)
she then decide to go from acad to biz... challenge was FOCUS.. what's the killer app.
want an emotion chip in all our devices... act on it...</p>
<p>
VCs... this is not snake oil...
we've raised 20M (Rana says)
lots of ad work... but many other apps...</p>
<p>
Mary what is your avatar thinking of you, the user?
want agent to be neutral to happy...</p>
<p>
Zavain = Zava nickname...</p>
<p>
wired our team and played poker... (says Mary at Msft abt her team)</p>
<p>
Rana was out early on this...
the rest are following behind her... (Rana was in this 15 years ago)</p>
<p>
Yuval... Unilever does product side by side comparisons... with this...</p>
<p>
Yuval working CCs = call centers; difft app than mkt res.</p>
<p>
but want to use it for wellness...</p>
<p>
Z: can u collab? this is a humungous space... want to evangelize together...</p>
<p>
Z says (Ken confided to me...that is not true;
actually was ARE in competition) big laugh!</p>
<p>
Ken... we are v early... the academics all know one another....</p>
<p>
ken's team are the guys at UCSD profs.</p>
<p>
we need to validate this space... then run like heck...</p>
<p>
try to boil the ocean... but we'll ID are own verticals.</p>
<p>
Zava : but... concern abt every 13 year old who has 5 sodas per day
cuz we can really read that kid.</p>
<p>
Mary... we're abt health... did we get this wrong? wnat people to feel better.
ie give the 13 yo kid more info so make better decisions.</p>
<p>
Mary... going to FB anyway... why not go there to find 3 things you really are grateful for...</p>
<p>
Ken... objective measurement of pain...
(say, beter than a nurse can.. is it a 4, is it a 7)
bipolar, PTSD,</p>
<p>
concussion thing with iPad.... red or green for FB player...</p>
<p>
Rana... suppose I can ID that you like sentimental content... then give you that.</p>
<p>
aud Q cross cultural diffs: Mary did study... big diffs... even in reacting with emtonla words...</p>
<p>
Rana... Brazil.. more expres than SE Asia...</p>
<p>
UK no diff btwn men and women but in USA 40% more expressive (women than men)</p>
<p>
Japan peer pressure abt not expressing emotion..</p>
<p>
Yuval... we have a tool.. the mood of the world</p>
<p>
<b>KEN DENMAN does a demo</b> (Steve Ritter is here, his collaborator will do demo)</p>
<p>
Steve uses ...</p>
<p>
shows audience...contempt, neutral, sadness...</p>
<p>
great picture !!!! I get a neutral...</p>
<p>
Steve "this is during Yuval's talk" big laugh..</p>
<p>
<b>shows an emotion on every single face in the audience</b>...
wow!!! stunner!!! as the speech rolls...</p>
<p>
<b>MARY solve a really good problem that's important.</b></p>
<p>
<b>Ken D: really undersatnd how u will deliver value to ur customer</b>
<b>it's not just enough to give customer insight</b></p>
<p>
<b>Rana ignore the naysayers</b>...</p>
<p>
Yuval: develop your own gut feeling... cuz get conflicting advice...
</p>