Meetings/CPRM/2012 06 22

These are the notes from a meeting between Firsthand & TPRG.

Aloha, DGr

_______________________________________________________________

    A G E N D A     

_______________________________________________________________ ( Maryam + Halle: met upstairs )

1. OVERALL PLAN 2. MUSIC 3. BIOFEEDBACK: new GSR gear see: affective.com 4. DISPLAYS, TRACKERS: parallax: Ari's idea 5. COMUNICATION W/OTHERS 6. Cool!, Drift, Weasel: rename & plan to finish 7. VALUES 8. USAGE SCENARIO 9. BORDER CROSSING ISSUES 10. MOBILE DEVICE DEV.

ACTION ITEMS FOR EVERYONE IS AT BOTTOM OF THIS EMAIL

_______________________________________________________________ 1.OVERALL PLAN: get data in fall _______________________________________________________________ get data, by whatever means necessary, in fall VMW: for mindfulness meditation; finish in JUST DO IT mode Cool!/Drift: for distraction/"bad days"/anxiety w/as few changes as possible

_______________________________________________________________

2. MUSIC: 

_______________________________________________________________

  biofeedback: see <biofeedback> below
  wireless headphones: noise cancelling useful for cutting out treadmill noise, put mike in for communicating with measurer
    (lots of hospital noise)

CONTACT Karon MacLean re: headphone booties

   keep sound effects binaural, keep music positional
  (nearphones instead of earphones): ID can mount headphones on

>>> Howard has a bunch of speakers: full range (8) mount on array

_______________________________________________________________ 3.BIOFEEDBACK _______________________________________________________________

HOOK UP TO TREADMILL: RS 422 connector (in c-sharp) no standard way to talk to treadmills) spped indication, or 
  Don Ice has os is a company called HeartRate Games phase 1 SBIR W/TOm, hired Tom to build an interface to exercise equipment
  goal: middlewware: app store for exercise equipment on proprietary signals; he has a prototype device that plugs into exercise equipment
  talks a more universal language 

>>> send treadmill model to Ari & Howard

BIOFEEDBACK:

   TWO PARAMETERIZATIONS (visual: fog/ sound1/ sound 2)
   (data isn't driving anything at moment)
   have a plugin that reads it
   what do we want to do with the data? (Ari's explanation: externalizing certain aspects of your body & makie them explicit, 
          become aware of cause & effect in order to influence those subtle aspects)
   1. PARAMETERIZATION: VISUAL: FOG: the more the immersant/participant relaxes, the less fog
   2. PARAMETERIZATION TWO: MUSIC 
       OPTIONS
   music: the deeper the meditative state, the more sounds you hear, the more you are meditating
   subtle environmental sounds, the more you focus on the environment, the clearer, more detailed the osund
   a) biofeedback that would control a filter: at first, subtle, then open up a lowpass filter
   b) track for biofeedback milestones
   c) positional audio
   BIOFEEDBACK MUSIC: specific compositional elements: control tempo (anthroporcybersyncronicity in virtual enironments rhythm & intimacy
   immersion is influence by tempos to match what heart rate is ("interlocking rhythmn")
   polyrhythms: driven by HRV, treadmill
   how to do in f-MOD, plug-in square tangle
   study re: Maureen (speeding up visual cues, made people go faster)
   relationship between music & heartrate: 
--Mark has environment set up on machine, is researching what kind of audio engine (how many tracks do we have access to)
   Mark: music & biofeedback book
   Mark
   TRACK 1: LOW PASS FILTER FOR SOUND EFFECTS BIOFEEDBACK, rhythm & tempo
   TRACK 2: will record sounds for nature, composition

dandelion fluff EQ (frequency)

_______________________________________________________________ 4.DISPLAY/ STUDIES, trackers _______________________________________________________________ >>> ARI: add field (deforest) and/or fluff, to function as one or two visual "milestones" so it doesn't seem like an unending, undifferentiated walk

1. mono projection vs. 2. HMD vs. 3. VR glasses? ACTIVE Panasonic Projector shutter glasses: higher frame rate (120 hz. per eye) fund. 24hz 2000 lumens down PASSIVE (40lbs. each + mounting) 5000 lumens per eye (get bigger, higher resolution, full frame rate) DVI 60hz per eye

diff. btwn active display vs. passive display: expense sep. eyes, using time (temporal multiplexing) strobes, so need to be strobed vs. polarization

HEAT • Falcon northwest lunchbox computers (quadro) (fan noise ok) $1700. or so

crossplatform glasses RF & bluetooth sync

PROJECTORS: Firsthand's HMD: 2 sensor tracker $100.

_______________________________________________________________ 5.COMMUNICATION W/OTHERS _______________________________________________________________ TOM? HITLab Tasmania, HITLab NZ Mark Billinghurst, looking at creating one in Malaysia & Europe

  rat lab on 40th turned into his playland, private research, still has UW teaching position/bunker
  coming back in a couple weeks

FIRST WEEK IN JULY WILL BE BACK IN Seattle

---

CAHANA: Howard & Ari will meet with him, demo for DGr: find out from Pam DGr: introduce Magy (Boston) to Howard & Ari Ari's uncle runs games & playable media at UCSanta Cruz SBIR: NIMH: clinical neuroscience & entertainment $400k per year phase 1, $800 neuro improve Realworld functioning of patients

CS: LOOK UP NEURODEVNET, get in touch w/guys Michael (? guy at VA mtg.) recommended

_______________________________________________________________ 6.COOL!, COLD COMFORT WEASEL: FLOWE, FLOWING _______________________________________________________________

differences between distraction & 

cuter, bigger otters more demonstrative happy play animations: sit up, look around, lie down, happy hit, floating, beating chest, sliding otters targeting issue: SnowWorld, target in the centre of the screen (inherent problems) win: if you aim independent of looking, how to do the controls

where the thing is going to fly out from

motivation: playground, travel with an opportunity for play discover figure things out interface: accidental razor hydra: robust & cheap throwing affordances find DGr: sixence OEM rizer (what you want the Wii-mote to be) sequence to SNowWorld: best immersion things do something so that your small action results in larger things (throw snowball on top, falls down to get bigger snowball)

can't enjoy the result because you can't see it if it hit what you were looking at throwing at

_______________________________________________________________ 7.VALUES _______________________________________________________________ immersion

engagement: mechanics: you have to look at it and it comes from out of your face experiential: TEST IT size of the thing: targets are small in large landscape IS A MATTER OF WHERE YOU ARE IN THE FLIGHT PATH

HOWARD'S PROBLEM: if you are trying to 1. HARD TO HIT: smaller are harder to hit (conflict of attention between short range stuff and off in the distance) 2. SIZE influences being lower would help (size) 3. you don't have opportunity to build more interesting things because you are always

    keeping range of action short

visual flow, faster closer: target approaches you really fast hard to hit things balance experience better (Halo: took liberties with the aiming system) make target much more generous

touch environment: Human-Animal Interaction: controlling head is key factor for immersion

DISTRACTION: HMD vs. ID

>>> FIND SNOWWORLD, DANTE, NON-SEQUITER WORLD control was the most effective one study size? where published?

VALUES 1. ENHANCE IMMERSION 2. USER movement or not 3. user action or not 4. ambient movement 5. world responding immersive component Snoworld never got: cognitive immersion affordances I can see the world on magic carpet you could hear it imaginary world inferences (throwing stones) same result no matter what you hit: CHANGE THAT ORB: how much freedom do you want to give them? PERCEPTUAL ENGAGEMENT: ENGAGE YOUR MIND

physical constraints of patients: distraction or engagement: congitive enhgancement:

_______________________________________________________________ 8. USAGE SCENARIO _______________________________________________________________ 1. what do people/users think? 2. small studies controlled studies 3. ID vs. HMDs: they afford different things 4. ESTABLISH BASELINE: it reduces pain because it distracts 5. test ID: high field of view, low field of view (hi quality, low quality, ID):

    sense of immersion: efficacy at pain reduction: NEED A CONTROL

independent variables: a) display technology b) modality (visuals vs. sound, vs. spatial sound) sensory modalities c) audio tech. headphones vs. speakers d) comparison of temperature e) VECTION (perception of self-motion): look at content: ambient movement draws your attention f) Human-Animal interaction g) density (numbers of snowmen) h) engagement i) enhancement of effect (magnifcation of actions) j) too easy perceived as kid's game (as hard it is) k) rhetoric (metaphorical content) l) sense of agency

engaged in clinical context as good as placebo

TECHNICAL: MEDIA DESIGN RHETORIC: cute is ok IF it is non-Disney (example: TIM BURTON, volcanoworld monsters work because of texturemaps surrounding it) EXPERIENTIAL:

WATCH THINGS IN THE WORLD THROW FOOD, fish steers toward, spam, clown collar (otter food = spikey orb) THROW ORB variation: throw snowball vs. food weebles put out fires REMOVE ANNOYANCES

SHARE KARON's HUMAN_ANIMAL INTERACTION new

_______________________________________________________________ 9.BORDER CROSSING ISSUES: _______________________________________________________________ 1. DGr can get visiting faculty at the Art Institute of Chicago, but isn't a university

    DGr will investigate the possibilities of having a VISITING RESEARCHER/SCIENTIST gig at an AMerican university

2. Check w/SFU powers-that-be on assigning Ari to VISITING RESEARCH SCIENTIST 3. PREP FOR WALKING: see mirror neurons

UW ISIS (Institute for Simulations & Interactive S) Brian Ross Peter Oppenheimer mannequins Dr. J. Cahana: anesthesiologist UW uber pain + Dennis Turk Sam Shar Hunter works with Harborview

_______________________________________________________________ 10.MOBILE DEVICE DEVELOPMENT _______________________________________________________________ MODES OF USE: walking VMW MODES OF USE: sitting A+V use in mobile context, or intimate context: • use device for feedback: audio emphasis (nearly total) • bio measure via wristband • auto track data + turn into chart/graph

deepsea fish display visors stick above your head, visor: see thru eyephone display because toylike, could argue that it appeals to younger people who have pain

_______________________________________________________________ ACTION ITEMS FOR SUPERHEROES: DUE 4 JULY 2012 _______________________________________________________________

EVERYONE: DOCUMENTATION for future posterity, keep track of your notes + sketches for pubs + book remember: it is not possible to remember everything, so esp. for things that one is likely to forget, be sure you date & initialize your documentation >>> documentation filing: first of every month (send notes/scans to Terry: <tjlavend@sfu.ca>)

       how to decide what to send? BE CONCISE. send the most important thing you did; what you'd like to see in a book

>>> email: send each item in a sep. email whenever possible to facilitate easy <find>

       be sure to title email by your task so everyone can <find> it
       example: "Mark's specs for nearphone"

Diane Gromala TO DO LIST: review new GSR: affective.com review Sixense info • w/Mark: write+sketch specification

• order wireless headphones or nearphones specified by Mark

order mike equipment specified by Mark order: Falcon northwest lunchbox computers (quadro) (fan noise is ok) $1700. or so contact Dr. Pam Squire to see what the relationship is between Dr. Turk & Dr. Cahana check on research scientists designation w/VPResearch documentation

Ari Hollander TO DO LIST: UNITY: HOW MUCH WOULD ARI CHARGE TO TEACH UNITY TO LAB GRADS? send DGr + CS videoclips from Mutants send URL to DGr,CS,MN re: leap motion gesture tracking (Ari signed up for a beta) send URL to DGr,CS,MN re: sixense URL visual terrain: add field and/or fluff, as a visual "milestone" so it doesn't seem like an unending, undifferentiated walk ^ read or listen to: Pain Chronicles: chapter1, 2, + neuroplasticity + cognitive chapters (Mark sent Ari URL re:free online version) documentation

Howard Rose TO DO LIST: let DGr know the result of your meeting w/Dr. Cahana get speakers to Mark ^ read or listen to: Pain Chronicles: chapter1, 2, + neuroplasticity + cognitive chapters (Mark sent Ari URL re:free online version) advise what/when DGr+CS should communicate w/Tom talk to DGr re: projectors mounted on frame documentation

Chris Shaw TO DO LIST: review new GSR: affective.com review Sixense info see that someone (incoming student: Mehdi) writes treadmill driver biofeedback drivers CS: LOOK UP NEURODEVNET: ensure contact w/guy at downtown VA mtg. (Michael?) referenced check on research scientists designation w/VPResearch documentation

Mark Nazemi TO DO LIST: review new GSR: affective.com review Sixense info send treadmill mdoel # to Ari + Howard • w/DGr: write+sketch specification

• specify wireless headphones or nearphones (anecdotal test?)

documentation

Maryam Mobini TO DO LIST: transcribe notes from interview documentation

Terry TO DO LIST: review w/DGr+CS how display studies above fit w/your studies archive monthly incoming documentation

Tyler Fox TO DO LIST: ask Karon for 2 papers: her best ref. for human-animal(pet?) interaction [HAI] + the best of papers her lab published re: HAI send the two papers to everyone listed above

---

FUTURE THINGS TO DO explore mobile device transfer