Yanki Akoglu

Usb Biofeedback Game Controller / DIY Muscle Sensor / EMG Circuit for a Microcontroller

Inorder to receive more data from the person inside the coffin I have been doing a research onbio sensors. This project is about controlling a game with muscles. Maybe i can use or build a handle that the volunteer can hold during the installation and give me some more data on his/her body.

Advancer Technologies’ “USB Biofeedback Game Controller” harnesses the power of electromyography to allow players to directly control video games with their muscles. At the core of this plug-in-play controller is the powerful yet low-cost Arduino UNO microcontroller, a favorite among hobbyist and students, acting as a HID keyboard interface. Integrated with the Arduino UNO are four of Advancer Technologies’ new Platinum Series Muscle Sensors, allowing four muscles to act independently or in combination with each other to control over four buttons. In their setup, Advancer Technologies elected to use a six button setup with the left forearm controlling the B button (RUN/ATTACK), the right forearm controlling the A button (JUMP), the left bicep controlling the LEFT button, the right bicep controlling the RIGHT button, and combinations for UP and DOWN.

During gameplay, the Arduino UNO program constantly senses the muscle activity of each muscle via the muscle sensors. When the player flexes a muscle, the Arduino registers a spike in muscle activity, triggering a button press, and sends this information to the computer via USB connection, all in real-time.

 

HOW TO BUILD IT?

They have also included information on how to build this technology. The introductory video is below.

The Web Site:

http://www.instructables.com/id/Muscle-EMG-Sensor-for-a-Microcontroller/

Pulse Mirror Installation

Pulse Mirror:

PulseMirror is an interactive installation device that collects and translates participants’ pulse rate into a mirrored visual image. The mirror image is created by a series of circles that pulsate heart rate data collected from different participants. Participants input their heart rate by placing their finger on the device for 15 seconds. The device which incorporates an Arduino detects the heart rate is detected and a random circle on the screen will become the representation of participant’s heart rate. Those circles on the screen will change their color to form a mirrored image that is captured by the webcam on the monitor

Pulse Tank – Visualising the Pulse Rate data with an Interesting Medium: Water

This project is again about visualising the pulse-rate. Its main idea to receive the pulse-rate data and transform in into a motion by using the unique design product that has the ability to change pulse-rate data into a movement. The first step is to receive the pulse-rate. The second step is to visualise the information. Screening the data onto a medium. The third step is to tranform data into motion.

Visualising the Heart Rate (Self Reflection-Art Installation)

This installation coded by using Ardiuno and Processing. They used heart rate transmitter which is sending pulse rate data to Ardiuno and used processing the to visualise this data. The laser light is controlled by the pulse rate. Processing helped the laser light to act considering the speed of the heard. They projected the laser light onto different canvases and increased the effectiveness of the project.

 

http://www.youtube.com/watch?v=j6K0iud7COE

Proposal 1st Draft

Project Definition

 

This project aims to collect and screen audiovisual data from humans such as pulse rate, mimics, gestures, breathing sounds as a reaction to designed sounds, light effects and edited videos using micro phoning, video recording and screening techniques inside of a ‘coffin’ that is designed, built, modulated and programmed to experience an installation, which is themed as:  ‘human life & death’.

 

Goals and Objectives

 

I have several goals that are related to varied parts of the project. I have listed my goals as follows:

 

Media Environment Based Project Goals:

 

-Finding/recording footages related to a theme: ‘life and death’

-Editing the videos according to the theme

-Designing the proper sound effects for the final video

-Designing the light effects

 

Project Atmosphere Creation Goals:

 

-Building the coffin with correct measurements

-Integrating the screens, speakers, microphones, lights and cameras successfully

 

Project Launch Goals:

 

-Screening the videos inside the coffin

-Playing the sound effects

-Turning on & off the lights according to the video

-Recording the sounds and videos of the people inside the coffin successfully

-Receiving the pulse rate data

-Screening the data correctly

 

Background Information

 

I have been questioning life and death for a long time. I have been thinking about the bad moments of humanity as well. With this project I have the chance of creating an installation, which can encourage people to question this topic as well. The coffin that I will be creating is not a real one. I just want my coffin to be able to record physical responses and emotions.

 

 

My challenge is to push myself to find and capture several footages for different characters that will be experiencing my installation. By creating various audiovisual effects for this installation, I will be very experienced on video and sound design. I will also understand how videos, angles, sounds, light games and etc. can affect humans. On the other hand when it comes to representing my installation I will be programming. I will generate a program that mixes all of the collected data of the person inside the coffin and reflects them to a wall with a projector. This program should be very successful in order for audience to understand what is going on with that person inside the coffin. So I will also gain information on programming.

 

This project is about my personal opinion of life: which I perceive as a chain of events that suggest you choices. I want volunteer people to consider their choices that they have made in their lives.

 

 

Target Audience/User

 

Age based Target Audience/User: My target audience is people age between 18-60.

 

Idea Based Target Audience: My idea is to reflect human life and the inevitable end of human kind: ‘Death’ with the videos, lights and sounds that I will be designing. This installation is about an environment where I will be creating an experience based on the idea of ‘Life and Death’. I would like to collect some biological data such as pulse rate, which will be determine the projected videos and the other effects that I will be designing. So the person who is inside the coffin should be able to give some responses to the environment and has to be able to understand the concept in correct way.

 

Health Issues: I don’t suggest people with heart conditions, hearing problems or people with very sensitive eyes to experience my installation.

What are the related topics in other disciplines?

 

– Sound Design

– Video Design/Editing

– Light Design

– Live footage Recording

– Micro-phoning

– Programming

 

What are the similar projects, web sites, art works and etc.?

 

It was very for me to find the similar works for my project because it is a combination of many media environments. The first similar project is an installation. In October 2012 when I was in New York I visited Guggenheim Museum. One of the exhibitions really affected me. This exhibition belonged to Rineke Dijkstra. The work was The Krazyhouse (Megan, Simon, Nicky, Philip, Dee), Liverpool, UK (2009), Dijkstra filmed teenage habitués of local clubs dancing to their favorite music. Presented as multi-channel video installations, these works showcase their subjects’ teen personas and methods of self-expression, revealed in how they style themselves, and in the movements of their bodies. Two video works made in 2009 at Tate Liverpool expand the artist’s interest in the empathetic exchange between photographer and subject to include the affective response.

 

This installation gave me an inspiration of recording people’s responses. Here are some scenes from the Krazyhouse.

 

http://www.youtube.com/watch?v=cy4CnhaPn44&feature=related

 

The second project is about visualizing heart beat rate and determining the upcoming texts according to the pulse rate. data This is basically what I am trying to do. The only difference is using videos rather then texts. I want the heartbeat of the people to determine the videos sequences that will be screening. So this project can really help me.    

http://vimeo.com/38388664

 

http://www.azumio.com/apps/heart-rate/

 

Detailed Project Description

 

I am planning on building a coffin, which includes several audio-visual elements. I want to cover the interior of my coffin with screens that will be playing videos that have the theme: ‘Life and Death’. These videos are collections of footages shot by me and shot by other people. I am also planning my coffin to have some speakers, microphones and lights aimed to play the sound effects, record sound data from the subject inside of it and create a extraordinary lit environment. These elements would help me to increase the effect of my theme and my idea of experiencing the death and memories from life.

 

My videos will basically be about human life, regrets,  bad moments in history and good memories. So all the videos will be familiar to people in terms of the common feelings that humanity shares. I would like to push people to feel that this live that they are living in, can change. I also aim to show them that they might become the protagonists in every situation in life.

 

In order to make people involved with the installation I will use their heart beat to determine the sequence of the videos.

 

At first I will try to launch my coffin properly in terms of screening the videos, hearing the sounds and playing the light effects. Then I will try to integrate some cameras, microphones and detectors that can record human pulse rate and can put this data as an output. My aim on integrating detectors, cameras and microphones, is recording subject’s biological responses and reflexes inside the coffin.

 

The second phase of the project includes projecting the data, which I will be getting inside the coffin to a wall. Aim of this part is to share the experience that the subject is having inside. This part requires programming. I will be using Processing and Ardiuno to collect data and to create the interface of the screening program.

 

In the third phase of the project I plan on copying the collected data and burn it to a DVD. So that can the subject can see his/her own reactions in the coffin.So this installation general aim to give people some kind of judgmental perception towards life but at the same time reminding them that they are the ones inside the coffin and they would be the one who is going to be ‘judged’.

Scope of the Project

 

In this project I will be using many disciplines such as; sound design, video design, light design, live footage-recording, micro phoning, programming and screening. I will be building a coffin where I will also be creating an audiovisual environment that tries to make people react towards the happenings inside.

I am not planning on collecting lots of scientific data. My aim is to collect physical reactions of the volunteer and his/her pulse rate.

 

My main aim is to make people understand how life affects us and how sometimes we feel regret for the events happening around us. This project of course includes my understanding of life and death and tries to make the audience and the volunteer to feel that.

 

 

Required Know-How and Resources

 

This project requires me to deeply learn Processing and Arduino inorder to program.

 

Needed Know-How Abilities

 

– I have to know how to do a live broadcasting

– I have know how to record sound properly and broadcast it.

 

Need Resources

 

I need some volunteers who can accept getting into my coffin and be comfortable about it for 2 minutes.

 

H/W needs, S/W needs, other.

 

 

 

 

 

 

Difficulties and Risks

 

– Failure on building the coffin that includes cameras, speakers, lights, – – microphones and screens

– Failure on programming the pulse rate determined video sequences

– Failure on screening the data in a collective way

– Failure on creating the effective videos that would make people react or make them feel something

– Failure on creating the effective sound effects

– Failure on creating the effective light effects

 

 

Phases of the Project

 

–  Shooting and gathering videos

– Editing the videos

– Designing light effects

– Designing sound effects

– Building the coffin

– Integrating the lights, speakers and screens to the coffin

– Testing the audiovisual devices inside the coffin by launching the designed videos, sounds and lights effects.

– Integrating the microphones, cameras to the coffin

– Testing the microphones and cameras (if they can capture data)

– Building up the heart rate device

– Collecting pulse rate data

– Programming the screening program

– Projecting the data inside the coffin to the exteriors

–  Launching the program that includes and process all these data

 

 

Criteria of Success

 

By the end of this project:

 

– I should finalize my effective video, sound and light design

– I should build my coffin with the correct measurements

– I should integrate my technological elements to my coffin properly

– I should be able to collect data

– I should be able to screen data

– I should be able to copy and distribute the data

 

In order to be successful I should full field all of these steps.

Rather than the technological part of the project there is one more challenge that I should overcome. ‘The Effectiveness of the Audiovisual Elements’ that I will be creating. My project can collect data, screen copy and distribute them but if they don’t make people to react or feel then the project will not be accomplished in content.

 

 

 

Project Schedule

Controlling the Strobe Light

Sensum integrates emotional response reporting into any media and is universally compatible with a wide range of platforms and devices. The company behind Sensum is called Filmtrip, and they are not new to this kind of thing.They made a video to demo Pulse Sensor sending data wirelessly over XBee, a moble app, controlling Xbox Kinect, and fading theatrical lighting over DMX512.

In this demo we are able to see how pulse rate can control a strobe light. Which basically is a part of my project.

Theatre Safety Glasses

This project is an example of transforming the pulse-rate data. The Pulse Sensor Amped is receiving the pulse rate data from the girls’ ear. When she feels frightened the curtain is closing down and blocking the eye sight. So it is helping us to close our eyes automatically and blocks us to see the scary scenes in the movie. I think that it is a very fun project and can help me out to understand how i can change the pulse rate data into a sequence determining decision maker.

 

Pulse-Rate Sensor Found! and It is 25$ amigos!

As a result of my researches i have found my pulse-rate sensor that can measure pulse-rate. It is an optical heart-rate sensor. Which reflects a light onto a fingertip and it measures the time that the light bounces back from the finger. It is a very simple understanding of a pulse-rate. Here is the explanation of the working system of the sensor.

“Optical heart-rate monitors are easy to understand in theory. If you’ve ever shined a flashlight through your finger tips and seen your heart-beat pulse (a thing most kids have done) you have a good handle on the theory of optical heart-rate pulse sensors.

In an optical heart-rate pulse sensor, light is shot into a finger tip or ear lobe. The light either bounces back to a light sensor, or gets absorbed by blood cells. As you continue to shine light (into say a fingertip) and take light sensor readings, you quickly start to get a heart-beat pulse reading. The theory is easy to understand. In practice, it hard to master DIY optical heart-rate sensors, or get them operational at all. There are many tutorials online and in publications describing how to make DIY heart-rate sensors.”

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

Pulse Sensor Amped is a greatly improved version of our original Pulse Sensor, a plug-and-play heart-rate sensor for Arduino.  It can be used by students, artists, athletes, makers, and game & mobile developers who want to easily incorporate live heart-rate data into their projects.  

 

Pulse Sensor Amped added amplification and noise cancellation circuitry to the hardware.  It’s noticeably faster and easier to get reliable pulse readings.  Pulse Sensor Amped works with either a 3Volt and 5Volt Arduino.  We’ve discontinued our previous Pulse Sensor models, because this one is far better.


Lastly, we’ve also streamlined and improved theProcessing visualization software and Arduino code that comes with this hardware.

 

The kit includes:

1) A 24-inch Color-Coded Cable, with a standard male header connectors. Plug it straight into an Arduino or a Breadboard. No soldering is required. 

 

2) An Ear Clip, perfectly sized to the sensor.  We searched many many places to find just the right clip.  It can be hot-glued or epoxied to the back of the sensor to get reading from an ear lobe.

 

3) Parts to make a handy Velcro Finger Strap. This is another great way to get heart-rate data.

 

4) 4 Transparent Stickers, to insulate the front of the Pulse Sensor from oily fingers and sweaty earlobes.

 

5) The Pulse Sensor has 3 holes around the outside edge which make it easy to sew it into almost anything.

 

6) Visualization software (made in Processing) to instantly see output of the sensor and for troubleshooting.

 

 http://pulsesensor.myshopify.com/collections/frontpage/products/pulse-sensor-amped

Project: Beats of Time

This project that I found includes arduino micro-controller and a pulse-sensor. The project is basically transforming the data coming from the pulse-sensor into a visual structure. The program is giving responses to the each pulse-rate and determining the upcoming visuals according to them.

The speed of the hear beat also determines the sentences coming from the character of the program. So we are somehow bringing the character to life.

 

The project:

“Beats of time” aims to explore the notion of time and its connection with our body and entity by making the participants aware of their own heartbeat, and therefore existence, while simultaneously evoking them to change their perception about time and initiate actions that would take advantage of their remaining “beats of time”

Hardware used:
1) Arduino microcontroller
2) Pulse sensor (pulsesensor.com)