Final Documentation

In the final production of my project, I have successfully implemented all three of the ofxOpenCv images classes (ofxCvColorImage, ofxCvGrayscaleImage and ofxCvFloatImage). These different ofxCv classes each functions differently through the same input of the camera. The output is different because of the restrictions I have set for each. Only when a certain degree of pixels will be shown once the subject moves a certain way. One of the most interesting thing I find doing this project is that how one webcam can display so many different things at once on one screen. Another thing that is fascinating is to observe the amplified pixels and also the buffer image. Sometimes if the subject doesn’t move at all in front of the webcam, then certain frames are completely dark. However, once the subject starts moving then these frames are back alive again. The way I have presented “pop art” on my live canvas is somewhat inspired by Andy Warhol’s Marilyn Monroe. I wanted to create something that is offset the grid and somewhat disturbing. Hence the fact that I used random color flashing in the background making this installation more strange.

An installation scenarios for my project would be projecting the display on a large scale. I would like users to experiment the different frames and see that one input can have multiple outputs. When users are moving so fast or so slow these frames can really show significant difference. What is fun about the last frame, which is the largest one of them al is that pixels are constantly moving around the subject. It doesn’t matter if they subject is moving or not, these pixels will float like small particles. It is fun to look at them and think what is the internal logic behind this. When the subject is not moving, it does not detect the pixels so then two of the frames will become dark. It is almost as if the subject is in control what is happening on the screen. One thing I would like further do with this project is to add in the morphing or other functions in the ofxOpenCv addon. It would be really great to see more happenings with this one input and many output system.

Final Prototype and ofxAddon Research

Since my concept is mainly focusing on the usage of webcam and experimenting the possibilities displaying multiple frames of different display all at once, I have found ofxOpenCv useful for my project. Open Computer Vision (OpenCV) library contains hundreds of classic and newest algorithms for image processing and analysis. In the ofxOpenCv addon there are collection of classes and these classes’ names begin with ofxCv. In my project I will be using ofxCvColorImage, ofxCvGrayscaleImage and ofxCvFloatImage for the different frames I want to explore in my display.

The ofxOpenCv addon supports my conceptual experimentation because I want to have different types of display and degrees of pixels shown on my webcam display. Not only do I get to manipulate how I want the gray scale to be but also having the variety and differences between each frame. I want to make four frames to mimic pop art style, however, in my project I would want to create one frame that is off centered and larger in scale than other frames. I want to go out the boundary of symmetry and also the conventional pop art canvas. I want to show these frames with offset coordinate and let users experience the oddness.

The ofxOpenCv addon works because I am calling the ofxCvColorImage which represents the three-channel color images with color components. Basically, this first frame wii just be what the camera reads. My next frame will use ofxCvGrayscaleImage class which will represent the grayscale with pixel values. These images will have internal processing such as thresholding and contour finding and also has the ability to work with binary images which contains only two pixel values. For the gray scale image, it will display the absolute difference of the frames. The third and fourth frame, it will use ofxCvFloatImage which can amplified difference image and the other one showing buffer image.

From playing with these ofxOpenCv addons, I have learned that these image classes can have varieties of display which can be further explored. My ultimate goal is to have these different displays all sync under one screen and let users experience and see for the difference in each of these frames.

Work Cited

http://opencv.org/

Final Project Proposal

For my final project, I want to explore the idea of reflection and what we usually don’t see when we visualize the world, particularly I want to look into the world of pixels. I am inspired by the work of Nam June Paik because he applies the concept of cybernetics and loops. In the TV Buddha installation I admire the cybernetic connection between the buddha in front of the tv and their reflection. My concept will be focused on the relation between the participant in front of the webcam and objects they hold will be represented in forms of pixels which can follow their movement and form uniquely. When we take photos or zoom in on images really close, we could actually see that images are made of pixels. Pixels can create one image but we cannot see them when we look at things. Just like how our bodies are made out of cells and tissues, we do not see them with the naked eye or even view the human body as “pixelated” individuals. What I want to depict in my final project is to let users see the pixel world and the reflection of things they hold. This idea of cybernetics can be used in both technical and personal level because it not only raise the question of things we see but also how we see things in our daily lives. I also want to investigate on the changes of how webcam can display on screen depending on light and motion.

In terms of the software aspect for my final project, I will use openframeworks and use the webcam function to display user’s reflection. I will also make pixels that follows and forms the objects the user if holding or even turn the whole user into pixel form. In one screen I would like to experiment with multiple types of reflection and degrees of pixelation. I want to let users experience seeing themselves more than just their facial appearance or what the world see them as. Another thing I want users to feel when they interact with this webcam is that they see the changes happening and the differences between multiple frames all happening at once.

My artwork and the environment will interact in a site-specific installation context through the relationship between screen and activity. Everyone will experience different response and see how their activities will change the display on screen. Multiple frames in one screen will create a more dynamic experience because the display of motion will change depending on the gestures and lighting of the subject. Different frames will respond differently to the motion but all display at the same time which makes this cybernetic art more interesting since many things are happening at once and not only is there a reflection, but the system will determine what to display based on the agent.

Work Cited

http://www.medienkunstnetz.de/works/tv-buddha/

http://www.paikstudios.com/

http://openframeworks.cc/documentation/graphics/ofPixels/

Cybernetic Artwork from 1960s: Edward Ihnatowicz - Sound Activated Mobile (SAM)

SAM or the Sound Activated Mobile is one of the first cybernetic artwork from the 1960s. It was the first moving sculpture which moved directly and recognizably in response to what was going on around it. This artwork is created by Edward Ihnatowicz and was exhibited at the “Cybernetic Serendipity” exhibition in London in 1968 at the Institute of Contemporary Art and later moved the exhibition to Canada and US.

SAM is constructed with aluminum castings and had flower-like fiberglass reflector with an array of four small microphones mounted in the front. There are miniature hydraulic pistons inside the vertebrae which can make SAM move in relation to each other and the whole column could twist and lean forward and backward. There is an electronic circuit used as signals for the four microphones to determine the direction which any sound in the environment was coming from and two electro-hydraulic servo-valves moved the column in the direction of the sound. When people walked around SAM, there is movement and it fascinate observers. The sculpture also was sensitive to quiet but sustained noise, rather than shrieks. People would stand in front of SAM and try to produce the right level of sound to attract its attention and movement.

This artwork is a classic example of cybernetics because it follows the second wave of cybernetics which contains reflexivity: the relationship between system and its environment. Its behavior of system changes the environment as well and there is a feedback loop that’s happening between the art piece and the human interactions.

Work Cited

https://en.wikipedia.org/wiki/Edward_Ihnatowicz

https://www.youtube.com/watch?v=8b52qpyV__g

http://www.senster.com/ihnatowicz/SAM/sam.htm

Cybernetics

Cybernetics is the study of self-regulatory systems of any kind. Cybernetics is formally defined as the science of control and communication in animals, men and machines. It basically extracts whatever to its concerned with information processing and control. In the past, "cybernetics" was applied to self-regulatory systems and by Norbert Wiener's description, cybernetics in terms of both society and machines. He used society as a description of how each person is regulating which created order within society. One major characteristic of Cybernetics is its preoccupation with the construction of models and here it overlaps operational research. Cybernetic models are usually distinguished by being hierarchical, adaptive and making permanent use of feedback loops. One could say that cybernetics is like science of organization. For example the human brain can be compared to cybernetics. There are characteristics of storage, feedback, etc. In any structure there are some sort of organizations and the cybernetics in it will function differently. The ideology of that cybernetic systems are relevant and has fluidity which allows adaptation through changing times is the core of cybernetics.  

Cybernetics has changed since the 1960's because of technology improvements. There is a great improvement in artificial intelligence. The aim of this is to show how artificially manufactured systems can demonstrate intelligent behavior. Cybernetics can also be applied cross-field such as in education, engineering and others. Francis Heylighen describes cybernetics as a "first-order" which that the given can be freely manipulated and observed. The interaction between observer and system is the main focus and evolves the definition of cybernetics. With artificial intelligence, systems are both self-regulatory and interactive and can be regulating itself independently.

The four most important attributes of cybernetic system are self-regulation, feedback, user-observer interaction, and control. In which self-regulation is the core of all systems. According to Wiener the ability to receive information and react accordingly is one of the fundamentals of cybernetic systems. Feedbacks are also an important characteristic because without feedback, it will only be a one-way command that does not perform interaction. User-observer interaction is to analyze the system. Machine system cybernetics is making the interaction between human and machine more creative and break away from the boundaries.

Works Cited

Heylighen, Francis. "Cybernetics and Second Order Cybernetics." Encyclopedia of Physical Science & Technology. New York: Academic, 2001. N. pag. Print.

Wiener, Norbert. Cybernetics; Or, Control and Communication in the Animal and the Machine. New York: M.I.T., 1961. Print.