Category Archives: looking-outwards

Michael

29 Jan 2013

Cool Visualization Stuff!

Ladder of Abstraction – Bret Victor

abstraction

This isn’t exactly a visualization of a dataset, but it’s a visualization and an explanation of an approach toward visualization (if that makes any sense).  The article explains that complex systems can be better understood when the system is viewed at multiple levels of abstraction and control.  The author illustrates his point by using a simple toy example of a car driving along a curvy road.  I find this interactive addition to be particularly useful in understanding the author’s point, and as a result, I have used this strategy in some of my past projects.  Bret Victor (large ego aside) does an effective job of illustrating a complex approach using the approach itself.  In summary: The best way to understand a complex system is to view it both from the eagle’s perspective as well as the ant’s perspective, and everything in between and sideways.  For those of us that learn by interacting, we need the affordances to change the system and move up and down the ladder of abstraction.

 

Thinking Machine 4 – Martin Wattenberg

Thinking Machine 4

Unfortunately the game itself wouldn’t load for me, but I still find this compelling enough to write about.  It also is an example of something which could be considered both a visualization of data and a generative form.  Wattenberg and friends have created a chess-playing program that differs in one unusual way: It reveals the computer opponent’s “thoughts,” or its anticipation of your possible moves and its best maneuvers through multiple iterations.  By playing the game, the number of possible futures can be seen to converge to victory, loss, or stalemate.  I find this interesting as humans are constantly evaluating both their own internal state and the internal states of those around them.  We’re fairly good at it, I would argue, but we still can only guess.  For computers, though, we typically have very little insight into individual decisions made in order to serve us a particular set of outputs.  Sometimes their actions seem unprompted.  Why is my hard drive spinning furiously?  Is it backing something up?  Updating software?  Do I have a virus?

I envision a future (hopefully a result, in part, of my thesis) where computers and humans work together in true collaboration to solve complex problems with massive amounts of both abstract context and quantitative data.  In order for this to come to pass, the mind of the computer must be as transparent as the user’s own.

 

Health Infoscape – GE, MIT SENSEable City Lab

GE

The goal of this application is to show the link between various symptoms in terms of which ones are likely to accompany others.  I think this is a fantastic dataset (7.2 million patient records) but only a mediocre visualization.  Clicking a symptom reveals its nearest neighbors.  These can be sorted by color-coded categories like mental health, and the set is divided by gender.  The user can also switch between circle or cluster mode.  It’s certainly pretty and not without its uses, but I feel like it falls short of being truly informative or “useful.”

Here’s what I would like to see:  First of all, links should be persistent so that multiple symptoms can be selected at one time.  Second, individual and joint Bayesian probabilities should be displayed or at least represented clearly in some manner such as line thickness.  Third, links should fade once these probabilities drop below a certain threshold.  Fourth, perhaps, these changes should exist in an advanced mode, for people who prefer things simpler… see the Ladder of Abstraction, I suppose.

John

29 Jan 2013

None of these examples are software based…to prove a point:

Mark Lombardi

lombardi1

Mark Lombardi was not a digital artists, but his work is the reason i first became interested in data visualization. Lombardi was an art historian/researcher who diagrammed complex networks of events (political, conspiratorial, etc). Lombardi’s work is special in (a) the thoroughness of his research and (b) the fact that it distills complex networks into visually beautiful/legible schemes.

Here’s a link to a 2003 NPR interview about Lombardi. 

Sol Lewitt wall drawings

sollewitt

Sol Lewitt’s wall drawing aren’t info-viz in the sense a traditional pipe-a-bunch-of-data-into-a-computer-and-make-pretty way, but they are the the result of the execution of an algorithmic/generative process of instruction following/code execution to visually represent a series of instructions which serve as both code and data. A example of these instructions from Wall Drawing 118:

On a wall surface, any
continuous stretch of wall,
using a hard pencil, place
fifty points at random.
The points should be evenly
distributed over the area
of the wall. All of the
points should be connected
by straight lines

xkcd: money

 

I’m putting Randall Munroe in rarified company here, but this is one of the best info-vis projects I’ve seen in along time. Again, it’s simply rendered, but it’s the research that makes it so staggering as an object. It’s immediate, compelling, and works across a number of scales. I’d  love to see it outside of a computer window and in print. Link.

Ersatz

29 Jan 2013

Deb Roy – The Birth of a Word

MIT researcher Deb Roy, wanted to understand how his infant son learned language,
so he wired up his house with cameras and microphones and for 3 years, he recorded almost every moment of his life. After processing 90.000 hours of video, his team extracted information and data about how a child tend to learn new words or where are their house social hotspots. It’s a really astonishing data-rich research about how we learn and interact.

Evan Roth – Multi Touch Paintings

http://www.evan-roth.com/work/multi-touch-paintings/

Could anybody steal your username and password by taking finger prints from your multi touch device, apparently not, if you play a lot of Angry Birds. Evan Roth created a series of provocative paintings with finger prints taken from his iPhone.

Skataviz by Theo Watson

Skataviz is an experiment using an iPod touch, attached to a skateboard, to visualize it’s movement in 3d space. I really love this project, because it shows how beautiful and complex skateboard tricks and movement can be.

Meng

28 Jan 2013

Dues make my nose blooding !!!!!!!!
Bloodnose actually with ofxosc + OfxBox2d.
This is a simply sketch with ofxosc+ofBox2d.
I trying to use other addones such as a combination of ofxCV ofxVector, but can not successfully build. So I decided to do it in a easy way with this two addones.These two addons are popular and with very good documentation. This may let a coding newbie do things less frustrated. With this experience I learn that the importance of good documentation such as coding comment and read me files.

The current technical problem is that I cannot update the circles behind the dude’s face…

PO4 - meng

code is here: https://github.com/mengs/ofxoscOfxBox2d

~Taeyoon

28 Jan 2013

The Upkit assignment got me to try out more than few dozen ofxAddons. It was like eye shopping in a shopping mall. I discovered a few that are remarkable for various reasons.

9475d9d0683b11e2925f22000a1fb71a_7

 

This is a screenshot of some of the addon installed at OF. Sometime during the work session, oF stopped compiling with no good reason, and after half an hour of panicked debugging and googling, I asked Zach Lieberman what to do. I thought it’s an Xcode error that happened when I changed setting for debugging, because it wouldn’t debug. He suggested downloading oF again, and it worked. I still don’t understand how addons work in actuality. I shopped around enough to understand what addons can do. Here are few favorites.

1. ofXAnimatable

687474703a2f2f6661726d392e737461746963666c69636b722e636f6d2f383038332f383332393937353631305f616235303664646463625f7a2e6a7067

 

This is a great toolkit to animate visuals in openFrameworks. It gives more than enough choices for oscillating data which one can use to position puppet or make generative graphics. While the tutorial is straightforward, I wish there was more examples which shows the addon in action. I didn’t know where to start with this addon and when compiled with other addons, there were major crashes which was difficult to nail down. However, it is mostly a problem of my unfamiliarity. https://github.com/armadillu/ofxAnimatable 

2. oFxTldtracker

fdc170a8691611e283fe22000a1fa511_7

 

ofxTldtracker can mosaic certain areas of the vision. Cool thing is that even if the subject moves around in the frame, mosaic follows it. It also has two example code which gives me a good idea how to work with it. I like it because it vaguely resembles adult films or crime documentary where they hide victim’s face. I’d need to find a way to alter pitch of voice, and I can have Instant B-grade film filter. Wait… that’s a great idea for an addon! (Picture is an owl I printed as a test for 3D printer. and his bottoms are pixelated with the addon.)

TLD was originally published by Zdenek Kalal under GPL version https://github.com/yusuketomoto/ofxTldTracker

 

3. ofxTriangleMesh

687474703a2f2f692e696d6775722e636f6d2f777a5a57572e706e67

This is a fun little addon that generates triangulated pattern when you draw on the map. I like it because it was easy to use, and the result looks like abstract artists like Sol Lewit. With a bit of research, I’m sure one can make Sol Lewit plugin or addon. I remember an art critic mentioning Sol Lewit’s understanding of mathematics was relatively simple. However it was his visual imagination that make great work. This addon also got me thinking more about relationship with Systems Art and Open source, which is a topic I have been discussing with artists like Kyle McDonald and David Horvitz.

 

https://github.com/ofZach/ofxTriangleMesh

 

~Taeyoon

28 Jan 2013

1. Mother by Inmi Lee and Kyle McDonald untitled_006 untitled_003

” This piece explores synesthetic connections between language and shapes through generative sculptures based on gestures that represent the participants’interpretation of particular sounds. The gestures were captured using Microsoft’s Xbox Kinect, interpreted with openFrameworks and printed with rapid prototyping machine.” http://www.inmilee.net/untitled.html 

View process on McDonald’s Flickr

This project captures a person in response to a set of foreign words that sounds slightly different. Their hand movement is meshed into 3 dimensional data which is later printed. The video is especially amusing because I understand the Korean words that the artist is asking participants to explore. It is an example of sound-verb that change meaning according to aggressiveness of pronunciation. 3D printed objects are exceptionally beautiful, appearing to be something between a mad Dentist’s nightmare and dinosaur bones. When one interacts with the piece by holding it, the relation between it’s production and presentation is conceptually and physically connected. However I have no idea why they titled the piece ‘mother’ at the end. (Created with openFrameworks)

2. Audience by Christ O’Shea and rAndom International

audience-2 audience-4
Each mirror object can be placed in any location and angle. A calibration set-up stage informs the software of these details. Each mirror is controlled by two servo motors giving it pan and tilt rotations. The mirrors rotate themselves in such a way that enables the viewer to approximately see their face in each mirror. The chat state is not random movement, but carefully scripted to give each mirror the appearance of different natural behaviors. An overhead camera provides a live image for analysis. An individual is then tracked using optical flow, to help stick with that person through a crowd. http://www.chrisoshea.org/audience

Thinking Mirrors are one of the all time favorite of the old New Media Art. Artists like Daniel Rozin have been working primary on creating reflection of the world via digital devices. This project is not a paradigm shifting concept, however I appreciate it’s sensibility and humor. When the mirrors go on to chat among themselves, it looks like surveillance cameras pointing at each other. What if all that mirrors can see is another mirror? What if there is no reality to reflect but only another reflections? This project questions such conditions of mediation while leaving plenty of rooms for interaction and playfulness. (Created with openFrameworks and OpenCV)

3. Artvertiser by Julian Oliver

artvert-v2_sml2 binoculars-website

The Artvertiser is a software platform for replacing billboard advertisements with art in real-time. It works by teaching computers to ‘recognise’ individual advertisements so they can be easily replaced with alternative content, like images and video. Rather than refering to this as a form of Augmented Reality technology, we consider The Artvertiser an example of Improved Realityhttp://theartvertiser.com/

If you ever imagined a world where media technology is not used to create more advertisement? and where ‘Creative Coders’ are not making immersive experience that celebrates artificial freedom while marketing a corporate brands? Julian Oliver’s project shows a hint of hope for the art, activism and creative technology. While the project page does not indicate specifically, I am certain the project was developed with openFrameworks because of the technical collaborators on team are some of core developers of oF. I’d like to study Oliver’s work closely to understand his definition of ‘critical engineering’ and if any, the difference between ideas of ‘Critical Art Ensemble’.

Dev

28 Jan 2013

buddha_big Screen Shot 2013-01-28 at 12.34.29 AM

 

I wanted to capture the essence of the passage of Nirvana in a clean elegant way. There is nothing   I find more annoying, absorbing, and distracting than a loading bar – a curse of modern technology. You know that feeling when you have that smidgen of a bar left, but you can’t get to the end? That is one of many emotions that you have to throw away on your passage to freedom.

I used ofxProgressBar to create the loading bar. I used ofxTimer to interval the “Give up” voice which was synthesized using ofxSpeech.


void testApp::setup(){
value = 0;
max = 8000;
progressBar = ofxProgressBar(10, 10, 500, 20, &value, &max);
go = true;

timer.setup(10000, true);
timer.startTimer();

synthesizer.listVoices();
synthesizer.initSynthesizer("Ralph");
}

//--------------------------------------------------------------
void testApp::update(){

//you can never really get to the end from this application
if(go && value < = max){ value += 50; max += 51; } //Every 5 seconds encourage the user to give up his quest if(timer.getTimeLeftInMillis() < 5000){ synthesizer.speakPhrase("Give up"); } }

GitHub: https://github.com/dgurjar/ToNirvana/

Kyna

27 Jan 2013

ofxAddons! This was the hardest and most frustrating project for me. Being totally unfamiliar with the openFrameworks environment as well as both the Code::Blocks and VisualStudio 2010 environments, it took me a good long while to figure out how to do anything in these projects. As it turns out, most of the pre-built project examples for ofxAddons are for Xcode. Of the 15 or so addons I tried, I eventually got three to work, and this is the most interesting combination I found. This is a combination of underdoeg’s openSteer flocking example and toruurakawa’s FakeMotionBlur. While maybe not particularly interesting or ‘lazy like a fox’, I think the result is actually pretty graceful.

Git -> maybe someday, when github and I reconcile our differences

Joshua

24 Jan 2013

Autostereogram

This allows for the creation of those “magic eye” images.  If a person focuses there eyes in the right orientation (rather cross-eyed or defocused) then a three dimensional image becomes visible. Detailed explanation on wikipedia.  I have always enjoyed these images and I recall wishing, as a youngster, that I could make my own.  Now its possible! I want to make bizarre abstract three dimensional scenes.  I wonder if you could even make an animation this way, although it might be extremely difficult to keep in focus.

 

MSAFluid

Fluids are amazing, and modeling them on computers is awesome.  This add-on is for solving navier-stokes equations for 2d fluid flow.  It can be in real time.  I am super interested in physical modeling and simulation to create generative sculpture and images.  This could be really useful for a larger form-finding process that involves flow.  For example many underwater creatures grow in the presence of flow.  The forms that these creatures display are often closely related to the flow conditions they experience as they develop.

MarchingCubes

While I find reading about the marching cubes algorithm interesting, I don’t think I really want to spend the time creating it from scratch.  Basically this algorithm lets one create meshes from scalar fields.  The resulting meshes approximate iso-surfaces, or surfaces that are formed from points that all have the same scalar value.  Iso surfaces of crazy scalar fields look awesome.  Also a special type of iso surfaces are called meta-balls.  Anyway it seems like a great tool for making nice blobs or meshes from stick-like models.  I am interested in making a bunch of 3d-printed nodes that hold dowels or metal rods.  Marching Cubes algorithm might be a good way of generating elegant connectors.

Erica

23 Jan 2013

ofxaddons yay!
1. ofxSelfOrganizingMap
This addon helps to implement a mapping of high-dimensional data to a low-dimensional space. I don’t know a whole lot of about self-organizing maps or unsupervised machine learning but I’m really interested in machine learning and from reading some of the linked wikipedia pages, the addon sounds pretty cool and may be something I’d like to experiment with when doing the data visualization project.
2. ofxOpticalFlowFarneback
I posted a video called Optical Flow Test that uses OpenFrameWorks and OpenCV in my previous post, which uses this addon. I’ll post it again for convenience:

I really hope to experiment with optical flow because I think it could be used as an awesome interface for something or as a way of exploring or mutating a virtual space to create a different kind of experience.
3. ofxGame
This addon contains useful classes for making 2d games in OpenFrameworks. The author provides a video demonstrating the addon:

Tecnópolis Pakapaka: the makingoff ofxGame from Patricio Gonzalez Vivo on Vimeo.

Making games (particuarly 2d games) is kind of my default so I imagine that as I’m learning OpenFrameworks I will want to make a game at some point. The author also suggests some Processing apps that are useful for making game objects so I think working with this addon will give me experience working between both Processing and OpenFrameworks.