The website for Ear Trading is http://eartrading.moon.net.au

If you are interested in beta testing the application, please send your iPhone UDID (Unique [...]]]> Hearing the Unseen has evolved into an iphone game and generative music machine called Ear Trading.  It is now ready for beta testing after which it will be released as on the iTunes store as a free application.

The website for Ear Trading is http://eartrading.moon.net.au

If you are interested in beta testing the application, please send your iPhone UDID (Unique Device Identifier) to eartrading@moon.net.au.

\

Barry Moon Arizona State University Brenda Moon The Australian National University

This project started as a exploration of data sonification techniques. The abstract published in the conference program is a testament to this. [...]]]> This is based on a Poster/Demo presented at the “Humanities + Digital Visual Interpretations Conference” hosted by HyperStudio – Digital Humanities at MIT 20-22 May 2010.

Barry Moon
Arizona State University
Brenda Moon
The Australian National University

This project started as a exploration of data sonification techniques. The abstract published in the conference program is a testament to this. As it progressed, the idea of using real-time data to create a game for mobile devices became more alluring. More specifically, a game where sound plays a major role in decision making, or even a game that produces interesting music with minimal interaction. For this application, the meanings of the data become far less important than its trends and time basis. We are using stock market data which wakes up and goes to sleep at fixed times of the day. Music, being predominantly time based, suits this kind of predictable framework upon which to drape its material. Although the creation of a game is the direction our sonification research has taken us, similar techniques could be applied to data to not only reveal details, but make the exploration of those details interesting and fun.

As you will see in the conference program, our early model was programmed in Processing and Max/MSP. While this gave us a great deal of flexibility over visualization and sonification, it would not be usable on mobile devices in the near future. For our game, the iPhone/iPad was chosen as the device, and Unity as the programming solution. Choosing to use the iPhone/iPad over Macintosh should generate a greater amount of feedback from users to aid in development and create a stronger sense of intimacy with the interface via touchscreen.

Most approaches to producing sound in interactive media follow precedents set in film. So far, in our work, we have combined two sonic elements traditionally used to enhance visual media: music and “off-screen” sound. Music reveals details in the data in two ways:

1, Amount of rhythmic activity relates to a share’s trading volume – the greater trading volume per sample (6 seconds), the greater the number of beats per measure

2, Pitch change across the duration of the “measure” relates to price changes of the share -downward pitch sequence for falling share price and upward pitch sequence for increasing share price.

Figure 1: Typical bar of music with moderate trading volume (9 beats) and share increase in share price.

When data is off-screen, it continues to be heard, spatialized according to its position in the corresponding visual space:

Figure 2 – Position of sounds relative to visual space

Figure 2a: Game View

Figure 2b: Top View

Our main concern in creating a musical sonification (as it is in most music creation) is the balancing of repetition with variation. We generate music statistically by choosing beats via weighted probabilities. This extends a drum machine programming analogy, which if simplified (to create really horrible techno for example), the kick drum is heard on the downbeats and snare drum on upbeats.

Figure 3: Beat Tables

Audio samples are triggered at the statistically chosen beats. Audio synthesis would allow greater sonic variety, but there are no methods presently available in Unity. Sixteen percussive samples of different loudness were created for each sound. There needed to be some balance between percussiveness (which aids in direction perception), and “pitchedness” (since we are using pitch as a perceptual referent for price change). Samples needed to be quite short (less than one second), again because of limitations in the Unity environment.

We ultimately wanted to call our game “Our Tax Dollars at Work”, but found some of the bailout recipients have extremely low trading volume. Instead we chose shares with large trading volume (which does include CitiGroup and Fannie Mae), and our working title is now “b-trade”.

Enhancements we would like make to our game before letting it loose on the public (as much as iPhone/iPad users represent “the public”) are enhanced visual interface, greater variety of sounds, the potential for users to design their own “beat tables”, and for the game to morph between multiple “beat tables” to create greater musical variety. We would also like the user to be able to choose which company’s shares they follow.

Max/MSP: http://www.cycling74.com
Processing: http://processing.org/
Unity: http://unity3d.com/

We are in the process building a system – using both established and novel open source intelligence methods – to gauge, assess and display changes in the online discussion of science and [...]]]> Will Grant and I have written an article on the Diffusion blog titled “An Atlas of Now” describing the project I’m working on at CPAS.

We are in the process building a system – using both established and novel open source intelligence methods – to gauge, assess and display changes in the online discussion of science and technology issues, controversies and dangerous alternate conceptions. Our goal is to develop a science communication ‘atlas of now’: revealing geographical and temporal changes in attitudes to science and technology issues throughout society.  
(An Atlas of Now)

We will be presenting a paper on this project at the Australian Science Communicators National Conference February 2010.

Last night we had home made sushi for dinner. It was good [...]]]>

Last night we had home made sushi for dinner. It was good

PROGRAM:

Processing is fun because the sketching approach means [...]]]> I’ve been trying out the  MSAFluid library by Memo Akten for Processing.  Starting from the example program that comes with the library, I’m making a wind tunnel.  I’ve seperated adding force to the fluid, adding particles and adding dye so that I can add each where I want to.

Processing is fun because the sketching approach means that you see the results at each step, and this often provides weird / interesting visual results.  These images show my wind tunnel with a ‘fan’ emitting dye and then a set of dye emitters half way down the tunnel.  The particles are distributed through the fluid to show the flow.

WindTunnel Frame 60

WindTunnel Frame 177

WindTunnel frame 456

WindTunnel frame 1069

Coffee Scolls: [...]]]> At CPAS we have an afternoon seminar on Thursdays and everyone brings some food or wine. I felt like making some bread, so I made enough for the seminar and to make a pizza for dinner tonight.

Coffee Scolls:

Cheese Scolls

The AlloSphere uses two 5 metre radius half spheres made from optically opaque and acoustically transparent perforated aluminium. They are housed in a three story anechoic chamber. The viewers stand on a bridge that positions their heads near [...]]]> TED Talk – JoAnn Kuchera-Morin: Tour the AlloSphere, a stunning new way to see scientific data

The AlloSphere uses two 5 metre radius half spheres made from optically opaque and acoustically transparent perforated aluminium. They are housed in a three story anechoic chamber. The viewers stand on a bridge that positions their heads near the centre of the sphere. The images are projected onto the inside of the hemispheres from a projector positioned in the seam between them.

The examples in the video seem to be fairly low resolution, at this stage there are only two projectors in operation (one for each hemisphere). They are installing multiple high resolution projectors around the seam between the two spheres to be able to do ‘eye limited’ resolution in 3D. The audio uses multiple speakers to achieve 3D audio.

More information is available on their website: The AlloSphere at the California NanoSystems Institute, UC Santa Barbara

Eric Rodenbeck (Stamen): Information Visualization is a Medium This post contains 2 recorded talks from Eric Rodenbeck, founder and creative director of Stamen Design, the visualization design lab known for projects like Trulia Hindsight, Digg Labs, SFMOMA ArtScope and [...]]]> There is an interesting article on the Information Aesthetics blog about two talks given by Eric Rodenbeck last year:

Eric Rodenbeck (Stamen): Information Visualization is a Medium
This post contains 2 recorded talks from Eric Rodenbeck, founder and creative director of Stamen Design, the visualization design lab known for projects like Trulia Hindsight, Digg Labs, SFMOMA ArtScope and Flickr Clock. – Information Aesthetics

The first talk argues that Information Visualization is more than a technology, it is becoming a medium with its own culture. As well as showing examples of visualisations made by Stamen, Eric uses a series of Venn diagrams to describe visualisation as working in the overlap between various elements, in particular between Analysis vs Spectacle.

“It is not enough to simply analyse and it is not enough to simply entertain, but as this thing moves out into the medium we can start to approach this way of looking at the world and thinking about the world that is beautiful as well as useful.” – Eric Rodenbeck.

Both talks are excellent!

Kiva’s mission is to connect people [...]]]> Dick was an enthusiastic supporter of Kiva and his loan project details can be viewed here.  A new Kiva team has been created – the Dick Adamson Memorial Fund.  Contributions to the Dick Adamson Memorial Fund team can be made by joining Kiva and then selecting the team when you make donations.

Kiva’s mission is to connect people through lending for the sake of alleviating poverty.

Kiva is the world’s first person-to-person micro-lending website, empowering individuals to lend directly to unique entrepreneurs in the developing world.

Kiva is a non-profit that allows you to lend as little as $25USD to a specific low-income entrepreneur in the developing world.

You choose who to lend to – whether a baker in Afghanistan, a goat herder in Uganda, a farmer in Peru, a restaurateur in Cambodia, or a tailor in Iraq – and as they repay their loan, you get your money back. It’s a powerful and sustainable way to empower someone right now to lift themselves out of poverty.