Category Archives: Interaction design

Work in progress: Ambient audible energy data

The three instruments you hear here represent the electricity use of three items of office infrastructure – the kettle, a laser printer, and a gang socket for a row of desks – in the Helen Hamlyn Centre office over 12 hours from midnight on a Sunday to lunchtime on a Monday, in December, monitored using CurrentCost IAMs. The figures were scaled to provide ranges that sounded better, and converted into a MIDI file using John Walker’s csvmidi and then Aria Maestosa.

The ‘ticks’ indicate each hour’s passing. The ‘honk’ (Tenor Sax) is the kettle (up to 1.5kW when in use). The ‘whine’ (Synth Brass 1) is the Kyocera laser printer. The other synth (Polysynth) is the gang socket, which mainly had a couple of laptops (15W-50W) plugged into it when people were in the office, and a charger (1W) plugged into it otherwise . Lower pitch indicates greater electricity use, hence the high-pitched whine is the background power of the printer (about 10W on standby, rising to 300W-500W when in use).

As the audio starts, you can hear, over the background whine of the printer, the kettle come on as the security guard makes himself a middle-of-the-night cup of tea. Then, early in the morning, the kettle is used three times by the cleaners – twice in quick succession (reboiling?) and then once again. Suddenly, from 9.30, as office staff arrive, the kettle goes on again, laptops are plugged in, the printer starts printing and the energetic hubbub of office life becomes apparent.

Sound of the Office

Data sonification has been in the news a bit recently, from Domenico Vicinanza’s ‘Sound of Space Discovery’ to Opower’s ‘Chicago in the Wintertime’. It’s something that’s long intrigued me, but if I’m honest, has underwhelmed me in terms of either its actual utility or indeed its impact aesthetically. A (visual) graph is useful because I can use it to find something out. A table of numbers, likewise, even if patterns are less immediately evident. But a beautiful orchestral piece that just happens to draw on aggregated data which are a long way from anything I can comprehend, in scale or meaning, doesn’t tell me anything, somehow. Sarah Angliss was pretty much spot-on in this 2011 Mad Art Lab post.

Energy use is the focus of one of the main projects I’m working on, and one of the strongest findings that came out of interviews and co-creation work with householders that Flora Bowden and I did last summer and autumn was the notion that the invisibility of energy was a major component of householders’ lack of understanding, which contributed – by their own admission – to energy waste.

More than one person specifically suggested that being able to ‘listen’ to whether appliances were switched on or not, and, more interestingly, what state they were in (e.g. listening to a washing machine will give you a good idea as to where it is in its cycle), was potentially more useful for understanding how to reduce energy use than a flashy visual display or dashboard. Sound is potentially even more ‘glanceable’ than glanceables. Even hearing what you’d left on as you went out of the door would be useful. There are echoes of Mark Weiser’s Calm Technology including Natalie Jeremijenko’s Live Wire (Dangling String) but also the ‘useful side-effects’ of things like the ‘clacking’ sound of mechanical railway departure boards as an indicator that the display has updated, as Adrian McEwen and Hakim Cassimally point out in their excellent Designing the Internet of Things.

We also explored aspects of this idea further in our Seeing Things project with RCA students back in November, with contributors including Dave Cranmer and Dagny Rewera having an audio/visual sensory translation element to their work. Of the participants, Ted Hunt took an explicitly multi-sensory approach with his project, including audio, while Francesco Tacchini, with Julinka Ebhardt and Will Yates-Johnson, subsequently went on to create the incredible Space Replay where audio is both monitored and played back in public space.

I’m not saying the ‘Sound of the office’ audio above is particularly good. It was more of a let’s-play-around-with-some-data experiment, and I’ve since found that proper sonification platforms exist. But the approach is something I very much want to explore and build on – possibly whole-house energy use audio disaggregated by appliance, or by activity – and it raises so many interesting questions around what is most useful or most effective at actually either influencing energy use, or helping people understand the complex systems around them. Should it be aesthetically pleasing, or horrible enough it triggers you to turn things off? Is that just the kind of over-simplification that makes most energy monitor displays ineffective? Should the audio be real-time or provide a summary? Should it be paired with visuals? (e.g. like Alexander Chen’s beautiful MTA.ME or Listen to Bitcoin / Listen to Wikipedia) How much should it try to be ‘music’ versus, basically an ‘auditory affordance’ or alarm system? Should there be something about the quality of the sound that indicates something, e.g. load on the National Grid? (Thanks to Aideen McConville and Jack Kelly for this suggestion.)

The field is interesting partly because, post-PhD, I’ve come to realise that what I’m interested in is not so much the question of “how do we influence behaviour?” as an end in itself, but something more like “how do people understand complex systems of which their behaviour is a part, and how do we help them understand those systems better?”. There’s a substantial blog post coming on that, which hopefully draws together lots of interests and ideas, from the IoT to heuristics to seamfulness to affordances to mental models, and (I hope) will set out a kind of research programme which I might be able to get some funding for. But in the meantime, this is certainly part of the direction we’re going in with the ‘energy feedback’ part of the RCA’s work on the SusLab project. It’s going to be ambient, and it’s going to involve more than just numbers and graphs.

Direct link for MP3 file
Sound of the Office

Code as control

'You removed the card!'

In the earlier days of this blog, many of the posts were about code, in the Lawrence Lessig sense: the idea that the structure of software and the internet and the rules designed into these systems don’t just parallel the law (in a legal sense) in influencing and restricting public behaviour, but are qualitatively different, enabling distinct forms of affordance and constraint. Designers (and developers) — or in many cases those overseeing the process — in this sense potentially wield a lot of (political) power.
Continue reading

Report: Most people just trying to get by

Cubicles (image by Michael Lokner, used under CC licence)

Most people, for most of their day, are trying to get by. Every day is essentially a series of problems, some minor, some major, some requiring more thought than others. Some we care a lot about; some we wish we didn’t have to. Some are welcome; some we even bring on ourselves because we enjoy solving them; others are deeply unwelcome. Some we care about initially, but then find we no longer do; some we don’t care about to start with, but they become important to us over time.
Continue reading

CarbonCulture blog launch

CarbonCulture blog

It’s been quiet here, for reasons which will be explained later, but in the meantime I should mention that CarbonCulture (with whom I’ve been working for the past two years as part of the TSB-supported EMPOWER collaboration) has a new blog.

In anticipation of the forthcoming public launch of the CarbonCulture product, we’re introducing some background on behaviour change approaches, energy use and environmental impact. The first few posts (as of today) introduce:


Continue reading

If…

(introducing behavioural heuristics)

Some heuristics extracted by workshop participants

EDIT (April 2013): An article based on the ideas in this post has now been published in the International Journal of Design – which is open-access, so it’s free to read/share. The article refines some of the ideas in this post, using elements from CarbonCulture as examples, and linking it all to concepts from human factors, cybernetics and other fields.

There are lots of models of human behaviour, and as the design of systems becomes increasingly focused on people, modelling behaviour has become more important for designers. As Jon Froehlich, Leah Findlater and James Landay note, “even if it is not explicitly recognised, designers [necessarily] approach a problem with some model of human behaviour”, and, of course, “all models are wrong, but some are useful”. One of the points of the DwI toolkit (post-rationalised) was to try to give designers a few different models of human behaviour relevant to different situations, via pattern-like examples.

I’m not going to get into what models are ‘best’ / right / most predictive for designers’ use here. There are people doing that more clearly than I can; also, there’s more to say than I have time to do at present. What I am going to talk about is an approach which has emerged out of some of the ethnographic work I’ve been doing for the Empower project, working on CarbonCulture with More Associates, where asking users questions about how and why they behaved in certain ways with technology (in particular around energy-using systems) led to answers which were resolvable into something like rules: I’m talking about behavioural heuristics.
Continue reading

Architecture, urbanism, design and behaviour: a brief review

by Dan Lockton

Hollywood & Highland mall

Continuing the meta-auto-behaviour-change effort started here, I’m publishing a few extracts from my PhD thesis as I write it up (mostly from the literature review, and before any rigorous editing) as blog posts over the next few months. The idea of how architecture can be used to influence behaviour was central to this blog when it started, and so it’s pleasing to revisit it, even if makes me realise how little I still know.

“There is no doubt whatever about the influence of architecture and structure upon human character and action. We make our buildings and afterwards they make us. They regulate the course of our lives.”
Winston Churchill, addressing the English Architectural Association, 1924

In designing and constructing environments in which people live and work, architects and planners are necessarily involved in influencing human behaviour. While Sommer (1969, p.3) asserted that the architect “in his training and practice, learns to look at buildings without people in them,” it is clear that from, for example, Howard’s Garden Cities of To-morrow (1902), through Le Corbusier’s Ville Contemporaine and La Ville radieuse, to the Smithsons’ ‘Streets in the sky’, there has been a long-standing thread of recognition that the way people live their lives is directly linked to the designed environments in which they live. Whether the explicit intention to influence behaviour drives the design process—architectural determinism (Broady, 1966: see future blog post ‘POSIWID and determinism’)—or whether the behaviour consequences of design decisions are only revealed and considered as part of a post-occupancy evaluation (e.g. Zeisel, 2006) or by social scientists or psychologists studying the impact of a development, there are links between the design of the built environment and our behaviour, both individually and socially.
Continue reading