An introduction to Sounding out the System

In this blog post, I present a paper for the Research Infrastructures for Web Science (RI4WebSci) workshop with Alan Chamberlain. I will also add in some extra data that is not in the paper.

The paper discusses the use of an experimental Humanities (Chamberlain et al., 2017; Emsley et al. 2019) approach to a short experiment about using multiple devices to connect to a website. We ran a small experiment using three devices, two phones and a laptop, to connect to the PolemicTweet website using different connection types such as 4G and WiFi. There are various questions that one might want to ask from a network connection or the types of entity providing them, such as platform or service providers.

The data is processed using Python and Jupyter Notebooks to allow the intermediate files and processing to be clear. The data and code are put into a Github repository (RI4WebSci repo) to allow its re-use and inspection. This allows us to explore sonification as a potential scholarly machine (De Roure and Willcox, 2020).

The aim is to explore the use of sound, through sonification and composition, to represent the data. Here I want to discuss the sonifications that are not in the paper. The first file explores the sounds of the devices as they connect. The grand piano is the phone on 4g, the phone on WiFi is an organ and the laptop is a much quieter organ.

The second sonification explores a way of representing the companies that provide services, such as Google or Microsoft, and how they often that they appear. The work here is a simple set of rules that are applied to a map of the IP addresses.

These are simple sonifications designed to explore the data but are not in the paper.

Alan Chamberlain recomposed the MIDI files into a new composition, Unseen in Sound. One of the themes that I get from this is emergence of varying objects. I hope that others hear other things and engage with the work in their own way.

The more that I think about it, the more I am finding in this work.

Paper

Alan Chamberlain, Mads Bødker, Adrian Hazzard, David McGookin, David De Roure, Pip Willcox and Konstantinos Papangelis (2017) “Audio Technology and Mobile Human Computer Interaction: From Space and Place, to Social Media, Music, Composition and Creation”, In the International Journal of Mobile Human Computer Interaction (IJMHCI) Volume 9, Issue 4, October – December 2017 pp. 25 – 40. DOI https://doi.org/10.4018/ijmhci.2017100103

Iain Emsley and Alan Chamberlain 2021 Sounding out the system: multidisciplinary web science platforms for creative sonification. WebSci’21 Workshop on Research Infrastructure for Web Science (RI4WebSci), Virtual, 21 – 22 Jun 2021. Published in: ACM WebSci21 proceedings. ACM (Accepted) https://sro.sussex.ac.uk/id/eprint/99378/

Iain Emsley, David De Roure, Pip Willcox, Alan Chamberlain. 2019. Performing Shakespeare: From Symbolic Notation to Sonification, In Audio Mostly 2019 Proceedings (AM ’19), September 23–26, 2019, Nottingham UK. ACM, New York, NY, USA. DOI https://doi.org/10.1145/3356590.3356614 

David De Roure and Pip Willcox. 2020. Scholarly Social Machines: A Web Science Perspective on our Knowledge Infrastructure. In 12th ACM Conference on Web Science (WebSci '20). Association for Computing Machinery, New York, NY, USA, 250–256. DOI:https://doi.org/10.1145/3394231.3397915


A new project – Unheard City

A short post really but I am in the process of starting a new small project called the Unheard City. It is a side project, so I expect the pace to be slow, but it explores ideas that I have had in my head for a short while. What does the city sound like when […]


Installing and Using ProvConvert on OSX

I have just gone back to earlier work where I am using ProvConvert to visualise a PROV graph. I have had issues with installing and using it before so have been really wary of it. Until I came across Soiland Reye’s excellent blog post on the subject. As I am using openJDK through Homebrew on […]


Refreshing the blog

This is slightly more as an aide memoire than a post but Mark Carrigan has written a useful post on about academic blogging on the Post-Pandemic University blog, Academic blogging – both/and rather than either/or. The note towards discussing research that is already written or planned is the part that resonates. I suspect that, like […]


An Experimental Philosophy of Technology

Philosophy and Technology has an interesting article on the idea of Experimental Philosophy of Technology or Techxphi, by Steven R. Kraaijeveld. The argument seems to focus mainly on developing the ethical side. It seems like a way of testing various intuitions and assumptions and might be an area to keep an eye on to see […]


AudioVisual edition of Digital Humanities Quarterly

The preview version of the latest Digital Humanities Quarterly is out and is an AudioVisual Data in DH special edition.


Towards a playful approach

It has been a while since I posted and one hopes to get back to it in due course. I was leafing through some unread emails and came across the link to this reflection by Geoffrey Rockwell on Stéfan Sinclair, Celebrating Stéfan Sinclair: A Dialogue from 2007. The thing that really struck me was the […]


Media literacy as failure?

Will Partin has written a post on the QAnon media literacy, What if modern conspiracy theorists are altogether too media literate?. A long-ish read that is well worth it, it reminded me of Whitney Phillips’s talk at the Digital Methods Initiative Winter school in 2019 and her contentions about media literacy. It raises challenging questions […]


MediaStreams and Media Methods

I have been digging into Web Audio a little more deeply to scratch some itches and came across the Media Streams API. I have been thinking about how it can be used to get the browser to interact with streams and how JavaScript can be used to delve into them at a programmatic level. This […]


Re-purposing A-frame?

Currently having a nose around the a-frame design tool as a way of designing some scenes. I have a vague idea of what I want to see and hear but I am looking at what existing tools offer. Does reading the documentation become a way of testing the tool and becoming a way of thinking […]