Reflecting on interdiscplinarity in Eyetracking and Spanish Art

 

IMG_8859

During Museums and the Web 2013 I attended a session about Capturing Visitors’ Gazes: Three Eye Tracking Studies in Museums it was a great session which focused on the lessons learnt from three different eye-tracking studies conducted at the Indianapolis Museum of Art, The Deutsches Museum in Munich, and the Hatfield Marine Science Center in Newport, Oregon. I became fascinated by eyetracking and really wanted to have a go myself but at the time I was in the middle of my PhD and didn’t really have very much brain capacity left for anything else.  Fast forward a couple of years and I’m now working on a fascinating project looking at Eyetracking and Spanish Art.

We are at the early stages of a project that plays a part in Durham’s Centre for Art and Visual Cultures ongoing collaborative project Spanish Art in County Durham.  Turns out County Durham has a rather surprising collection of Spanish art including works by El Greco, Zurbarán, and Goya. Working alongside Andy Beresford and Dan Smith, we are exploring how Spanish Art, museum studies, experimental psychology and digital humanities can work together to ask new questions about how visitors respond to a collection of artworks.

We are interested in a range of questions around how people look at and experience art. The experience of art is a complex one, and undoubtedly is incredibly subjective.  It involves issues of perception, attention, memory, decision-making, affect, and emotion.  So we have a difficult task ahead of us trying to understand the aesthetic and cognitive appreciation of 17th Century Spanish artworks.  Where do people look? What are the areas of interest? The face, the hands, the background, the frame? How long to they look for? Do they like it?

We’ve just finished the data collection of a small pilot project in which we did some lab based tests using a fixed eye tracking system on a series of digital reproductions of artworks.  We will know more once we have fully analysed the data.  There is a lot of numbers and spreadsheets, and more enjoyable heatmaps to be looked at. Reflecting on the experience so far, it struck me how much of my personal thoughts about the process revolved not about the project and results, but the interdiscplinarity across disciplines.

What I have found so far is that my research ideas align much more strongly with experimental psychology than I realised. I always find it fascinating to see where else I could potentially sit in the academic spectrum.  Since I started my academic career I have been situated within four different departments at three different universities: Departments of Archaeology, History, Information Studies and now English Studies.  Perhaps a psychology department beckons in my future? Yet I keep doing the same thing, which I now label as digital humanities, but will perhaps be called something else in ten years’ time.

This project may well be about Eyetracking and Spanish Art but it is also about readjusting disciplinary boundaries and assumptions to accommodate new forms of research which have not been adequately recognised previously.  I have found ever since I was an undergraduate that what I want to study simply does not fit comfortably in pre-existing disciplinary structures, because those structures simply disregarded the kind of engagement with the digital and cultural heritage materials in which I was interested. Working on the Eyetracking and Spanish Art project which crosses a range of traditional disciplinary boundaries is promising and demonstrates the strength in the research that can be undertaken when applying techniques from very different disciplines to a humanities research problem, although concrete research outcomes with any impact are yet to be produced.  I look forward to exploring the data soon.

Of course, it is true that interdisciplinary scholarship exists in many areas of research, in the sciences, social sciences, arts and humanities. Why interdisciplinary research is particularly pertinent to me, though, is the fact that, to a certain extent, all digital humanities research is by definition operating on this scholarly divide between computational method and humanities investigation.  In order to do my research, like many digital humanists, there is a pragmatic need to assemble a team of people with wide range of skills to fully investigate a digital humanities research question.  Potentially that means I am a jack of all trades and a master of none.  But, I think it is important to think more about the nature of connections between disciplines, and what we can learn from each other.  I am incredibly lucky that I have the freedom to roam between disciplines and faculties at Durham to seek out interesting people and projects.  This project has not only taught me a lot about psychology, attention and visual cognition, but I have also learnt a lot about Spanish Art.  I am a massive museum nerd, and proud, but normally, I prefer to look at objects, sculpture and graphic prints rather than paintings but working on a project focused on 17th century paintings has really upped my appreciation of the artform. So not only am I exploring new research, I am learning to love paintings. winner.

 

Does Digital Humanities embrace difference? Different interpretations, perspectives & disciplines?

Following on from the Defining the Digital in Arts and Humanities research post, this post will discuss the first half day session at the Northern Bridge Summer School held at Newcastle University in The Great North Museum on the 4-5th June 2015. The session focused on Exploring the Digital in the Arts and Humanities.  The aim was to emphasise that Digital Humanities embraces difference whether that be different interpretations, perspectives or disciplines.

So is Digital Humanities perceived as a Big Tent? The “Big Tent” was the theme of DH 2011, and since then this issue of “Big Tent Digital Humanities” has stimulated numerous discussions about the inclusive and interdisciplinary nature of the discipline.  “Big Tent Digital Humanities”, deliberately opens and muddles the focus of the field and it has even been suggested that “Everything is Digital Humanities! Everyone is a digital humanist!” (Melissa Terras 2011). Well at least that’s what those that self-identify as Digital Humanist’s have a tendency to think.  But what about those who don’t identify as Digital Humanists? Like the Northern Bridge Students.  What do they think about digital scholarship and the impact it is having?

The doctoral student participants were invited to gather in specific disciplinary groups to consider the question of how digital impacts on their discipline and their personal research agendas.  The groups were tasked with thinking of 3 ways digital is shaping their discipline.  The discussion and feedback from the specific discipline groups highlighted an exciting range of perspectives. This really hit home the diversity in Arts and Humanities research.  It was fantastic to see the differences and the commonalities when it comes to thinking about digital.

Below are the 8 specific discipline groups main points about how digital is shaping their subject area:

Theology:

  • Access of information – easy access to sources from dispersed areas. Enabling research rather than shaping it.
  • Connecting the field – networking and collaboration.
  • The Limiting access of digital – there needs to be an awareness of the digital divide.

Languages

  • Range of digital resources, accessibility and novel ways of interrogating sources.
  • Information management, specifically reference management. With accompanying advantages and disadvantages.
  • Dissemination of research – sharing research widely.

Philosophy

  • Concern of publishing unfinished material, accuracy of digital sources and information, but the digital also gives access to unrefined materials.
  • Dissemination of research – increasing conversations and access to research.
  • Ask not what you can do for the internet, but what the internet can do for you.

Creative practitioners

  • Serendipity of the bookshelf – not easy to do digitally, but if you know what you are looking for digital tools can help accessibility and findability of real objects – finding things to use in research.
  • Digital as a medium in itself but does this impact on tangibility and aura? Is this lost in digital media?
  • Using a computer to understand the human element.

Linguists and literature

  • Digital tools can be useful, but it shouldn’t be leading us. Digital resources are often used naturally, perhaps researchers don’t consider it as DH.
  • Digital can increase ability to collaborate.
  • Anxiety – Should we always be using digital, even when it is not necessarily relevant to research?

English Literature

  • Greater scope for your research library – but you can only find what you know it is there. Serendipity of bookshelf is often lacking in digital resources.
  • Media savvy generation – should be using digital resources and tools.
  • Impact of research and employability. DH is a good way to highlight relevance of research.

Archaeology & Heritage

  • Archaeology has already been using technology for a long time.
  • Changing expectations of what we can achieve – speed of changing expectations – The digital is changing expectations of research and researchers at an alarming rate. You can invest a lot of time in learning how to use new technology, is it worth it?
  • Remodelling knowledge – interacting in a more organic way.

Archaeology

  • Visualisation of data – maps, GIS etc – archaeologists have always used digital tools to help visualise their data.
  • Transformative – access, publish, analysis, process, software, interdisciplinary.
  • Critical thinking – why are we using technology – how does it help? Should we be using it?

Despite taking a closer look at impact of digital on discipline specific areas when we brought the group back together there were some key commonalities and overlapping themes:

  • We need to ‘Engage the brain’ – why are we using digital technology, and is it really helping us?
  • There is a need for critical engagement and thinking when using digital tools.
  • Digital tools enable wider dissemination, increases accessibility and findability of research.
  • Offers exciting possibilities for interdisciplinary approaches.
  • The challenge of digital attribution is an issue.
  • Serendipity of the bookshelf – how can we retain/regain serendipity in the digital?
  • Diversity of perspectives.
  • Trepidation about the use of some digital resources.
  • Engaging globally, increased opportunities, to be part of a virtual community.
  • Thinking about the nature of engagement, and what that means and offers.

In many ways, Digital Humanities embracing difference or “Big Tent Digital Humanities” is a nice concept and it is a useful perspective to continually explore.  The DH community is now considerably more open, approachable, and willing to embrace new perspectives than many traditional areas of arts and humanities academia.  This inclusivity, however, is not clearly reflected in the main published research areas in the digital humanities field. As Pannapacker (2011) notes:

The digital humanities have some internal tensions, such as the occasional divide between builders and theorizers, and coders and non-coders. But the field, as a whole, seems to be developing an in-group, out-group dynamic that threatens to replicate the culture of Big Theory back in the 80s and 90s, which was alienating to so many people. It’s perceptible in the universe of Twitter: We read it, but we do not participate. It’s the cool-kids’ table.

So, the digital humanities seem more exclusive, more cliquish, than they did even one year ago (Pannapacker 2011).

So it was nice to see so many commonalities between the disciplines when thinking about how digital is shaping their subject.    This to me really highlights what DH is all about – a broad spectrum of multidisciplinary academic individuals and approaches, which come together with a shared interest in technology and humanities research.

The follow-up exercise involved taking the ideas and points raised in the first session into multidisciplinary groups to think about and compile a manifesto/charter for the Northern Bridge Training Partnership.  The challenge was to suggest ways that Northern Bridge and its strategic partners could best meet the needs and requirements of students to equip them for emerging digital scholarship and perhaps even develop a leading position in doctoral training in this area.  Shawn has written an excellent summary of this over at Digital Humanities @ the library.

A big thank you to all the conveners and to all the Northern Bridge participants for an energizing and thought provoking session and conference.

 

N.B Obviously this post is just reflecting on different disciplines and the ideas discussed during the Northern Bridge Summer School.  There are lots of brilliant discussions about gender, ethnicity, age, and sexuality and digital humanities – a few links:

Defining the Digital in Arts and Humanities Research

Digital Humanities? What on earth is it? Tools for research? cultural expectations? understanding pervasive technology in society? We asked the Northern Bridge doctoral candidates to define and discuss.

On the 4th -5th June 2015 I had the pleasure of taking part in the Annual Northern Bridge Training Programme Summer School held at Newcastle University in The Great North Museum .  The Northern Bridge is a doctoral training partnership between Newcastle UniversityDurham University and Queen’s University Belfast, funded by the Arts and Humanities Research Council (AHRC).

The 2015 Summer School theme focused on Digital Humanities and it produced a stimulating environment to discuss, share and learn about the impact of the digital on arts and humanities scholarship.   Digital Humanities is becoming an increasingly popular focus for academic research and discussion.  There are now hundreds of Digital Humanities centres and there has been an expansion in digital humanities taught courses, journals, and conferences.   But what is actually understood by the term ‘Digital Humanities’ is still up for debate.

Alongside the brilliant Shawn Day (lecturer at University College Cork, Queen’s University Belfast and Trinity College Dublin), Ian Johnson (Archivist at Newcastle University Special Collections) and Deirdre Wildy (Head of Special Collections & Archives at Queen’s University Belfast) we challenged the doctoral candidates to consider how emerging digital tools and methodologies impact on their own doctoral studies.

Before the Summer School started we circulated a short questionnaire to stimulate thoughts about digital scholarship. One of the most interesting questions enquired as to what the doctoral candiates understood by Digital Humanities.   As part of the form, we asked, ” What do you understand to mean by Digital Humanities in 140 characters?” – and received a surprisingly interesting set of answers. This list of definitions proved to be a very interesting starting point for exploring the Digital in the Arts and Humanities within the Northern Bridge Consortium.

In comparison to A Day in the Life of the Digital Humanities (Day of DH), which is a community documentation project that brings together digital humanists from around the world to document what they do and how they define Digital Humanities, none of the Northern Bridge consortium self-identified as digital humanities scholars.   So it was very interesting to see what ‘non DHers’ had to say about digital humanities.

Some examples from the twitters:









The definitions were tweeted using the hashtag #NBSS2015 and were processed through Textal to explore the relationships between words in the text via a snazzy word cloud interface. What came out most strongly to me was the emphasis on tools and dissemination.  Digital as an output rather than a process or an object of study in its own right.

Lots has already been written about how digital humanities might be defined (see the excellent Defining Digital Humanities edited by Melissa Terras, Julianne Nyhan and Edward Vanhoutte for a full volume on the subject) and the question of ‘What is digital humanities?’ continues to be a rich source of intellectual debate for scholars.  It was fascinating to hear what the next generation of PhD students felt to be important in defining DH.  It raises some interesting perspectives about how digital arts & humanities may be represented in the future.  It’s exciting to see how the established boundaries between, and relationships among, arts and humanities scholars are being re-imagined through the use of digital technology and the dynamic forms of engagement, discussion and collaboration it is enabling.

SMKE workshop: Social Media and the Museum

SMKElogo-370x100Yesterday as part of the Social Media Knowledge Exchange project, UCLDH hosted  a workshop on  Social Media and the Museum.It was targeted specifically at doctoral students and early career researchers.

The general workshop theme: how Social Media is changing museum practice and visitor experience; and how Social Media can be integrated into museum exhibitions and events.

Its not news to most of us that museums are embracing social media and use it as a means to communicate and promote their activities, and also to interact and engage with their visitors.  A large number of museums now have a profile on social media sites to post news, promote their exhibitions & events, or disseminate their content; and also to  to interact with visitors by starting conversations, debates and organise participatory projects.   This in itself is brilliant.  But what is less well understood from an academic and a museum professional perspective is the key questions and challenges that are arising out of the use of social media.

Some of the key (well most obvious at least) questions the workshop tried to address were:

  • how do we engage visitors and encourage users of the collections to build an online community?
  • how do we start conversations with visitors in such a way that they feel that it is appropriate for non-experts to contribute?
  • how do we create a feeling of ownership of museum collections amongst the visitors and users?
  • What does this type of social engagement mean for the museum experience?
  • How do we evaluate the impact of social media?

These questions came up throughout the day, and naturally more questions came out of that than answers.

There was a range of talks by academic and museum professionals to discuss how Social Media is changing museum practice and visitor experience:

Social Media in the Humanities: Claire Warwick (UCL)

Claire spoke using social media as a different way to engage people with historical content. The focus of Claire’s talk was around the D-Day as it happens initiative led by Channel 4. Utilising Twitter as a different way of presenting oral history.  Suggesting that social media offers a sense of engagement which is very different to reading from history books. Providing a sense of immediacy. The personification of history.  Claire highlighted how social media allows contemporary voices to be heard, but it can also bring historical figures and events to life. Throughout her talk interesting questions were raised about physicality, immersive theatre and emotional engagement with historical events and how social media can be involved in all three.  In essence are historical figures tweeting in the social media space in the same genre as live interpretation in the museum space?

There has been a lot of discussion about what museums can learn from immersive theatre lately.  See Seb Chan’s post on Fresh & New(er) of 23 May 2012. “What if we made ‘wonderment’ our Key Performance Indicator?” and Ed Rodley’s post, http://exhibitdev.wordpress.com/2013/01/14/on-immersion-theatre-and-museums/  and Suse Cairns Rethinking why immersive theatre is compelling. It might not be the immersion after all and I think this is something which will need to be explored further.


Tweeting Moles? Social Media from the Grant Museum: Mark Carnall (Grant Museum)

Mark Carnall, curator from the Grant Museum spoke about their strategic use of social media.  Mark explained that Social media in the museum is a continually changing landscape and questioned how do/should/could museums manage this evolution.

The Grant Museum uses social media in 4 key ways:

  1. Twitter- transitory, irreverent, topical
  2. Facebook – badges and postcards
  3. Blogs- long form, publication, cv
  4. Flickr, YouTube and others – hosting tool.

Mark really hit home the need to think strategically. Museums shouldn’t use social media for social medias sake. There is a need to make time to fit social media into working practice.

Mark also raised some social media issues for museums to think about:

  • Is there an institutional format you should adopt?
  • Institutional buy in and support
  • Get image crediting right.
  • What voice will you use?
  • Dealing with the digital divide. Who is your audience? Social media doesn’t reach everyone. – in reality the people who aren’t using social media are people the museum most wants to reach
  • Sustainability: Social media in museums need to be sustainable and you need to be prepared for infrequently of returns because they aren’t always apparent instantly.

Mark also shared this brilliant infographic from informationisbeautiful.net: Hierarchy of digital distractions.

1276_hierarchy_of_digital_distractions


Social media: worth the time for small museums?: Alex Smith (Islington Museum)

Alex Smith from Islington Museum gave a great example of how small museums can blog, tweet and use social media as a knowledge experience with limited time and budget highlighting the benefits as well as the reasons why small museums show become involved in social media activities.   Alex started by highlighting that the Islington Museum is constrained by council ICT strategy/guidelines and how council museums have to think outside the box to deal with this adequately.

Islington Museum use social media tools in the following ways:

  • Facebook
    • Events management system
    • Sharing Photos
    • Timeline – Ambitious use of Facebook timeline as a general historic timeline of objects and events relating to Islington Museum
    • Community engagement
    • Building brand identity
    • Twitter
      • Discus things that are happening now at the museum
      • Hashtags – the example of the Joe Orton Trial Reconstruction
      • Time management – hootsuite helps schedule and organise tweets
      • Conversations and praise –  Alex says the power of anecdotal evidence as well as statistics helps with convincing management.  Bite sized chunks from socmedia
      • Blogging
        • Example of the Sadlers Wells Theatre Archive blog
        • Found that visitors do interact
        • Important to get time management right
        • Historypin
          • New for the museum
          • Easy for people to use museum images
          • Builds a community of interest
          • Supports our current activities

Collecting Social Media as a museum object: Laura Lannin & Ellie Miles (Museum of London)

Ellie Miles and Larua Lannin from the Museum of London, gave a really interesting talk about the citizen curators project and what they have discovered about trying to collect social media as a museum object.  I attended an event at the Museum of London about collecting social media earlier in the year (My post on the Museum of London social media event: can a museum collect tweets & should it? ) so it was great to continue the conversation.

The Museum of London’s main aim is to be a contemporary collector of objects, events and ideas from and about the city of London, and because of this contemporary collecting policy they began to think about digital capture of events in London quite early on. They now have the experimental role of a digital curator which aims to develop fresh ways of collecting contemporary digital culture.

One of their projects is #citizencurators – a social networking project for London2012.  It’s a great  project and it has some really interesting research questions which you can see at http://t.co/g4NNg9zoMS

Production/consumption – museum social media in use: Daniel Pett (British Museum)

Daniel Pett (Portable Antiquities Scheme) gave a mesmerising talk about production and consumption of social media.  Dan’s key message was to ensure that any social media activity in museums needs to be relevant.  Important to have a social media museum strategy and to think about issues like:

  • Who is ultimately responsible for social media content
  • How do museums create interesting social media content? Who decides what is appropriate?
  • How seriously does the institution take social media channels – who are the advocates and for what?
  • Do you have institutional buy in?
  • Impact of social media in museums. can you measure interactions? Is the engagement meaningful? Are stats enough?
  • Multi-vocality. Everyone can have a voice. How do you deal with that?
  • Does anyone in your organisation already have useful social media skills, can you utilise them?
  • Adequate time management
  • Moderation
  • Who is the target audience?

Dan then went on to discuss consuming social media as code and gave some really useful ways that utilising the right code can make archiving and optimising social media a piece of cake.  Check out Dan’s google drive presentation for some great info on how to consume and produce social media using some simple coding.

The rest of the Social Media and the Museum session was a bit more hands on.  We went to see Jeremy Bentham and discussed Transcribe Bentham and the The Bentham Pop-up, which waspowered by QRator, and posed a set of Bentham-esq questions to visitors.  From there we went to have a look at my Digital Frontiers exhibition and asked question about the challenges and benefits of utilising all digital interpretation and social media inside a museum space.   Finally Mark Carnall led a great social media challenge and asked us to work in teams to come up with how we would respond to different social media comments from the public.  It really hit home some of the issues you have to think about when dealing with social media responses.

A really great day full of interesting discussions.

Creating a mini me: Playing with 3D printing

 
photo (13)

As part of the Digital Frontiers exhibition I have been experimenting a bit with 3D printing.  This is why working in a university is brilliant as there is so many clever people and bits of kit about who will let you have a bit of a play.

3D tech is becoming quite big in museum discussions right now, and many museums are looking to embed 3D features permanently into their museum services but there are a few challenges to do this. Check out Andrew Lewis’ from the V&A’s post about How ready is 3D for delivering museum services? And my post from bits to blogs about Crapjects.

Because 3D is emerging and is turning out to be a playfully disruptive technology I felt it was important to experiment with just what could be done relatively quickly with 3D tech for an exhibition.

A couple of months ago I had myself scanned quickly by Jan Boehm and John Hindmarch from UCL Engineering,  Virtual Environments, Imaging & Visualisation which was then printed out with Andy Hudson Smith’s (CASA) 3D printer and it produced this prototype:

3D Me!Last night Steve Gray and I had another play, this time creating an object model mesh with a Kinect.  We used a Kinect  and  the software ReconstructMe.

Microsoft’s Kinect is an awesome piece of tech.  Instead of game play you can use its Infrared sensors to do depth of field scanning!  We were trying to work out a re-usable workflow, so we could then scan everybody! We started with a desk drawer and moving the kinect around but that didn’t really cut it.  Eventually with a bit of tinkering we has success with an office swivel chair is to allow the object (aka me) to revolve slowly in front of the Kinect!

The scans produced are not faultless, but they are really very good for such simple and cheap kit.  We (I say we, but actually Steve) cleaned up the scan using free tools. Here is a scan of myself showing the problem areas. This is in MeshMixer:

3D me in MeshMixer

3D me in MeshMixer

The final result was using a mix of MeshMixer and MeshLabs and NetFabb Basic to fix gaps in the models.

3D Steve and Claire

And if you so wish, you can download and print either Steve or me, or both of us out! We added ourselves to thingyverse.  Now everyone can have a mini Claire!  since last night there’s already been 12 downloads of us! weird!

Blimey, Day of DH nearly passed me by!

It was the Day of DH yesterday, where Digital Humanists all over the world are telling people what they are up to on a specific day.  Its a great opportunity to see what the DH community are up to.  I have taken part every year since I joined UCLDH.  Here are my posts from 2010, 2011, and 2012

However this year has been a bit different.

This is reposting of the blog post I’ve put up on the Day of DH 2013 site:

It’s normally quite quiet at this time of year, the Easter holidays always arrives at just the right time, when everyone really needs a bit of a break.  So there hasn’t been as much email as normal.  which is good because I’m supposed to be focused on one very important document…

I have been working at home, away from the office and the distractions, on my PhD research. I’m in write up stage. Less than a year to go, and I’m piling on the pressure to get it done.   I’m trying to keep all distractions to a minimum, and the aim is to churn out at least 1000 words a day, every day, until I have a full first draft. But shutting myself in the study with only herbal tea to keep me company is actually quite difficult to do and challenges everything that is quite DHy about me.

My PhD in Digital Humanities has seemingly made me less Digital Humanities in real life.  I used to blog, tweet, email, collaborate and tinker regularly. Now I don’t really do anything except write, and procrastinate.

I managed 2189 words yesterday. But Day of DH passed me by, I only realised this morning that it was yesterday.  Does that mean DH isn’t on my radar any more? will I get it back when I eventually finish my PhD? I hope so.