Introduction

The significance of humanities research to stakeholders outside the academy, variously referred to as ‘impact’ and ‘valorisation’, is of growing significance and importance throughout Europe. There is also increased expectation from humanities funders that projects articulate and demonstrate the impact of their research. Public engagement and knowledge exchange are considered to be core components of cultural, social and economic impact. Whilst the multiple European partners involved in HERA have differing national approaches to their definition, communication, capture and assessment, the HERA network is committed to maximising public engagement, knowledge exchange and the impact of research activity across Europe.

Humanities research plays a vital role in building relationships among a wide range of societal stakeholders, including academics, citizens, communities, civic organisations, industries, museums and memory sites, creative practitioners and policymakers. Projects funded under the HERA JRPs include a broad and impressive range of partners across the public, private, governmental and non-governmental sectors. These include policy makers, festivals and venues, military regiments, religious institutions, artist organisations and performing arts practitioners, heritage sites and historic buildings, museums and galleries, libraries and archives, media organisations, professional networking organisations, activist groups, academic bodies and societies, legal and financial institutions, businesses, professional societies, public sector institutions, voluntary and community groups, and charitable organisations. HERA does not seek to impose any one model of impact but embraces innovation, experimentation, sensitivity to the needs of project research and national contexts; there is no ‘one size fits all’ approach. HERA values diversity and acknowledges the importance of basic research whilst encouraging researchers to identify the relevance of their work within contemporary Europe and beyond.

Developing best practice in public engagement, knowledge exchange and impact has been a key feature of HERA from its beginning. This toolkit is intended to support HERA projects in navigating and developing effective public engagement, knowledge exchange and impact in complex transnational environments, as well as capturing their outcomes. Based on the challenges and opportunities experienced by the three previous HERA JRPs (2010-2019), and present developments in the European research landscape, the toolkit aims to provide practical, humanities researcher-centered guidance to project members.


About this toolkit

This toolkit was created by Prof. Jo Sofaer (University of Southampton), Prof. Tony Whyton (Birmingham City University), Dr Craig Hamilton (Birmingham City University) and Elysia Greenaway (University of Southampton). We welcome feedback in order to make it as useful to projects as possible.

  • You can use the menu bar on the left-hand side to navigate to different sections, and your browser toolbar to return to previous sections. The document also contains internal links, which provide shortcuts to other areas of the document.

  • The toolkit is intended as a ‘living’ document. It will be updated with new elements over time. This version was created on October 20th, 2020.

  • During the course of creating this toolkit, the research team have also created an interactive, online application that provides visibility on outputs, public engagement, knowledge exchange and impact for all HERA projects. This will be available soon.

  • Alongside the text contained within this report there are a number of Case Studies of HERA-funded projects, practical ‘How To’ sections, and some ‘Further Reading’ links. These are placed at relevant points throughout the toolkit and are intended as additional resources. They will appear as follows:

Case Study

A pink Case Study box provides information about a specific aspect of an existing or previous HERA-funded project that is intended as an example of best practice for a particular area of public engagement, knowledge exchange or impact.


How to…

The blue Toolkit boxes provide a brief overview of a specific element of the Tookit that may assist you in activities related to public engagement, knowledge exchange or impact.


Further reading..

The yellow Further Reading boxes provide links to additional materials, readings and resources that are relevant to a particular section. A full list of references is provided at the end of the toolkit.


Public Engagement


What is it?

Public engagement, also known as outreach, refers to the wide range of ways that researchers can share their work with the public outside the academy. It is a two-way process involving interaction, listening and developing understanding that aims to generate mutual benefit. This two-way dynamic distinguishes it from the one-way process of dissemination.


Why do it?

There is a wide variety of arguments for why scholars should engage with different audiences and, more specifically, for the particular role of the humanities in public life. If we do public engagement well, we are helping to improve research, making it more accessible and highlighting the importance of the humanities.

  • If we, as researchers, believe that what we do is important and valuable then we have a duty to communicate outside our own community.

  • The humanities are innately social and inclusive. They explore issues that matter to people and that speak to them on a human level. People are interested in the humanities because as members of humanity they directly benefit from our research - or at least they ought to!

  • The publicly funded nature of much humanities research (including HERA funding) means that the public have a stake in what we do. Engaging outside the academy is a matter of public accountability that forms part of our contract with society.

  • By contributing to the knowledge economy, public engagement with the humanities can stimulate debate on issues that are of critical importance to society. As the humanities promote the values of intellectual curiosity, innovation, critical thinking and tolerance, public engagement is therefore vital to democracy and well-being.

  • Many contemporary thinkers in the humanities claim that humanities have - or should have - a political impact on society (e.g. Marquard, Nussbaum, Rorty, Fish). The main goal of the humanities should be then a transformation of the social imaginary by making explicit the multitude of vocabularies used to describe human experience. This can only be done by engaging outside the academy.

  • The humanities distinctive focus on the past - and the many ways that they address fundamental challenges of human history, culture and identity - can inform present debates and transformations in Europe. The humanities offer insights into how pasts are actively and instrumentally used and re-used, (including their relation to issues such as solidarity, trust and imagined futures), which historically-informed discourses and actions in society are promoted, mobilised and legitimised, and which mechanisms lie behind the work of historical understanding. This knowledge enables us to see more clearly the complex ways in which our cultural diversity has been formed, and the dynamics by which it may be shaped and directed in the future. It explores and systematises exactly what it means to be a ‘reflective society’, enabling us to better understand processes of historical development, innovation, and social change that are fundamental to the human condition. The relevance and power of the humanities thus lie not only in what they can tell us about the past but in how they can help shape the present and the future. Public engagement enables us to fulfil this promise.

  • Effective public engagement makes a difference by changing the ways that people think and act. It thus forms part of a pathway to impact. This impact is qualitatively different from that of the sciences in that the possibilities for the humanities to shape the future need not always be immediately utilitarian, instrumental, or about the application of knowledge per se. Instead the humanities offer the possibility for a much deeper shaping: a shaping of thought, ideas and human actions.


How can we do it?

Effective public engagement makes a difference. It is by definition interactive. It is about finding ways to encourage active, enquiring ‘prosumers’ rather than simply delivering findings to passive ‘consumers’. It allows people to ask questions, create dialogue and get involved.

In designing a public engagement activity, it can be useful to consider the following:

1. What are people engaging with?

A good starting point is to return to basics and to ask:

  • What is interesting about my research?

  • Where can it make a difference?

  • What are the overarching aims of my activity? What do I want to stimulate through interacting with people outside the academy?

  • What do I want to get through the process of engagement? For example, is the public contributing to, or co-creating the research in some way, for example by adding to an archive of oral history?

2. Who are the audience?

Although we use the phrase ‘public engagement’, the word ‘public’ is rather imprecise. Just as people are all different, not all publics are the same. There is a wide variety of different interest groups, stakeholders and visitor types. Thus, although there is an implicit assumption that publicly funded research has universal public value in which all members of society have a shared interest, and many researchers desire to be inclusive in order to reach as wide an audience as possible, in practical terms it can be much more strategic and effective to segment potential audiences.

Segmentation is a well-established notion within marketing, the arts, culture, and heritage sectors. It is the process of dividing and organising the population into meaningful and manageable groups in order to tailor activities and communications to their preferences and interests. It can also be used as a tool to diversify and widen audiences by identifying under-represented groups. Defining your audience means that you can tailor communication to them rather than using a scatter-gun approach that hopes, or assumes, that people will be interested in your work.

There are many different ways of segmenting an audience. The Audience Agency works internationally and has some good advice on audience segmentation that is particularly relevant to projects that are partnering with arts and heritage organisations. It also offers sophisticated analysis tools that are aimed primarily at these sectors. These are likely to be more detailed than is required by most HERA projects but the principle of audience segmentation is worth considering. The Audience Agency suggests that the following variables may be useful in segmenting audiences:

Modified from The Audience Agency

Modified from The Audience Agency

Instead of aiming activities at ‘the general public’, consider whether your audience might be, for example, families, school children or young adults. Is it local residents of a particular area? Professionals in a particular sector? You might also consider targeting audiences that are socially marginalised or frequently excluded from academic contexts in order to widen participation.

It can be useful to have a scoping stage where you have some preliminary conversations with your target group(s) in order to understand your audience. This might include verifying why your topic is of interest to them and / or discussing what might be the best methods of engagement to get them interested in your research. Knowing your audience means that you can plan around them in order to best achieve your aims. This, in turn, means that your public engagement is likely to be much more successful and impactful.

You can refine or expand beyond your original proposal to HERA as long as this is justified in your annual report.

3. What Method of Engagement Is Most Suitable?

Choosing a method of engagement is a matter of selecting the most appropriate tool depending on the audience and purpose of engagement. Staff time, cost, duration and scale of engagement (how many people and geographical scale) are also important factors in selection. The Engage2020 project and National Co-ordinating Centre for Public Engagement have useful resources that help researchers select an appropriate method based on purpose and audience.

The range of public engagement activities used by previous HERA projects includes: participatory art, art installations, exhibitions, films, concerts, festivals, pop-up stands at various events, fashion shows, community projects, co-created research, life-long learning activities, education packs for schools, interactive websites, bespoke apps, social media (Twitter, Facebook, Instagram, blogs etc), podcasts, public talks, posters, newspaper and magazine articles, press releases, TV and radio programmes and other kinds of media appearances.

Many of the most successful projects have used these in combination, drawing on a spectrum of activities that vary in the intensity of their interactivity. Successful projects also frequently involve partnership working and have drawn on the expertise of non-academic partners in order to inspire, generate and tailor content, provide essential technical or linguistic insights, offer exciting venues, and reach target audiences.

For example, several HERA projects have museum, library or archive partners. Staff in such institutions are often strongly embedded in their community, have an excellent understanding of potential audiences and possess an established network and infrastructure for reaching out beyond the academy. Many also have specialist pedagogues or outreach officers who are experienced in working with children and community groups. They are experts in working outside the academy who and can help you to design and implement effective activities, and often welcome new content to add to existing programmes. Developing full and rounded partnerships that link research, collections and public engagement can be extremely successful and satisfying.

The transnational nature of HERA projects offers a unique range of options – and distinct challenges – in terms of the scale of public engagement, from the very local to the pan-European. At the small scale, projects have engaged with local communities, for instance to explore locally relevant issues such as the ways that people feel about place and identity. At the national scale they have sought to engage policy makers or governments to highlight awareness and create dialogue and change in health or environmental policy. Despite the advantages of transnational research, with some notable exceptions it has, however, often proved more challenging for HERA projects to develop effective public engagement on a large, multi-country, European or global scale. While there may sometimes be barriers in terms of cultural context, where appropriate, HERA welcomes attempts to develop forms of public engagement that capitalise on the benefits of transnational team working and that embrace audiences beyond national boundaries. The digital humanities and social media platforms have a particular role to play in this regard.

The multi-lingual nature of HERA projects means that language often presents a particular challenge for HERA projects. The translation of words and concepts into local languages can sometimes be difficult. Some projects have addressed this issue as a group and have developed their own dictionary or thesaurus for research and public engagement purposes. Others have taken the decision to create forms of public engagement that sidestep language as much as possible by relying on music or visual media. The appropriate use of language in relation to the target audience also needs to be carefully considered in order to ensure clear, jargon-free communication.

HERA is keen to encourage creativity, innovation, imagination and ambition in public engagement. Some of the most successful public engagement activities carried out by HERA projects have been experimental in nature. It may be useful to try out activities on a small scale to assess audience reaction and refine before scaling up to a larger (and more expensive) ‘big splash’ activity.

Radio.Garden: A Case Study in Transnational Public Engagement

Radio.garden is an output of the HERA project Transnational Radio Encounters: Mediations of Nationality, Identity and Community through Radio (TRE). The project took place from 2013-2016 as part of the HERA Cultural Encounters strand. It examined how radio as a medium fosters transnational encounters, and how it is shaped in and by transnational arenas.

Radio.garden is an online platform that allows users to explore an interactive globe filled with radio. It allows listeners to explore processes of broadcasting and to hear identities across the entire globe. It connects distant cultures, reconnects people with ‘home’ from thousands of miles away, and includes community radio stations which traditionally enrich the places in which people live.

Prof Alec Badenoch, PI University of Utrecht, Netherlands and Endowed Professor of Transnational Media (Netherlands Institute for Sound and Vision) with award Winner, 2017 Best Use of Archive FIAT/IFTA Archive Achievement Awards

Prof Alec Badenoch, PI University of Utrecht, Netherlands and Endowed Professor of Transnational Media (Netherlands Institute for Sound and Vision) with award Winner, 2017 Best Use of Archive FIAT/IFTA Archive Achievement Awards

As a project engaged with research on radio, TRE clearly identified their audience as the global radio listener community. The aim of the activity was to engage the public with the connective potential of radio by creating the conditions for people to have their own transnational radio encounters. The project partner Netherlands Institute for Sound and Vision commissioned professional design companies Studio Puckey and Moniker in Amsterdam to develop the platform. Having tested the platform and given it a soft launch, the project was confident in the technical and public engagement potential of the activity. They were then able to further build public engagement through a series of media appearances, including via national radio (BBC Radio 4). Importantly, these media appearances catalysed public engagement with the platform rather than standing as forms of public engagement on their own and allowed radio.garden to further grow its audience. Social media also played an important role in letting people know about radio.garden and in gaining feedback from users through analysis of tweets. The latter now offer further exciting opportunities for researchers to understand the roles of radio through the new digital archive created by the activity.

Since its launch in 2016 radio.garden has had over 900 million page views. In the first six months alone, it had 100 million visitors. It is one of the most successful humanities public engagement activities ever carried out. Since the TRE project ended, the platform developer Jonathan Puckey has continued to run radio.garden, adding over 15,000 new stations to the ‘Live’ layer and adding a ‘favourites’ function to the platform. He has also made some changes to respond to the lower take up of the specialist archive layers and to increase capacity to accommodate the growing number of new stations. He has also created a phone app. The removal of the non-live layers highlights the need for projects to consider IP issues when working with external partners.

Dr Caroline Mitchell, Associate Professor in Radio and Participation, University of Sunderland UK describes how radio.garden came about and reaction to it:

In February 2016 we were entering the last stages of the project. Like most academics, members of our HERA project (Prof. Golo Föllmer Martin Luther University in Halle, Germany; myself from University of Sunderland and Professor Peter Lewis from London Metropolitan University, UK; Assistant Prof. Dr. Jacob Kreutzfeldt at University of Copenhagen and Associate Prof. Per Jauert Aarhus University in Denmark and Professor Dr. Sonja de Leeuw and Prof. Dr. Alec Badenoch from University of Utrecht in the Netherlands) all knew the value of telling the story of our research beyond refereed articles and published reports and books. Our varied interests in the radio medium meant that from an early stage we were excited about what our ‘exhibition’ would look, and importantly sound, like.
Peter Lewis and I had been conducting workshops in Britain, Canada, France and Spain, gathering stories of transnational radio participation by community radio broadcasters in collaboration with a wide range of social, ethnic and special interest groups, listening to what ‘transnational community radio’ sounds like and looking at the conditions that support transnational radio production, broadcasts and archives. People’s links with homeland and diaspora transcend the boundaries of national identity. In ethnic minority radio stations there were programmes made by and for long-standing minority ethnic groups, and increasingly it has become the role of community radio to give voice to more recently arrived communities. We had mused over how to display these connections, their histories and the huge range of community stations that existed worldwide. One of our community researchers had constructed a ‘listening table’ where people could hear interviews about radio’s transnational connections and this included lit up pathways connecting countries and stations. Peter and I had used geo-located digital mapping in previous projects (see for instance http://www.comapp-online.de and https://connected-communities.org/index.php/project_resources/map-your-bristol/).

School students explore radio garden as part of BBC Young Reporters and STEM Ambassador workshop, BBC Bristol 2018 (Photo Marvin McKenzie)

School students explore radio garden as part of BBC Young Reporters and STEM Ambassador workshop, BBC Bristol 2018 (Photo Marvin McKenzie)

Together with our colleagues and our partner, the Netherland’s National Sound and Vision Institute in Hilversum, the project commissioned an online interactive platform from Amsterdam based designers Studio Moniker that would highlight key aspects of transnational radio experiences. Jonathan Puckey carried out the project with Studio Puckey, creating an innovative listening platform: a beautifully designed interactive globe without national borders that draws in listeners to surf the global airwaves.
After pre-testing and a ‘soft’ launch at the project’s final conference in Utrecht Radio.Garden went live on 13 December 2016.
The Live section allows you to explore a world of radio as it is happening right now. Tune into any place on the globe to explore over 15,000 stations (stations are still added every week) broadcasting live to your desktop or mobile phone. What sounds familiar? What sounds foreign? Where would you like to travel and what sounds like ‘home’? Jingles offered a world-wide crash course in station identification. How do stations signal within a fraction of a second what kind of programmes you are likely to hear? History offered clips from radio history, while in the Stories section listeners told how they used radio to make themselves at home in the world and described their radio journeys as they crossed borders and countries.
Following its formal launch, the site received approximately half a million visitors in its first day and by the end of January over 18 million visitors. To date it has had more than 900 million page views. It has won major awards, including a ‘Webby’ for designer and site developer Jonathan Puckey and has been picked up by newspapers, journalists, news websites, social media platforms and broadcasters all over the world. The site developer has taken on extra staff to keep up with adding stations.
Since the launch I’ve been monitoring the thousands of tweets at #radio.garden that still come in on a daily, sometimes hourly, basis from every continent of the world. This is where it gets exciting in terms of the impact of the research. The tweets have been entirely and overwhelmingly enthusiastic; in many ways defining the impact of the research. They herald Radio Garden as new way of listening to radio, exploring music, languages and radio programmes.

“Radio meets Google Earth”; “I swear this is the most entertaining thing I’ve ever come across”;

“This is an amazing site that will change the way you listen to the world!”

“My first reaction to radio.garden was excitement ‐ it is so accessible ‐ radio at my fingertips”

The coolest link ever, radio from all over the world …Fantastic to use with our children from all over the world! Have a look together with your class! #ell #esl #eal #ellchat #langchat #exploreinyourclassroom

The best website ever to practise your language! Also, you can listen to the world radio at the same time. Follow the green dot to identify your selected location and tune in. You can learn a lot from listening to the radio…

Meet John, my 85 yrs young neighbour who has @ParkinsonsUK. He can now use http://radio.garden on his #iPad to find #radio stations in #Greece to listen to in his home language. #digitalskills helps John with developing his #motorskills @getonlineweek #inspiration #try1thing

In the two years since Radio Garden’s launch, Peter Lewis and I have carried out small scale impact workshops with a range of people and organisations to introduce them to the platform. This has included working with senior citizens in community settings, BME and refugee organisations and youth projects. In one workshop with school children in conjunction with the BBC we witnessed the expression on the face of one teenage ‘radio gardener’: we saw the thrill and wonder of being able to connect to her family’s homeland via a station from her grandmother’s home town in Cyprus where she heard her family’s language and music. In another encounter there were tears as an older women found the station in Italy that her son, who emigrated there, listens to – she said “we can listen at the same time!” This same person declared that she would set up ‘radio garden parties’ with her friends and neighbours so they could all make similar connections with family and friends through their beloved radios. These workshops have been largely unfunded although we hope this will change soon…
It is clear that as well as the viral spread of Radio Garden through social media, word of mouth within interest groups and family and friendship networks has also been powerful. With a touch of the screen Radio Garden offers an escape from the bubble of ‘likes’ to new musical and linguistic encounters, geographical difference and distance, perhaps even an escape from the bubble of nationality. Might this audio globe be as influential as the ‘Earthrise’ photograph taken from Apollo 8 in 1968?

For open access to the TRE project publication ‘Transnationalizing Radio Research click here

4. How can I let people know about my activity?

There is little point in organising a public engagement event if no one shows up! Likewise, many websites or social media initiatives flounder because nobody knows about them or wants to contribute. Projects often put a great deal of time and effort into organising public engagement activities but they don’t have the impact that they deserve because they don’t let people know about them. It’s very easy for your activity to get lost in the white noise of constant communication that people live in today.

In order for projects and audiences to derive maximum benefit from public engagement it may be useful to consider the following:

  • Identifying your target audience is vital to making sure that you are communicating effectively about your plans.

  • Leverage local partners and resources. They will know how best to reach your intended audience and can be very helpful in providing effective channels to do so.

  • Use a range of media and build between activities to advertise your activity. For example, a press release or media appearance can be used to promote public engagement, as the Transnational Radio Encounters project did for their Radio Garden app in the case study above. See also: Hints & Tips on Writing a Press Release

  • If you are planning to use media appearances as a way of engaging the public then training in how best to get your message across and appear on camera can be very useful. This can often be organised through your institution.

  • Participate in large-scale events such as festivals where there is a guaranteed audience who may be interested in your work. This has the benefit of piggy-backing on established organisation and marketing, thereby lowering burden on project staff.

  • Invest in good graphics and professional design. Not only do they make a project look smart but they help to attract people.

  • Digital platforms and social media are very cost effective ways of reaching audiences and involving people beyond the local in order to both publicise and scale-up an activity. The ELMCIP project used social media to generate momentum for the creation of digital literature archives through contributions from user communities beyond the academy. The collection of digital literature was vital to the research and developed a critical mass such that the archive is now well known and continues to be sustained after the project end. Other HERA projects have put images or tours or their physical exhibitions on-line or have held exhibitions entirely online.

  • HERA is always happy to post activities on its website and to use its social media channels to help advertise project events. The HERA twitter handle is @HERA_Research and the hashtag is: #humanitiesmatter


5. Evaluation

Evaluation of your activity is vital to understanding what difference public engagement has made and thus what effects (impact) you have had on your audience. Evaluation is not a description of your event but is an evidence-based analysis of its consequences (positive and negative). It involves a process of data collection and reflection that helps you to learn from your experience, and to assess its benefit and impact. Demonstrating the effects of your activities is important in terms of public accountability for funding and evidencing the value for money of humanities research. You will be expected to demonstrate the impact of your activities in project reports to HERA.

There are many qualitative and quantitative methods available for the collection of evaluation data and a range of resources available to help with this. In evaluating your activity, you will need to consider reach (how many people participated; geographical scope in terms of locations from where you drew in participation) and depth (the extent to which your activity created impact). The nature of your activity, what you wish to find out about it, time available for the collection of data, expertise available for its analysis and ethical issues will also affect your choice. Some HERA projects have used short on-the-spot questionnaires to obtain audience feedback at an event. This can be done on paper or using free off-the-shelf smartphone or tablet apps. The latter are user-friendly and have the advantage of speeding up analysis as data do not need to be entered manually and such apps often have inbuilt analytics software. Interviews and various forms of social media analysis can also be useful. Quotes from participants can be particularly helpful in evidencing impact and reflecting upon your activity. Other potential forms of data collection techniques include focus groups, postcards, games or video diaries.

Evaluation questions are effectively research questions and should link to what you want to find out about your activity. For example, you might want to find out:

  • What have participants learnt or understood?

  • Have their attitudes changed as a result of the engagement? If so, how?

  • Would they like to find out more as a result of having participated in the activity?

  • Do they have feedback or knowledge that could contribute to your future research?

It can be a good idea to take photos of your activity that build into a project archive. Not only are photos good for spreading the word about your project on social media, but they can also be included in reports to HERA as evidence of your activity. See: Hints & Tips on Collecting Tweets and Hints & Tips on Analysing Tweets.

Many institutions now require that all research with human participants pass through ethics review. This includes public engagement evaluation activities. European GDPR legislation also places an onus on researchers to be clear and transparent regarding the retention and collection of personal data and to seek consent. Publication of images may also require consent from people in them. It is advisable to seek advice from your institution in order to ensure compliance with relevant ethical and legal frameworks. You may wish to consider having project guidelines that all members can follow.


Common Concerns and Pitfalls

Concern: Public engagement can be time consuming and takes time away from the core business of research.

There is no doubt that high quality public engagement takes time to think through and to set up. The imperative to reach out beyond the academy is, however, strong. The benefits for projects, funders and society are substantial. It can also be very enjoyable. Many projects have integrated public engagement into their work as part of the research strategy, enabling them to collect forms of data that they would otherwise be unable to access. Partnership working can be beneficial in leveraging expertise or existing frameworks in order to enhance effectiveness. Be strategic. There is no need to reinvent the wheel! Doing public engagement badly is a waste of time and money and can incur reputational damage, so there is no point in tokenism.

Concern: Humanities researchers often deal with sensitive or controversial topics. I am worried that the media will misinterpret or sensationalise my research.

Dealing with the media is not necessarily easy but it does create important opportunities for communicating with otherwise hard to reach audiences. To be successful you need to have a good understanding of how media works, the needs of the particular medium, what you want to say and how best to get your story across. Do your research about the kind of outlet and who you are talking to. You are likely to be edited. If timelines allow, ask to check any copy or film before it goes out. If doing live broadcast then try to find out questions in advance. Professional media training can be very useful.

Concern: My research is too complex and important to ‘dumb down’ for public consumption. Public engagement is simply populism and I don’t want to be part of that.

Good public engagement is about communicating your research in ways that your audience can understand and respond to. You are not being asked to compromise your ideas or intellectual freedom. Academic elitism runs the risk of making the humanities appear out of touch and irrelevant.

Pitfall: A common misconception is that public engagement is just about education and that a few public lectures will do the job. Public lectures can be appropriate in some contexts but the best public engagement creates a dialogue outside traditional academic settings. Education has a part to play – HERA projects have made packs for schools, held arts based education interventions, engaged with adult learners, and developed programmes for continuing professional development – but public engagement is more than education alone. If education is part of your public engagement strategy then try to be imaginative and creative.

Pitfall: Public engagement is researcher-led but senior researchers are often very busy juggling a variety of commitments. It is tempting to devolve public engagement activities to post-docs or PhD students. Early career researchers can have a lot of energy and enthusiasm, and are thus excellent at engaging with the public. However, leaving all engagement to them can be a burden on relatively inexperienced researchers and they may need training, especially if dealing with sensitive topics. Similarly, younger team members can often be more familiar with social media than their older colleagues and there can be a tendency to make this part of their role. This is not necessarily problematic but dealing with social media and website maintenance can be a big job. Consider how your team works – the strengths, weakness and commitments of individual team members – and how you want to organise public engagement within your project. Is it shared between everyone or do staff have particular roles? It can be useful to designate public engagement as an agenda item in project meetings so that everyone is in the loop and you can be respond if staff change or new opportunities arise. Good public engagement is also a matter of good project management.

Pitfall: Many projects develop successful public engagement on a small scale in one local or national context but don’t follow it up or scale it up elsewhere. They are therefore unable to capitalise on their initial investment of time and resources and lose out on potential impact. It can be helpful to think about public engagement as an iterative process, rather than a series of one-hit wonders! Every project is different but consider whether you are likely to obtain more impact and use resources more wisely through a smaller number of scaled up activities rather than several individual smaller ones.

The HERA Knowledge Exchange and Impact Fellows are there to help support projects and talk through any specific concerns that you may have. They are both former HERA project leaders and so understand many of the issues faced by complex transnational research endeavours.


FAQs

Q: Can I add an associated partner to my project who was not in the original application?

A: Yes, you can add associated partners as long as there is no alteration to the financial arrangements. If you wish to alter any budget lines then you must contact HERA. Projects often grow partners as they develop, create contacts and identify project needs. Please contact the HERA Handling Agency to progress the addition of a new partner.

Q: An exciting new opportunity for public engagement has come up but it was not in my application. Should I go ahead?

A: If there is project benefit and you can afford it, go ahead! Unexpected opportunities often arise during the research process. HERA encourages projects to take advantage of this and to be flexible and agile in responding to new opportunities.

Q: My public engagement activity isn’t working as well as I hoped but I said that I would do it in my application. Should I persist?

A: Public engagement activities can bring surprises. If something is not working then you can either modify it and give it another go, or put it to one side. There is no point in persisting with a useless activity. You can indicate in your reporting to HERA that you are replacing activities on the basis that they are more effective than those originally indicated. Reflection and honesty are important.

Q: Is there any additional support for public engagement activities that I did not include in my original HERA application?

A: HERA recognises that activities can bring unexpected success or that new and unexpected opportunities can arise for public engagement. Small top-up awards have been made available for previous HERA JRPs on a competitive basis. It is likely that something similar will be available for Public Spaces projects but this is at the discretion of the HERA Board.

Q: I intend to write a number of books and articles during my project. Can I count these as public engagement?

A: No, this is dissemination not public engagement. If, however, you were to organise an event where you discuss the content of your book with an audience and invite people to engage in dialogue around it then this would be public engagement.


Useful Resources

General Advice

Why Engage With the Public

Audience Segmentation


Writing a Press Release (hints & tips)

Alongside using Social and online media channels to engage with different audience segments there are also opportunities to reach audiences through ‘traditional’ media channels, and in particular through press coverage.

Media outlets – such as newspapers, radio and TV shows – offer a way of reaching audiences that may be interested in your research and who may engage with it given the opportunity. Although media practices have altered considerably in recent years as publics move towards consumption through internet and mobile devices, a well-constructed and targeted press release remains an effective means by which those audiences can be reached.

If you are considering using a press release in order to reach audiences there are two important things to consider, which this section will deal with in turn.

  • Constructing a useful, ‘newsworthy’ press release

  • Disseminating that release to key media outlets

1) Writing a press release

A press release is usually a one or two page document that succinctly tells a story. It is intended to provide a media outlet with everything it needs to construct a news story or feature that will, in turn, draw audiences’ attention to your project or event.

Whether a media outlet is large or small, specialised or general, it is likely that they will receive many more press releases than they can use, or will even consider. Constructing a useful press release will increase the chances of it being used.

Consider a news angle or hook.

What is it about your story that people might find interesting? Does it involve something new, or extraordinary? Who will care?

An example: Your press release may concern a research event that is taking place at a museum. This is unlikely to be newsworthy in and of itself. However, the museum may have recently taken possession of a new collection, or have re-opened following a refurbishment, or else appointed a high-profile person as board member. Any of those could be used as the ‘hook’ around which the release is based, and the event could be mentioned alongside the ‘bigger’ story.

Choose an eye-catching headline

The headline for your release should attempt to convey the interesting ‘hook’ of your entire release.

“Academic publishes new book” – momentous as that may be - will not make a media outlet sit up and take notice. It would be far better instead to attempt to construct a headline based on one of the books’ main arguments. A headline such as “Art Galleries are the new Twitter” – an imaginary example - may seem to trivialise or devalue a serious academic work that explored social cohesion in publicly-funded cultural spaces, but it is more likely to bring that work to the attention of relevant audiences

The first paragraph is crucial

It is important to be concise in your release, and nowhere is this more important than in the first paragraph, which needs to convey both the ‘hook’ of the story and the main points of the rest of the release. In working on this paragraph ensure your hit the ‘5Ws’:

  • Who: the person, people or institution involved

  • What: the ‘hook’ or other newsworthy angle of the story

  • Where: where this interesting event took place

  • When: ..and when it happened

  • Why: what is so special about the ‘hook’ or ‘angle’

An example here from a press release constructed by the Songwriting Studies Research Network, a research project operating from Birmingham City University in the UK, illustrates the ‘5W’ rule:

Legendary musician and producer Nile Rodgers surprised a room full of songwriters, music industry workers, and academics on 8th August, emerging as the unannounced keynote speaker for the Songwriting Studies Research Network event held at The Ivors Academy in London, UK.

Here the focus of the story is Nile Rodgers (Who), delivering a keynote speech (What) in what was a surprise appearance at an academic conference (Why) in London (Where) on 8th August (When).

Include a quote

A press release should always include a quote from a person or persons involved. This allows the media outlet concerned to publish a press release – often almost verbatim – without having to take the time to chase down supporting quotes.

The quote you include should first refer to the news angle or hook the press release is based upon, but should then introduce the other element of the release – i.e. the one you hope will reach audiences.

In the example of the imaginary research event at the museum from above, a very simple quote may look something along the lines of this:

“The new collection of 15th Century ceramics is a fantastic addition to the museum’s offer”, said [project lead from University], “and fits perfectly with the theme of our event”

This quote keeps the focus of the story on the new collection, but introduces the research project within that context, allowing you to then expand on the research in later paragraphs, before bringing the release to a close with a reminder of the significance of the main hook of the release.

Other elements

  • At the end of the release remember to include a contact name, number and email address, should any media outlets wish to follow up.

  • Ensure you have print and web-ready images available online and include a link.

  • Try to keep the release to one-page if possible, and without fail fewer than three pages.

  • Try to format your release for email (HTML) as well as creating PDF/Word versions.

2) Finding the right media outlets

Depending on the nature of your ‘story’ there will be some media outlets that are more likely to use it that others, and so identifying those outlets more likely to use it will be crucial to its potential success. Since the majority of unsolicited press releases are ignored, being strategic will also save you a lot of time! A story with a very localised focus is unlikely to be of interest to a national publication, for instance.

Large media organisations - such as national broadcasts - offer the potential to reach very large, general audiences. Smaller, more specialised outlets (perhaps a magazine, or a podcast) will mean your potential audience reach is smaller, but increases the likelihood of relevance to ‘your’ audience. The likelihood of your press release or news story achieving coverage decreases as the size of the media outlet concerned increases.

  • Canvass your immediate research network to see if they have any likely or useful contacts at media organisations. Begin adding those contacts to a database.

  • Look at your own social media networks – either the networks of researchers, or those of the project itself – and try to see if there are any potential media organisations or contacts within those. An informal approach to a journalist in your network who may be receptive to your work can produce useful results.

  • If possible, try to cultivate new relationships with media contacts that may be receptive; if a journalist is specialising in an area of work that is linked to your research it is likely they would – at the very least – being made aware of your work.

  • Speak to project partners and explore their internal systems and media networks. It is likely, for instance, that organisations such as museums, art galleries, or other cultural organisations will have their own in-house PR or press teams. If your press release can be reconfigured to fit their agendas it may be the case that sending it out via partner networks brings better results.

  • Likewise, liaise with your own institutions. Most universities have a press office and they will already have developed media relationships, certainly with local media organisations.

  • Whichever method you choose to send out your release, ensure that follow-ups occur in a timely manner. A short email reminding a contact that an event (or similar) is approaching can sometimes jog a busy journalist’s memory. Be careful, however, not to bombard those contacts as this will almost certainly have a negative impact.


Alongside using social and online media channels to engage with different audience segments there are also opportunities to reach audiences through ‘traditional’ media channels, and in particular through press coverage.

Alongside being useful in terms of helping to demonstrate any impact your project may have had, analysing social media comments related to your project are also a useful way of exploring ways in which people have engaged with your work. Tweets (and other social media posts) can reveal some of the wider discourse around your work, as well as revealing networks that may have coalesced around it. Understanding what has been said and who has said it can provide useful insights into how your project is viewed with different audiences.

You will be able to use the tweets to:

  • Demonstrate how publics and organisations have engaged with your work

  • Explore networks that have emerged around your research project

  • Analyse the language used by people when discussing or describing your work

In order to use the resources in this section you will need:

  • A Gmail account (for access to Google Drive)

  • A Twitter account

To begin collecting tweets ensure you are logged in to your Gmail and Twitter accounts, then open a new browser tab/window.

  • Visit Martin Hawksey’s TAGs website

  • Click on Get Tags - this will create a version of the data collection sheet in your Google Drive account

  • Follow Martin’s instructions for authorising the sheet to access your Twitter account

  • Enter a Search Term - this could be the Twitter account name of your project, or instead a hashtag you use to promote your project.

  • Set sheet to ‘Update Archive Every Hour’

Martin has produced this helpful video that will walk you through the process

Collecting tweets (or other social media posts) is only half of the task, however. To explore how you can visualise and analyse the data gathered in this section, see the Analyse Project Tweets section of this toolkit. There you will find some resources that will enable you to run some exploratory analyses on the data collected in this section.


Gary Hall (2011) describes what he has called the ‘computational turn’ in humanities research as “the process whereby techniques and methodologies drawn from computer science and related fields… are used to create new ways of approaching and understanding texts in the humanities”. You may have come across terms such as Digital Humanities, or Cultural Analytics – these are ways of describing the kind of academic work that Hall is talking about. From a humanities perspective, digital and data technologies are of great interest because of their relationship to the ways in which cultural items are now produced, distributed and consumed. One way to think about approaching this is an observation from David Berry (2011), who points out that in order ‘to mediate an object, a digital or computational device requires that this object be translated into the digital code that it can understand’.

Although these technologies may not relate specifically to your research, one of the ways in which they almost certainly do is through the ways audiences discover and discuss your work. In terms of public engagement, social media is an effective means of making audiences aware of your work and a way of opening up dialogues, but understanding what that engagement may look like (and whether it is good or bad) is not an easy task. In an earlier section of this toolkit we demonstrated a simple method through which you could gather posts on the Twitter social network that may relate to a discussion topic or hashtag. In this section we will show you some simple techniques for exploring those tweets

For the purposes of this section of the Toolkit we have provided a sample data set of 50 tweets and a coding script that can be used with the R software package. This script can be used to analyse any tweets you gather about public engagement in your own project, providing that the dataset is organised in a similar, ‘tidy’ fashion to the one provided. If you have used the tweet collection process elsewhere in this toolkit you should be able to use this script without too much difficulty.

The dataset provided is comparatively small – you may find that you have hundreds, perhaps thousands of tweets to analyse - but the coding script provided will work regardless of the size of dataset (although may take longer to run). The data being used here illustrates a small number of exploratory computational processes that may enable you to begin to understand the ways in which audiences are engaging with your own work.

Our suggestion is that you run the coding script with the sample data to familiarise yourself with the process, before substituting the sample set for your own. You can download the sample data set here, and then follow the process explained below by watching this video.

Loading in and preparing the data

The original data set contains 4 variables: unique numbers for both the tweets and the users who posted, the text of each tweet, and the time each tweet was sent. The process below will take those four variables as a starting point and create around 30 new variables that can be used in terms of exploring and visualising the tweets.

The first stage of the analysis is to prepare the text within the tweets for processing. This includes the following steps:

  • Removal of all punctuation and other extraneous characters (e.g. @, #, //)

  • Removal of words that occur with very high frequency in written text, commonly known as ‘stopwords’. (e.g. the, it, at, were)

  • All text is converted to lower case (i.e. to avoid the counting of ‘Vinyl’ and ‘vinyl’ as separate entities)

  • Removal of ‘whitespace’, such as that which occurs between paragraphs

  • All words are ‘stemmed’ to their roots (i.e. to avoid ‘played’, ‘play’, ‘player’ and other derivations being counted as separate entries)

  • Removal of specific ‘stopwords’ that occur with very high frequency in a particular dataset – for example: ‘the’, ‘and’ and so on. NB: This list is easily editable, so common words within your own dataset of tweets – for example, a hashtag or project name – can be added.

Following that, the script provided creates a document term matrix. This represents each word within a corpus along one axis, and each document within the corpus along the other. The amount of times each unique word within a corpus appears in each document is contained within each cell, enabling the words within a matrix to be counted and visualised.

Exploration

The script then produces a ‘wordcloud’, enable you to see that the following words appear frequently within the sample dataset. Following the ‘wordcloud’ the script then produces a handful of other visualisations that will enable you to see how frequently words appear.

If certain words appear at this point that are not required, or which you feel may skew any further analysis, they can be removed. You can do this by adding them to the list of ‘stopwords’ list and then repeating the process of creating the document term matrix above.

Topic Modelling

David Blei (2012) defines Topic Modelling as a process that ‘provides a suite of algorithms to discover hidden thematic structure in large collections of texts. The results of topic modelling algorithms can be used to summarize, visualize, explore, and theorize about a corpus’.

Topics can be understood as recurring data points across a dataset. The model, meanwhile, represents the extent to which each individual entry in a dataset (the tweets) contains data points (topics/words).

What this process will allow you to begin exploring is how certain words are used in conjunction with others. In the case of your own research you may be able to see a degree of context around words related to your project, such as ‘exhibition’ or ‘seminar’

Sentiment Analysis

Sentiment Analysis has been described by Bing Liu (2012) as the ‘computational study of opinions, sentiments and emotions expressed in text’. This process searches documents for the appearance of certain words that are individually scored, producing an overall value that marks a document as either exhibiting a positive, negative or neutral sentiment. This produces numeric scores based on text that enables individual documents to be grouped together according to numeric similarities, differences and statistical relationships.

This element may be particularly useful in terms of gauging how well (or not!) a particular event, exhibition, broadcast or seminar was received by audiences.

The differing processes above produce additional variables in the original dataset that can be combined in order to further explore your dataset of Tweets. You may be interested in looking at, for instance, the times and dates that ‘negative’ comments emerged, or whether new discussion topics began to emerge after a series of workshops.

Resources

  • Download the sample data set and coding script (ZIP file)

  • Instructions on how to download and install R and R Studio on your Windows or Mac

  • Click here for resources that will enable you to learn basic R skills

Examples of other social media research using R


Knowledge Exchange


What is it?

Knowledge exchange (KE) is a dynamic, reciprocal process whereby researchers and external organisations come together to exchange ideas, data, experiences and expertise in order to create new knowledge for mutual benefit. It involves partnership and collaboration in research. It is sometimes also known as valorisation, knowledge utilisation or knowledge mobilisation.

KE can overlap with public engagement in that it may identify specific stakeholders within ‘the public’ and lead to a public engagement outcome through a collaboration (e.g. KE with educationalists leads to the production of an activity for schools, or working with a museum to create an exhibition or podcast). KE is, however, distinct from public engagement as knowledge exchange collaborations tend to focus on industry, policy and practice-led groups in public, private and third sectors. KE can respond to pre-existing needs outside the Academy (demand driven) or emerge from a need revealed by research or arise from a combination of these. Previous HERA KE includes collaborations with community groups, charities and NGOs, bodies representing specific industries, businesses (large organisations, SMEs and sole traders), artists, designers, policy makers, legislators, health professionals, schools, museums, galleries, archives, theatres and festivals.

KE differs from knowledge transfer (KT) where knowledge is delivered from expert to user in a one way direction, such as the exploitation of intellectual property through commercialisation and the creation of spin-out companies. In contrast to knowledge transfer, which is of limited relevance to the humanities, the term knowledge exchange recognises a much more complex and diffuse range of collaborative activity that may involve many voices with different strengths and knowledge in dialogue, and different directions in which the collaboration may develop. It can be understood as part of a system of knowledge flows, which Holm (2015: 85) describes as ‘translational research practice’ or the relationship between the production of knowledge and its appropriation, and the feedback processes that come with that interaction.


Why do it?

The reasons for engaging in knowledge exchange are wide ranging. They reflect the benefits of collaborative working for both researchers and non-academic partners, and how they can stimulate and add value to each.

  • Research can be enhanced by diversifying thinking though the cross-fertilisation, transdisciplinarity and access to expertise that KE and partnership working offer. Collaboration brings diversity and diversity allows space for more voices, which leads to better research.
  • Collaboration between academic and non-academic partners can give access to datasets, expertise or equipment that would otherwise be impossible or very expensive to obtain.
  • Working with non-academic partners who have different working methods and ways of looking at research problems can be a useful learning experience for both sides.
  • KE partnerships can include potential benefits to research training and the development of early career researchers by exposing them to different ways of thinking, involvement in research projects, access to case study materials, and opportunities to visit partner organisations. These can improve employability, both inside and outside academia.
  • KE is a means of democratising research by giving stakeholders outside the academy access and input into scholarly inquiry. This in turn makes humanities research relevant to more people.
  • KE collaborations accelerate creativity and promote innovation outside the academy through the development of new networks. This innovation includes social innovation, cultural and artistic outcomes, new practices or ways of doing things, and the development of new commercial products and services. Humanities research has an important but often unrecognised role in the ‘innovation ecosystem’.
  • Successful KE collaborations can make a substantial long-term difference to individuals and organisations outside the academy. They therefore form part of a pathway to impact.

POPID was funded from 2010-2013 under the HERA JRP Cultural Dynamics, Inheritance and Identity.

Here you can find an interview with project leader, Prof. Susanne Janssen, Professor of Sociology of Media and Culture at Erasmus University Rotterdam, on her experience of integrating KE within research. This interview forms part of a resource on Knowledge Utilisation produced by NWO.


How can we do it?

A core principle of KE is that it is a creative, dynamic process that creates new knowledge through co-production, co-creation or co-design. The practice of KE therefore requires the setting up of partnerships in order to develop these kinds of interactions. The ways in which KE takes place depends on the type, size and aims of the partners involved and can take place at a range of scales from one-to-one relationships (e.g. between a single academic and a single artist or sole trader) to large multi-institutional collaborations (such as between representatives of academic institutions and governments or multinational organisations). It can be one-to-one, one-to-many, or many-to-many. It can be short-term, or long-term. It can take place locally, nationally or internationally. It can be a single mode of interaction, or several over time. The outcomes may be defined, or it may be a more open-ended investigation. In practice, HERA projects are likely to lie somewhere between these various ends of the spectrum. Many projects have expanded their partnerships as the research has progressed and they have realised both the need and potential for involving external stakeholders in new ways. Others have decided to invest more energy in relationships that prove particularly beneficial. If done well, both these contrasting strategies enable projects to develop traction by gradually scaling up KE activities.

1. Making Connections and Engaging Stakeholders

The first step in KE is identifying who is likely to be interested in your research.

  • Who are the key stakeholders?
  • How could they contribute to, and benefit from, what you are investigating?
  • What kinds of knowledge are you exchanging?

All funded HERA projects will already have considered these questions in the application stage (you may have read the HERA Knowledge Exchange Guide at application stage). Nonetheless, as research progresses, as indicated above, it can be useful to review your collaborations, or to invest more energy in those that are proving particularly beneficial.

In addition to collaborations with individual non-academic partners, some previous HERA projects have found it useful to partner with industry representatives or associations (e.g. national film institutes, digital media organisations or regional tourist authorities). Not only are such organisations deeply familiar with key issues facing their sector but they are also able to act as brokers or intermediaries, putting projects in touch with their members. This creates efficiencies for projects inasmuch as they do not have to expend time and energy recruiting individual KE participants. Industry representatives can also be particularly useful in helping projects gain entry into heavily networked sectors that are likely to be linked to humanities research, such as the creative industries, publishing or heritage sectors. They may be able to broker relationships with individual organisations and to facilitate sector wide data collection. Furthermore, the outcomes of the research can be more easily pulled back into organisations if they form part of wider industry recommendations, thereby increasing project impact.

2. Approaches to Knowledge Exchange

Approaches to Knowledge Exchange include:

  • Collaborative research: academic research undertaken in partnership with other universities or research organisations, with business, with government and/or with the third sector (e.g. charities). All HERA projects are likely to engage in collaborative research although exactly how this is configured will depend on the nature of the research team. The transnational nature of HERA projects offers unique opportunities for humanities research in bringing knowledge and skills to teams beyond a national context, and to create new networks.
  • Collaborative training: enabling academic researchers and partners based outside the academy to share good practice, develop skills to undertake excellent research, to work effectively in non-academic environments, and to maximise the benefits of their research. Training opportunities include secondments, vocational courses, collaborative studentships between academia and non-academic organisations, and the development and delivery of continuing professional development (CPD) programmes in conjunction with external partners.
  • People and information exchange: exchange of researchers between academic and non-academic partners to stimulate collaboration between them, including supporting communities of practice to grow, co-create solutions, share successes and key resources, develop guidance and standards. This may include events with external audiences, networking activities, briefings, artists’ residencies, or academics spending time in non-academic partner organisations. As well as face-to-face interactions, online communication and social media platforms provide ways for HERA projects to create opportunities for regular information exchange. These can be particularly useful in transnational settings where travel time, cost and environmental concerns (particularly those linked to flying) might otherwise limit potential communication.
  • Research exploitation and development activities: this involves working in partnership to realise the social, cultural and economic potential of research. Although the commercialisation of research is frequently associated with the hard sciences, in the context of the humanities this kind of KE requires an understanding of the nature and value of humanities research beyond narrow definitions of utility and financial value to encompass the value of humanities in its broadest sense: its contribution to the lives of others, and role in the transmission of culture, practices and values. KE within the humanities contributes to an inclusive society, has benefits for well-being, as well as making an economic contribution (for example see Council of Europe Report on Cultural Participation and Inclusive Societies 2016; The Value of Arts and Culture to People and Society. An Evidence Review 2014). KE as research exploitation therefore includes innovations that are not based on intellectual property (IP) and have not-for-profit, as well as commercial, applications. In other words, unlike the hard sciences where innovations are considered IP and may be protected by patents or involve commercial transactions, the exploitation of humanities research tends not to have such legal protection attached and does not ‘belong’ to the researcher or their institution in the same way. Whilst humanities research tends to lack commercial advantage to the researcher, the relative absence of restrictions means that it is more easily shared with partners and the benefits of the research distributed widely. Humanities research is therefore suited to policy recommendations, consultancy and makes important direct and indirect social, cultural and economic contributions that may be one, two or more steps away from the researcher themselves.

We recognise that many humanities researchers are uncomfortable with the instrumentalisation of their research, which is frequently identified as part of commercialisation. It is important to recognise that the commercial value of humanities research lies not just in the ‘discovery’ or research outcome but in the benefits, inspiration or new thinking that it can stimulate in others outside the academy. For instance, many HERA projects have developed exhibitions in collaboration with external partners. Here, the KE leads to a public engagement ‘product’ (the exhibition) which attracts visitors to the partner’s venue. Visitor numbers can be important in financial terms for the partner (demonstrating a need for continued state support or contributing through ticket sales). We also have evidence from some HERA projects of ‘down the line’ benefits of KE. For example, research on prehistoric textiles studied by the HERA-funded CinBA project contributed to the development of a new permanent exhibition at the Natural History Museum in Vienna. The tablet-woven textiles on display inspired some visitors to make their own pieces, which can now be found on sale in craft markets. In this case, visitors to the exhibition were inspired by what they saw and took it into unpredicted areas of commercial activity. The creative, cultural, environmental and social sectors have so far been the primary areas for the commercial exploitation of HERA project research including in contemporary craft, festivals, music, the tourist industry, publishing, museums, galleries and archives, and art works. Several HERA projects have also engaged in research exploitation by working directly with artists, film makers or composers; a grant or commission forms an important element of business activity for creative practitioners and may feed into further work and career development for these groups. HERA projects have also found that their research outcomes or ideas have been adopted by commercial organisations or external agencies and that they are in a position to consider whether they wish to license technologies, tools or training material, or whether they wish to make them freely available as part of a commitment to open access.

3. Modes of Knowledge Exchange

Recent analysis of KE processes points to the existence of both informal and formal modes of KE (Monroe 2016).

Informal KE refers to elements of the process that occur within everyday interactions with partners, including the cumulative effect of small, informal discussions with individuals and the sometimes unexpected ways that knowledge becomes useful (Monroe 2016). The notion of informal KE is of particular importance for the humanities where KE does not tend to be IP-based, is relationship-based in nature, and is frequently less easy to quantify than more transactional forms of knowledge exchange based around IP, ‘technology transfer’ and ‘research commercialisation’ in the hard sciences.

Formal KE refers to a range of activities or tools that enable researchers to work with external partners or to take research outcomes into external contexts. It includes deliberately constructed events and user-engagement strategies. These include tools for fostering in-person (face-to-face) exchange as well as platforms and software that enable online networking and knowledge sharing across geographic boundaries and between organisations, supporting communities of practice to grow, co-create solutions, share successes and useful resources.

There are several sources that provide advice on how to select an appropriate KE tool. These include the UNICEF Knowledge Exchange Toolbox which lists more than 20 different formats for KE activities that can be used to design and deliver a KE event. The Irish Research Council (IRC) and Irish Universities Association (IUA) has a very useful booklet Engaged Research. Society & Higher Education. Addressing Grand Societal Challenges Together (2017) which includes a glossary of methods and approaches that can be used in KE.

Engaging with Industry: Mediating Cultural Encounters through European Screens (MeCETES)

From Scandinavian crime dramas to Spanish horrors, from British period dramas to contemporary French comedies, Europeans are increasingly engaging with films and television dramas from other parts of Europe. The MeCETES project set out to research this phenomenon.

Involving humanities researchers from the University of York, University of Copenhagen and Vrije Universiteit Brussel, it examined: (1) which European films and television dramas travel well within Europe; (2) how audiences engage with these screen fictions; and (3) how these films and television dramas shape our understandings of other Europeans and sense of European identity. The project took place from 2014-2016 as part of the HERA Cultural Encounters strand.

Dr Huw Jones, a post-doctoral researcher on the project at University of York and now a Lecturer in Film at University of Southampton, describes the project’s approach to KE and offers some useful tips for working with industry partners.

Industry engagement:

Engaging with the film and television industries formed a core part of the MeCETES project. As well as interviewing directors, producers, screenwriters, film distributors and policymakers about their work, we invited media professionals to participate in our annual academic-industry conferences. These included knowledge exchange discussion panels on:
* Producing the Oscar-winning film Ida – with Ewa Puszczynska and Sofie Wanting Hassing
* Writing television fiction for European audiences – with Ingolf Gabold (producer, The Killing), Katherine Winfield (director, The Bridge), Tasja Abel (ZDF, Germany)
* Supporting European co-productions – with Rebecca O’Brien (producer, I, Daniel Blake), Emmanuel Joly (European Commission) and Petri Kemppinen (Nordic Film and TV Fund)
* Creative Europe: The Digital Challenge? – with Lucia Recalde (Head of EU Creative Europe)
* How Brexit will affect the UK film industry – with Amada Neil (British Film Institute), Tim Bevan (Working Title Films) and Hugo Heppell (Screen Yorkshire)
* Distributing film and TV in Europe – with Rikke Ennis (Trust Nordisk), Helene Aurø (DR International Sales) and Jon Sadler (Arrow Films)
* The convergence between film and television – with Alex Agran (Arrow Films), Tim Highsted (Channel 4) and Jeanette Steemers (University of Westminster)
* Audiovisual policy in Europe – with Agnieszka Moody (EU Creative Europe), Christine Eloy (Europa Distribution) and Michael Gubbins (Sampomedia/Ffilm Cymru Wales)
* Producing historical drama – with Nick Wild and Alistair Maclean-Clark (360o Media)
These events were an opportunity not only to learn from experts about the changing media landscape in Europe, but also to share the findings of our research with media professionals and policymakers – a two-way knowledge exchange process.

How to make connections

Making connections with industry can be difficult. Media professionals and policymakers may not have time in their busy schedule to do interviews or attend conferences. Some connections were made through our Associate Partners, who included the Danish Film Institute, Flanders Audio-Visual Fund, British Film Institute, and the Council of Europe. Other links came about simply by emailing or telephoning potential industry contacts. It helps to remind media professionals that participating in an academic research project can be a chance to:
* Reflect on their own creative practice
* Network with other media professionals and academics
* Influence academic debates and teaching curriculum
* Gain intellectual kudos
* Always be polite in your dealings with industry partners, and make sure you make the process easy for them by organising and paying for their hospitality, travel and accommodation.

Discussion panel on Scandi crime drama Bedraget/Follow the Money (2016) with writer/creator Jeppe Gjervig Gram and Head of DR Drama Piv Bernth at the 2nd MeCETES academic-industry conference, September 2015

Discussion panel on Scandi crime drama Bedraget/Follow the Money (2016) with writer/creator Jeppe Gjervig Gram and Head of DR Drama Piv Bernth at the 2nd MeCETES academic-industry conference, September 2015

Influencing the debate

The logistics of engaging with industry can be challenging. But it is well worth it for the chance to exchange knowledge and ideas, make connections and influence the wider debate – as the news coverage of our academic-industry conferences demonstrates:
* “Brexit Poses Challenges to Independent European Distributors”, Variety, 8 July 2016. Link
* “University of York -Industry experts debate impact of Brexit on UK film industry”, ENP Newswire, 12 September 2016. Link
* “Netflix, Amazon dominate discussion on film distribution in the UK”, Cineuropa, 15 June, 2016. Link
* “Europæisk Nordic Noir”, Information, 19 February 2015. Link


4. Developing a Successful Partnership

At its heart, KE is about relationships between people. It is therefore important to be conscious of how you manage these relationships and are responsive to developments in them.

Guidelines on developing a successful partnership, such as the Handbook on Responsible Partnering often tend to be aimed at the hard sciences and engaging in corporate relationships. Nonetheless, there are a series of common sense principles that can be extracted as relevant to all KE partnerships.

  • Intent – In developing a partnership it is vital to explore and agree what you expect to accomplish. Your aims may be concrete or quite open ended. In either case it is important to be transparent and ensure that there are no hidden agendas.
  • Interests – Successful KE depends on being able to identify shared interests. It is worth spending time and effort to understand these. They can include shared spaces, people, or priorities and can sometimes surprise.
  • Resources – Consider the resources that all sides can offer and how they are distributed between them. Be transparent and ensure that sufficient resource is put into supporting non-academic partner participation where they cannot contribute this themselves, for example, by paying travel costs. In addition to financial resources, you may want to include data, staff time, access to skills, materials, venues for events, provision of accommodation or other contributions in kind.
  • Trust – It is important to ensure that you deliver what you say you will. In other words, that you do not ‘over-promise’ and that results match expectations.
  • Build Together – Test collaboration strategically and find out how your collaboration works in practice. That way you can iron out any issues and understand the best ways to develop your partnership going forward.
  • Listen – Successful partnerships are about bringing together complementary knowledge, skills and understandings. Transdisciplinary working requires listening to your partners and benefitting from different world views.
  • Intellectual Property (IP) – IP is a complex area, especially in large collaborative projects. Even if you are committed to open access and open innovation, your non-academic partners may have IP considerations. Previous HERA projects have come across IP issues when working with external providers (e.g. app developers, software providers and creative practitioners). It can be a good idea to discuss IP with partners in advance and draw up a collaboration agreement to avoid misunderstandings. Most academic institutions will be able to provide professional advice in this area.
  • Organisation – Non-academic partners often work on different timelines to academics. Consider these and build them into your research from the start.
  • Communication – Consider how you will develop lines of communication with your partners in order to maintain dialogue and that they are kept informed of project progress. How frequently are you going to meet? Are you going to visit another organisation or are external partners going to be embedded in your team? How are you going to capture the contents of KE activities and act on them?
  • Review – Agree periodic reviews of your partnership so that you can reflect on progress, move forward together and head off any potential issues.
  • Share - Find out what has worked in the past, either with your specific partners or draw on the experiences of other HERA projects. Sharing good practice or established working methods can help smooth the path to effective collaboration.

5. Evaluation

Evaluation of KE processes, activities and outcomes is vital to understanding their effectiveness and thus what effects (impact) your collaboration has had. Evaluation is also important in terms of public accountability for funding and evidencing the value for money of humanities research. You will be expected to demonstrate the impact of your activities in project reports to HERA.

It is important to recognise that KE is a means of creating impact but it is not in itself the impact or outcome. Thus, evaluation is not a description of your KE but is an evidence-based analysis of its consequences (positive and negative). It involves a process of data collection and reflection that helps you to learn from your experiences and to assess their benefits.

The evaluation of KE is not, however, always straightforward. KE evaluation relies on both partners knowing that knowledge has been exchanged. In the case of humanities research where informal, relationship-based KE may form a large part of the process, this kind of KE may be less visible and thus less recognised, making capturing impact problematic (Monroe 2016). Furthermore, the outcomes of humanities KE may include intangible outcomes such as new ideas, changes in practice or implementation of policy recommendations, which are not as easily measured as the development of new products. In addition, some partners may be eager to claim outcomes as their own and to downplay the effects of academic input as they are concerned about the IP implications. This has occasionally been the case for some HERA projects when working with artists or other creative practitioners. It is therefore important to capture an evaluation of the process as well as its outcomes by all participants in order to identify what has been exchanged and why it is important.

There is no ‘catch all’ method of evaluation for KE and methods for the evaluation of KE in humanities are the subject of debate (see Crossick 2009, Moreton 2015). Humanities KE tends to be less readily monetised and to resist the metrics that are applied to the hard sciences. The latter have a tendency to decontextualize the processes of knowledge production and exchange, focusing instead on how knowledge is rendered ‘technical’, and mobile across a range of contexts (Monroe 2016). Thus, many of the existing models or metrics for evaluating KE simply do not recognise the wide variety of approaches to KE and their outcomes that exist within the humanities. Timescales for the impact of KE also frequently extend beyond the official project end date, continuing for up to a decade after the original research has taken place (Kings College London and Digital Science 2015). Appropriate evaluation of KE for your project therefore needs to take into account both how knowledge is understood and how knowledge exchange is implemented (see Fazey et al 2014). In order to develop ‘humanities friendly’ KE evaluation for your project it may be useful to consider the following aspects:

  • What is the context of your KE?
  • What are the tangible and intangible outcomes of KE?
  • Did KE lead to direct outcomes for partners and / or can you identify ‘down the line’ effects of the collaboration?
  • What new skills, knowledge, data and expertise have been gained by each of the different partners?
  • How did partners engage in the KE process? To what extent did they engage in the process – do they feel positive about the process and did they enjoy it? How stimulating were its different elements? What was the balance between formal and informal KE?
  • What was the reach (who and how many partners / people) and depth (the extent of co-operation) of the collaboration? It is possible to engage in extremely successful KE with different degrees of reach and depth depending on the mode and aim of the collaboration.
  • To what extent did the KE result in new research networks?
  • How sustainable is the collaboration going forward?
  • Were there any surprises or unexpected outcomes? This is often the case.
  • Is it possible to put in place light touch monitoring of project outcomes beyond the official lifetime of the project?

Given the complexity of evaluating KE in the humanities, qualitative and quantitative methods for evaluation tend to work best in combination, as can formal and informal evaluation. The AHRC has produced Understanding Your Project a Guide to Self Evaluation and the ESRC has produced guidelines on how to develop an effective evaluation plan. In practice, it is likely that many evaluation methods will be shared between public engagement and knowledge exchange (e.g. questionnaires or interviews), although the kinds of information that you gather will, of course, differ (see section on the evaluation of public engagement in this toolkit).

Working with Policy Makers (Hints & Tips)

Humanities researchers have an important role to play in supporting policy-makers across a diverse range of subject disciplines and government activities. Research in the humanities can inform the design and implementation of public policy, both directly and indirectly. Directly, academics can contribute to consultations, formulate new policy, or develop guidelines for its delivery. Indirectly, they evaluate the effects of existing legislation, provide historical perspectives on current policy debates and interrogate the principles and premises that underpin areas of policy. HERA projects have made direct contributions to policy in a range of areas including health care, heritage, tourism, human rights, legislation, education and the environment. They have made indirect contributions by providing important reflections in fields as wide ranging as public health, migration, banking and cultural property from which policy makers may learn important lessons.

The AHRC has produced a guidance document on planning and demonstrating effective policy engagement.

Gavin Costigan, Gavin Costigan, Chief Executive at FST prepared this helpful powerpoint presentation for the HERA3 Uses of the Past mid-term conference in 2018.


The MELA project. Working with policy makers to influence legislation

The MELA Project (Memory Laws in European and Comparative Perspective) was funded from 2016-2019 under the Uses of the Past HERA JRP. It undertook both an interpretive (descriptive) and a normative (prescriptive) study of memory laws. Through its collaborative research it proposed a European code of best practice for the drafting and implementation of memory laws – a ‘Framework Declaration on Historical Memory’ as a set of legal and policy guidelines to aid national governments, European and international bodies, and non-governmental organisations in adopting critically-minded images of the past within the spheres of education, media, and civic life.

Dr Aleksandra Gliszczynska-Grabias, Institute of Law Studies of the Polish Academy of Sciences, and Dr Grażyna Baranowska, a Postdoctoral Researcher at the Institute of Law Studies of the Polish Academy of Sciences, describe how their research influenced legislation at a critical time.

It goes without saying that the gauging the impact of projects in the humanities is usually a tough job since rare is the case when a simple ‘Yes’ or ‘No’ answer is available to a question as to whether a given project produced a tangible change or contributed to the achievement of specific goals. However, the MELA project certainly achieved more than was originally envisaged. Namely, it firmly planted the concept of ‘memory laws’ in the scientific and public mainstream, not only bringing these laws to the attention of scholars but also prompting social and public analyses of the phenomenon.
The international research consortium, composed of Queen Mary University of London, Institute of Law Studies of the Polish Academy of Sciences, T. M. C. Asser Instituut – University of Amsterdam and Department of Law, Alma Mater Studiorum, University of Bologna, found itself involved in MELA at a very special time. It quickly turned out that the expectations voiced in the grant application stage did indeed materialise: memory laws emerged as a prominent feature in the legal and social landscape in many countries. What MELA offered was not just in-depth analyses of the various memory laws in existence, but also an extensive theoretical and methodological background to aid discussions of the kinds of memory laws that do not cross the red line of inadmissible interference in human rights and freedoms, and those that do cross that line, sometimes becoming dangerous tools in the hands of the powers that be. MELA investigators took an active part in discussions of the notorious amendments to the Polish law on the Institute of National Remembrance (eventually discarded in line with calls from MELA), the controversial European Court of Human Rights judgment on the negation of the Armenian genocide, and the memory laws in place in Turkey and Ukraine.
The book Law and Memory. Towards Legal Governance of History, edited by two of the principal MELA investigators and published by Cambridge University Press late in 2017, was the first comprehensive legal treatment of the issue of memory laws, becoming a reference point in nearly all of the later discussions on the subject. Also going to MELA’s credit are dozens of other scientific publications, countless blog posts, media interviews, social media activity, a Wikipedia entry on memory laws, and dozens of contributions at scientific, political and media events around the world.
MELA also came up with a feasible model procedure for countries implementing legislation in the area of history and remembrance, outlined in the Model Declaration we offered to the public, policy makers — and to political dissidents. In it we proposed a number of guidelines, advising extreme caution in dealing with history and interpretations of history while using legal instruments. At the MELA conference wrapping up the project, staged in Brussels in May 2019, representatives of leading international organizations and NGOs discussed the Declaration, acknowledging its wide-ranging social impact. We hope to be able to continue our promotion of the Declaration, thanks also to the additional support provided by HERA, such as at the United Nations.
In these difficult times we live in, the risk of memory of the past being manipulated and abused is on the rise. We are confident that MELA helped highlight these risks and indicated specific ways of mitigating them. Thanks to the KE strategy it developed and implemented, MELA projected the results of its research across a broad audience, including individuals and organisations with the greatest say in the process of developing laws which determine the ways in which we approach the past.


Challenges of Knowledge Exchange

Effective knowledge exchange can be extremely rewarding but the process can also raise a series of challenges. These may include:

  • Partners working to different timelines. Universities often operate on significantly longer time scales than outside collaborators. External organisations may also have annual business cycles that differ to those of academic institutions. There may therefore be periods when knowledge exchange can take place and periods when this is more difficult. It is important to establish where potential pinch points may be in the lifecycle of the project and factor this into your work plan. For example, the CinBA project worked with contemporary makers and designers to explore the role that prehistoric creativity can play in inspiring creative practice today. Markers and designers are small businesses whose busiest time of year is September to December when they are preparing products for Christmas. Although the CinBA researchers would have liked to collaborate in their autumn term, in practice the availability of non-academic participants meant that the majority of knowledge exchange activities took place at other points in the year.
  • A mismatch between the drivers and timescales of academic research and partners’ expectations of outcomes and impact. The currency of academics is publications while that of non-academic participants is the effect of the collaboration on their organisation. It is not always clear to partners what academic research entails – particularly when it comes to humanities research – and non-academic partners may expect more immediate impact than academics are able to provide (Pickerill 2014). Consider what your different drivers are.
  • A mismatch in the identification of what counts as useful knowledge to be exchanged. In their examination of KE in the music industry Williamson et al. (2011) note that a mismatch between participants’ demand for relevance and applied knowledge, and academics’ demand for methodological rigour and replicability can lead to tension. These authors argue that what ‘counts’ as useful knowledge for KE partners in the music industry is usually knowledge that enables individuals or firms to gain competitive market advantage or, alternatively, knowledge that can inform policy (Monroe 2016).
  • Understanding what will happen at the end of the project is a particular issue for humanities KE where close personal and organisational relationships have been developed. This is especially the case where projects engage in social innovation with community or volunteer organisations who may recognise benefits from the relationship and will be unable to sustain them at the project end. It is important to have open and honest conversations about this in order to develop plans for post-project sustainability and that partners recognise that the HERA collaboration is time limited.
  • Academic and non-academic partners may speak different ‘languages’. It can help to have someone in your project who is a designated ‘go between’ who can translate between the partners and make sure that communication is maintained. Developing this kind of intermediary role forms one of the recommendations in the Heritage and Creative Industries Report (2019).
  • Financial constraints can become a challenge, especially when non-academic partners are not budget holders and / or KE has unexpected positive outcomes that you want to scale up in order to increase impact. If you have project-specific issues of this kind please seek the advice of the HERA handling agency (IRC). In previous rounds of HERA funding there has been a competitive call for small amounts of top-up KE and Impact funding. The award of such funds is at the discretion of the HERA Board.
  • Sometimes knowledge is not successfully exchanged. It may be resisted, ignored or taken up in unexpected ways. You may also find that partners are unable to deliver on agreements made during grant preparation. In such situations it is important to be honest, flexible and responsive. It may be useful to add or replace a partner, in which case you should contact the HERA handling agency (IRC) who will be able to help you.
  • The humanities often work without formal IP and it can be difficult to decide to whom data, ideas or innovation belong. It may be useful to consider your attitude to IP in advance and to draw up a collaboration agreement with your partners.
  • Traditionally, humanities researchers are not trained to work collaboratively with non-academic partners. If they have not previously worked in this way, there will inevitably be a steep learning curve. Not only do they need to understand the ways that non-academic organisations work and ensure that partners feel valued, but they have to balance this with their desire to carry out high quality research, institutional systems of recognition and academic culture. Building an effective KE relationship may involve stepping outside recognised, established research pathways. It thus requires considerable emotional investment (Monroe 2016). The HERA Fellows can support projects in KE and help point them to a reservoir of skills and experiences available from other HERA projects.

Common Concerns and Pitfalls

Concern: I’m working with artists in my project but none of this is relevant to KE.

Many projects engage in KE without realising it! Many HERA projects have worked with artists and every artist has to make a living. They are effectively small businesses where exhibitions and grants are important sources of income, profile raising and new products. Working with artists is a form of KE.

Concern: I object to the instrumentalisation of research.

HERA does not take an instrumental approach. It funds basic research (rather than applied research) and does not require that your research is carried out to serve any particular group.

Concern: KE is for scientists. I don’t do spinout or commercialisation.

As indicated above, HERA recognises that Humanities KE is qualitatively different to that in the sciences. It takes place in a variety of ways and has significant benefits for research and society that go beyond models of purely commercial application of research.

Concern: KE is too time consuming and an unhelpful addition to research commitments.

KE can offer positive benefits that improve the quality of research. It should not be seen as an additional burden on researchers but rather as a means of developing unique insights and understandings that could not otherwise be gained.


FAQs

Q: One of my non-academic partners has gone quiet and is not responding to my emails. What should I do? Can I find someone else?

A: KE often brings unexpected challenges as well as rewards. Sometimes partners become busy and their priorities shift. Try to keep lines of communication open so that they can tell you if the timing is difficult. But sometimes partners do have to pull out unexpectedly. Although this can feel like a blow, it can provide opportunities to develop new partnerships with other people or organisations. If you decide to do this (or an unexpected opportunity arises to develop a partnership that was not in your original application) you can indicate this in your reporting to HERA. Do talk to the handling agency (IRC) if you alter or add to your list of non-academic partners.

Q: What am I allowed to pay for in order to help a non-academic partner take part in KE? Can I move between budget lines to facilitate their involvement?

A: Contact the HERA handling agency (IRC) for advice. Explain what you would like to do. They will let you know what you can and cannot pay for, and what the rules are around budget lines.

Q: Is there any additional support for KE activities that I did not include in my original HERA application?

A: HERA recognises that KE can lead to unexpected outcomes or that new and unexpected opportunities can arise for KE. Small top-up awards have been made available for previous HERA JRPs on a competitive basis. It is possible that something similar will be available for Public Spaces projects but this is at the discretion of the HERA Board.


Useful Resources

Additional resources are organised according to funding and other organisations and also geographically.

DFG

FWF

  • Top Citizen Science Funding Link (TCS)
  • Science Communication Programme Link (WissKomm)

NWO

  • NWO Knowledge Utilisation Resources Link (English)
  • NWO Knowledge Utilisation Resources Link (Dutch)
  • Innovation Amsterdam Link

UKRI

  • Gateway to Research Link a UKRI website, contains information such as who, what and where the Research Councils and Innovate UK fund, konfer, created by the National Centre for Universities and Business in partnership with UKRI, can help businesses, of all sizes, connect with universities. An online tool that help businesses find opportunities for collaboration including research, researchers, facilities, equipment, funding and support
  • Many UK universities are members of the national centre for universities and business http://www.ncub.co.uk and of Praxis Auril which helps members to work in partnership with businesses.

European Commission

  • The Knowledge Exchange Platform Link (KEP) is a concept jointly developed by the European Committee of the Regions (CoR) and DG Research and Innovation of the European Commission (DG RTD). It is aimed at presenting new R&I solutions, innovative products and best practices in response to societal challenges facing the regions and cities of Europe. The focus on cities and social innovation is of particular relevance to several HERA projects.

Global

  • iKEN Link – a global co-creation and ideas platform that harnesses the power of human connection to innovate new solutions for cities to improve lives and build fairer, more inclusive societies. iKEN connects Europe’s leading cities of innovation to researchers, innovators, entrepreneurs, policy-makers and investors world-wide to develop fresh ideas, share best practice and unlock the power of co-creation to transform innovation policy and practice around the world.
  • UNICEF Knowledge Exchange Toolbox Link. Of interest to projects working in development contexts and with NGOs.

Impact

In this section of the Toolkit we aim to unpack what impact is, how it is constructed, and how it might be documented, and to raise questions around the ethics and politics of impact. We do not intend to tell you how to ‘do’ impact. Instead, we suggest that realising the impact of Humanities research requires engagement in critique and acknowledging difficult questions in order to maximise positive benefits. Our intention is to consider impact through a specifically Humanities lens, so that scholars can consider what works best for their research questions, discipline and national context.


What is it?

Impact is the change, effects or benefits arising from research via public engagement and knowledge exchange. It is therefore their outcome. However, whilst knowledge exchange and public engagement activities often lead to impact, collaborations with partners and different audiences should not necessarily be viewed as impact in and of themselves. Impact is an umbrella term for the contribution that research makes in two potentially linked areas: i) non-academic impact (the impact of research beyond academia), ii) academic impact (the research knowledge contribution to a field of enquiry or influencing the career development of project members). Impact can take place at a range of scales from the individual to the global.


Imagining humanities impact

Several scholars have attempted to articulate the distinctive contribution of the humanities and its societal impact (e.g. Small, 2013; Holm, Jarrick and Scott, 2015). This work often aims to highlight different ways in which value can be understood. For example, we can immediately point to the intrinsic value of the humanities regardless of any subsequent impacts (humanities research is valuable in and of itself) but we can also highlight the integral social role the Humanities play in understanding, preserving and challenging our sense of cultural heritage, histories and traditions. Through a commitment to critical thinking, humanities research promotes innovation and new ways of working and understanding. As HERA project teams, we also understand how Humanities research often informs – and is informed by - work in other fields (from the social sciences to medicine).

Nonetheless, discussions of intrinsic value and the qualities of the Humanities can at times seem vague or ephemeral in a climate where there is a political need to justify public spending and to provide concrete evidence of return on investments. Thus, despite attempts to open up a debate about value, discussions of impact have often tended to focus on the economic and policy–driven benefits of research, as opposed to broader values and impacts within the humanities. In large part this reflects the dominance of modes of impact in the hard sciences and social sciences (where applied research has a long-standing role), and attempts to squeeze humanities research (which tends to be basic rather than applied) into the same sets of criteria for impact assessment. For example, in medicine the beneficial outcomes of research activity can be easily grasped in terms of the development of treatments, processes or procedures, that are adopted to demonstrable effect outside the lab. The adoption of a new drug, for instance, can be directly linked to health benefits in the population that it reaches. In such instances, a clear and linear impact narrative can be drawn from problem (for example, a disease) to solution (a therapy) via a research process designed to address a specific problem. In the Humanities, however, demonstrating how research directly addresses a problem can be more complex. On one hand, this is because the methods of the humanities are frequently exploratory rather than experimental; in many cases, problems may only be revealed and articulated through the research process itself – or, a more intriguing and pressing set of problems is revealed during the investigation of another set of questions. On the other hand, the adoption of solutions or recommendations related to a given set of identified problems may occur in dispersed and unexpected ways, and may take place beyond the lifetime of a project.

The established tropes of economic and policy impacts, have sometimes made it challenging for Humanities researchers to recognise, understand and capture the impact of their own work in these terms. Humanities scholars can feel caught between a belief in the innate value of scholarship and what they perceive to be external instrumentalist agendas. It is, however, important to recognise that the distinctive features of the Humanities do not mean that they necessarily have less impact than the hard sciences. Instead, Humanities impact is qualitatively different and this means that its potential benefits need to be differently imagined to the hard sciences. Considering Humanities impact on its own terms by acknowledging its breadth and variability, in addition to its innate value, allows broader conceptualisation of the ways that the Humanities can benefit society, including how research actively contributes to well-being and meaning-making in everyday life.

Mark Reed offers the following general outline of types of impact that provides a starting point for thinking about the potential of humanities research:

Categories of research impacts (Reed 2018)

Categories of research impacts (Reed 2018)

Reed’s general suggestions should not be seen as definitive. The epistemological diversity that characterises humanities research and the relative freedom that humanities researchers have to create impact in ways that work for them create opportunities for experimentation in impact creation, particularly in transnational settings. The breadth by which the humanities can create impact should therefore be understood as a relative strength of humanities research since it has potential for scholars to recognise the diversity of stakeholders, and to connect with beneficiaries in an inclusive manner. Furthermore, the diversity of Humanities research means that the nature of impacts will continually change.

Further reading on Impact and Humanties work

Bate, J, ed (2011), The Public Value of the Humanities. Bloomsbury

Benneworth, P.; Gulbrandson, M.; Hazelkorn, E. 2016. The Impact and Future of Arts and Humanities Research, Palgrave Macmillan.

Hazelkorn, E., 2015. Making an impact: New directions for arts and humanities research. Arts and humanities in higher education, 14(1), pp.25-44.

Nussbaum, M. 2010, Not for profit: why democracy needs the humanities, Princeton University Press


Models of Impact

The diverse nature of impact means that there is no one correct way to ‘do impact’. Indeed, recent work has revealed at least 13 distinct mechanisms for the creation of impact in the humanities and social sciences (Muhonen et al 2020), of which only one followed a linear pathway from academics to end users. Impactful research in the Humanities may be iterative, involve complex networks of collaborators, and take time to be embedded within social discourse or effect change in practices. The trajectories of humanities impacts may have elongated pathways lacking one-to-one-correspondence between a research activity and a societal outcome (Martin 2011). This is because, in contrast to the hard sciences where models of impact tend to be more linear and exceptional moments of impact can be identified (e.g. filing a patent or use of a new drug), humanities impact is frequently derived by creating opportunities for ‘productive interactions’ which may be part of the everyday (Sivertsen and Meijer 2020). Instead of handing over a finished product to beneficiaries at the end of the research, impactful humanities research tends to incorporate partners throughout the research process, and the link between knowledge and society is never complete.

Impact can be developed at a variety of points within the research process (Muhonen et al 2020). These include:

  • In research questions (the decision to study a topic can itself generate societal impact, for example by highlighting neglected minorities or migrant groups)
  • In research findings
  • In creation of new products, methods, conceptualisation or approaches to a problem.

Impact is also linked to the type of knowledge, modes of interaction (between researchers, research partners, stakeholders and intermediaries) and the nature of beneficiaries. It emerges as a result of the conditions by which knowledge is made useful, as well as the knowledge itself (Research Council of Australia 2018). The context of research, including external factors such as political dynamics, the COVID-19 pandemic, or climate change, is central to impact. In this sense, high impact projects are about being in the right place at the right time and not all projects can (or should) expect to be equally impactful. Impact is therefore, in part, a matter of serendipity but it can be maximised though flexibility, responsiveness, and taking opportunities as they arise. Regular self-reflection on the relevance and importance of research as it develops is important in order to recognise windows of opportunity when research can have impact, as is the ability to react swiftly to them. Developing impact is often a matter of conscious awareness of changing opportunities to use research for social benefit in real time. Therefore, the impact that emerges from research is not always predictable and is often retrospective.


Capturing and Articulating Impact

Humanities research can have substantial positive benefits outside the academy however, to date, it has often been difficult for the public, funders, policy makers and governments to understand and acknowledge the importance of the humanities for society. It is therefore vital that the benefits of humanities research are made clear. Capturing impact provides the evidence base to understand the effectiveness of translating humanities research into demonstrable outcomes that benefit society. Using this data to creates narratives articulates research impact and creates opportunities to recognise the role of the humanities and engage in advocacy.

The informal and often everyday nature of impact creation by the humanities means that some research impacts tend to be hidden. Furthermore, they are often taken for granted by scholars who tend to forget that they are distinctive features of humanities scholarship which may need to be made visible in order to highlight the role of humanities in society. How, then, can humanities researchers capture and articulate impact that is sometimes hard to spot and define? What methods can be used to capture the value of work that often cannot be reduced to economic or other metrics?


1. Capturing Impact

Humanities research requires ways of drawing out its effects that acknowledge the means by which such effects are created, including everyday interactions and informal conversations. In previous sections of the Toolkit we discussed a range of methods for evaluation of public engagement and knowledge exchange activities, including collection of qualitative and quantitative data as appropriate to the nature of the research, audience and intended outcomes of interactions. The diagram below indicates a range of different types of evidence used to demonstrate impact in the UK Research Excellence Framework 2014, though these should not be seen as definitive.

Examples of different types of evidence used to demonstrate impact in the UK Research Excellence Framework, 2014.

Examples of different types of evidence used to demonstrate impact in the UK Research Excellence Framework, 2014.

In order to capture impact data effectively it can be useful to:

  • Monitor impact throughout the project lifetime rather than an afterthought at the end. Gathering impact monitoring data increases in difficulty as more time elapses between project activity and evidence gathering. This is compounded by the fact that the importance of a particular activity during the lifetime of the project may not be revealed until later. For example, an exploratory public workshop or activity taking place early in the project may retrospectively be revealed as the catalyst for the involvement of key beneficiaries in the project. However, if data was not gathered at the event itself (for example, via feedback forms), it is often impossible to retrospectively gather evidence that can demonstrate this. It is therefore vital to engage in monitoring and evaluation throughout the lifetime of a project. This also allows you to trace research benefits, capitalise on impact, or modify activities.

  • Deploy existing research skills, methods and activities. It can be helpful to treat capturing impact as simply another strand of your project’s research activities. Consider your research strengths and adapt these to impact data collection. For example, if you are using participant observation methods of data collection in your research, can you use this expertise to consider impact?

  • Consider what additional resources and tools are available that can be enfolded into the research process and working practices. If you need additional skills or data, can you take an off the shelf solution (such as online survey tools or tools for collection of social media data), or do you need something bespoke?

  • Look at examples of best practice (and what didn’t work) from previous HERA-funded projects. Over the last decade of HERA-funded research there is likely to be a project that has tried to capture impact in a way that is relevant to you. Rather than ‘reinventing the wheel’, why not draw on past HERA experiences. Several previous HERA projects have agreed to share resources and experiences with current grantees. These are discussed below.


2. Articulating Impact

As with any form of research, once impact data has been collected, this needs to by synthesised and interpreted. In some national contexts so-called ‘impact pathways’ have been the predominant means of planning and describing the ways in which research can be made useful to society. There is increasing recognition of the drawbacks of this approach in terms of its implicit assumptions regarding the linear nature of impact and the tension this creates in describing the benefits of the humanities. As an alternative, there is growing acknowledgement of the importance of the relationship between impact and social networks for the humanities. In some countries this includes moves towards understanding the development and characterisation of networks themselves as an alternative means of assessing impact.

Mapping Networks to Demonstrate Impact

One way of exploring the potential areas of impact for your research project is to map out the different people and organisations you have worked with, or who have come into contact with your work indirectly. An example of this kind of approach is provided by the JPI Heritage-funded CHIME project. In this blog post, researcher George McKay - who was also involved in the HERA Rhythm Changes project - describes the process he and his fellow researchers engaged in when attempting to map the impact their project was having. The image below was created using Adobe software, but is derived from a much simpler and more accessible piece of technology; George and colleagues met to discuss their network and its composition, and began by sketching out their network as a pen and paper diagram.

The diagram below provides a useful example of how connections are established, and how potential impact can often occur at several removes from work of individual researchers. Using the outer elements of the network (in this instance, jazz and improvised music festivals) as a starting point for conversations about potential impact and sources of evidence, an impact narrative can begin to be traced back to the research work undertaken. This is a more logical and efficient manner of identifying and articulating impact than using the research as a starting point.

How CHIME chimed, HERA-funded CHIME project, 2015.

How CHIME chimed, HERA-funded CHIME project, 2015.

It may be the case, however, that it is not possible for you to map out your impact network in this way – or, if your project is on-going – there may be potential elements of your network that are unknown or hidden. One potential way of capturing this over the lifetime of the project is to set up some automated data collection early in your work and then periodically create visualisations of the network coalescing around the project. Comparing how these visualisations change over time can also help point towards the development of your impact network, and allow you to pinpoint particular events or elements of work that facilitated new connections. For example, if certain elements or connections appear in the latter stages of a project – or even after the project has completed – it will be easier to trace their appearance back to the activities taking place in that period.

Other Network analysis tools/processes

Socioviz - A tool that enables users to enter a search term, scrape social media data, and identify key actors within a network, and produce visualisations. You can explore the tool here.

Gephi – Open source software that enables the creation of 3D network visualisations. You can find introductory tutorials here.

Tableau – is a tool that provides a user-friendly interface for analysing and visualising data. All analysis is performed using functions within the Tableau system, meaning that no coding experience is required. See an example workflow for creating network diagrams here.


Further reading on Networks

Grandjean, M., 2016. A social network analysis of Twitter: Mapping the digital humanities community. Cogent Arts & Humanities, 3(1), p.1171458.

Schuster, J., Jörgens, H., & Kolleck, N. 2019. Using social network analysis to study twitter data in the field of international agreements. SAGE Research Methods Cases. doi:10.4135/9781526487421



Rhythm Changes: A Case Study in Growing Impact, Creating Networks and Taking Opportunities

Rhythm Changes: Jazz Cultures and European Identities was funded as part of the first HERA JRP programme. The three-year project investigated the trans-national nature of European jazz scenes past and present, and explored cultural dynamics through the exchange of ideas and inspirations. The project interrogated concepts of European cultural identity, examined national movements and meanings, and considered inherited European traditions in relation to the politics of African American culture.

The Rhythm Changes Project Leader met the Director of the London Jazz Festival at an event in Singapore in 2010. The HERA award had already been announced and, whilst London had already been named as a potential location for public engagement activities (due to a link between the Danish PI and the Festival team), the Festival had not been listed as an Associated Partner at the proposal stage. A late-night conversation in a hotel bar resulted in discussion of the HERA project and its potential impact on the festivals, audiences and the wider industry. The Festival director was able to outline what research had been carried out from an industry perspective to date and discussed the benefits of working with the Europe Jazz Network, groups of leading promoters, festivals, venues and agencies. This initial conversation led to further talks back in London as well as engagement with the Europe Jazz Network, who were embarking on a research study of their own membership at the time. These initial conversations led to some immediate collaborations which benefitted the project including a curated public forum at the 2010 London Jazz Festival entitled ‘Another Place: Why Jazz Festivals Matter’ which featured contributions from festival organisers and the project team and an invitation to participate in the research steering group for the Europe Jazz Network’s Strength in Numbers research programme.

Once the Rhythm Changes project was underway, the initial work with London and the growing relationship with Europe Jazz Network led to similar events in other festival locations and countries, from Copenhagen to Vienna, London. The project team also contributed national case studies to the EJN research programme.

Live Jazz at the Rhythm Changes conference, 2016.

Live Jazz at the Rhythm Changes conference, 2016.

Collaboration with the London Jazz Festival grew year on year as the festival expanded its public talks programme involving the HERA project team to the point where they created Professor in Residence scheme in 2013. The Festival were also involved in curating the final HERA showcase for the 1st Joint Research programme, commissioning artists to work alongside HERA project teams. Following the completion of the HERA project, team member Professor George McKay, secured additional funding to work on The Impact of Festivals which included the publication of a history of the London Jazz Festival.

The initial London Jazz Festival event had featured a contribution from long standing Birmingham promoter and consultant programmer for the Cheltenham Jazz Festival. As a result of this initial engagement, the Cheltenham festival team become more engaged in research events, with key members becoming regular attendees at project events, seminars and research sessions at EJN conferences. Whilst these engagements occurred towards the end of the project, they stimulated conversations about mutual research interests and potential future collaborations.

This gradual relationship led to a substantial collaboration with the Cheltenham Jazz Festival team in subsequent funded research projects (see: CHIME, Everyday Jazz Aesthetics, and George McKay’s AHRC-funded talks). Activities ranged from the curation of seminars within the festival programme, pre and post-concert talks with artists, new forms of audience engagement including sound walks, and an official festival app, as well as a CPD programme for artists based on the engagement with cultural heritage research. The impact of this work also extended to other colleagues working in jazz who developed additional activities, ranging from BBC Broadcasts based on archival and media research to a post-doctoral research project linked to the European Keychange initiative.

Over a 10-year period, members of the research team moved from working on the periphery of festivals to being closely engaged in the development of new programming and commissioning ideas, and played a key role in new project and funding initiatives, in developing new audience engagement activities and technologies, and provided a context for festivals to reflect on their social and cultural significance, articulating their value to policy makers and a broader public.


Reflective narratives or case studies are also a widely used means of articulating impact. These can acknowledge the twists and turns of humanities research. If you use this method, it can be useful to ask yourself some basic questions in order to articulate the effects and benefits of your research. For example:

  • How many impact stories do you have to tell? The impact of your work may be hard to identify, measure and articulate in a neat, broad metanarrative. This can sometimes make it difficult to know where and how to start. A useful way of addressing this is to initially focus on a set of smaller, specific impact narratives and then try to identify if any of these might be linked.
  • Why is this impact important? Does the benefit of your work relate to a specific problem?
  • Who benefitted and at what scale? For example, individuals, organisations, national level, globally?
  • What reach did your research have? How many people / organisations / countries benefited or were affected by your work?
  • Where were the beneficiaries located?
  • How was the research used / applied by the beneficiaries?
  • What depth of benefit did they experience? How important was it for them?

It can be tempting to claim world-changing impact but try to be realistic. There needs to be a clear link between the claimed impact and the research and not all research will, or can be, equally impactful. Good research is not always impactful research but impactful research needs to be good research in order that impacts are properly evidence-based.



Tips for collecting qualitative and quantitative impact data

Qualitative impact data can be extremely powerful in illustrating humanities impact. Speak to your contacts in partner organisations. These are the people you have worked with most closely during your research, and they are likely to understand the broad benefits of having worked with you – even if, like you, they may find it difficult to articulate those benefits in strict problem / solution terms. Conversations with your partners may:

  • Reveal kinds of impact you had not considered. The way your partner(s) describe and frame the benefits of having worked with you may differ from those you have identified, and may reveal impact pathways that were unknown to you.
  • Provide access to secondary beneficiaries. The work you have undertaken with a particular organisation may have been applied in other areas of their work, or helped inform their thinking on projects in development. Ask about partners planned activities that do not relate specifically to the research process, and try to identify overlaps.
  • Gain insights into potential/future impact.
  • Reach partner audiences through mutually beneficial evidence gathering. The type of organisations that humanities researchers often work with are often subject to scrutiny in terms of monitoring and evaluation processes imposed by funders and other benefactors. Working with your partner on mutually beneficial evidence gathering activities such as surveys or focus groups can be a way of reaching audiences and potential beneficiaries of your work, as well as sharing the workload

Try talking to people who have had involvement in a particular aspect of your research – for example a museum curator or an arts practitioner. This can help to tease out some of the ways the project has been beneficial for individuals. You may want to consider:

  • The ways they directed benefitted. What happened? A person or organisation your work has reached will be able to talk to you about the direct benefits of engaging in your work. They may, for example, have learned something new about their area of interest, or have picked up some new skills, or simply had an experience that was memorable. This can often be a gateway to..
  • The tangential or longer-term benefits. What happened next that can be linked to that experience? Did the person apply their new knowledge or skills in a different project or role? Did the connections they made during your research project lead to opportunities or other work? How has the knowledge or information your project provided been applied, and where?
  • The reach and significance of those benefits. What has happened since? Has the person moved to another job, or perhaps instigated a project of their own? Have they shared the knowledge or experience with others?

The experiences and stories you collect can help you reveal ‘impact themes’ that emerge from your research. For example, several respondents may report using the knowledge or skills they developed via engagement with your project in securing funding or employment in a particular sector. Improving the employability prospects of practitioners may not have been an objective of your work, but it frequently emerges as an impact of HERA projects.

Quantitative data can take many forms such as visitor numbers (e.g. to an exhibition), increased revenue for an organisation as a result of your work (e.g. through ticket sales) or leverage (the ways in which organisations capitalised on their relationship with you to develop new relationships, products or services or win grants). Quantitative data have traditionally been seen as more straightforward in terms of illustrating impact, however on their own they cannot fully indicate the nature of impact and how it happened; quantitative data is a measure of ‘what’ but not ‘why’ and often benefits from complementary qualitative data in order to understand what it means. Furthermore, figures are not always easy to obtain. For instance, companies or sole traders may be reluctant to reveal sensitive data on revenue or income. They may also be worried about acknowledging the role of researchers in developing new products, services or ideas because they fear the implications of doing so for copyright or intellectual property rights.

The HERA data capture template provides a useful (though not exclusive) guide to the kinds of data that can be useful to collect as your project progresses. It also offers a framework for you to enter impact data as your project unfolds, thereby assisting in project monitoring and reporting.

N.B. just as you would need to comply with GDPR for research data, collection of impact data may be subject to the same regulations. Speak to your institution about how to comply with GRPR.


Working with External Partners to Create Impact

Working with external partners is a good way to effectively develop impact (see the Knowledge Exchange section of this toolkit). Since the first JRP programme launched in 2009, HERA projects have developed meaningful relationships with a range of stakeholders, including museums, galleries, libraries and archives, media organisations, the education sector, journalists and writers groups, business and industry, policy makers, festivals and venues, military regiments, religious institutions, artist organisations and performing arts practitioners, heritage sites and historic buildings, activist groups, legal and financial institutions, professional societies, public sector institutions, as well as voluntary and community groups, and charitable organisations, and the general public. This list is by no means exhaustive but offers an indication of the breadth of potential impact of humanities research.

Collaborating with Associated Partners can be a truly rewarding experience for HERA projects. Partnerships have led to new research insights and areas of discovery and have enabled project teams to reach a wider audience. However, previous HERA projects have also encountered a number of challenges in partnership working. Here are some of the common issues encountered by project teams working with external partners:

Timelines and timescales

Several HERA projects have encountered potential incompatibility issues with Associated Partners due to different patterns of working and organisational cycles. This can include Associated Partners having different expectations about project deliverables, planning and timescales for completion. For example, several HERA project teams named museums and galleries in proposals with the expectation that project findings would be exhibited. However, once project funding had been secured, HERA teams realised that main exhibition spaces were booked beyond a three-year cycle and so alternative exhibition spaces had to be secured (such as a digital exhibition or spaces not usually associated with museum audiences).

Changing priorities

The priorities of Associated Partners can change over a project cycle as they respond to factors influencing their organisation, meaning that partners cannot fully engage in research activities as planned. Often, such changes can come about through factors that are beyond the control of research teams and partners (such as shifts in external funding, revenue or business models). Such changes can happen at any point in a project, including in the gap between application and funding, or towards the end, when all parties have worked closely. In all cases, projects have to find ways to adjust and problem solve. Conversely, some projects have experienced a growth in involvement as organisational priorities of Associated Partners shifted towards the research.

The gap between a project application phase and funding award can appear long to non-academic organisations who are used to different time scales. It may be therefore be difficult for external partners to fully commit to a programme of collaboration until a funding award is announced. It can be useful to regularly engage in dialogue with external partners regarding their priorities and needs.

There have been times when a lack of transparency about the role and expectations of Associated Partners has caused tensions between project teams and Associated Partners. For example, one HERA Cultural Encounters project set out with a clear aim of influencing policy and had named a European Policy Institute as an Associated Partner during the proposal phase. Once the award was announced and work commenced, the Associated Partner made it clear that they were the body that did policy work and not the research team. This resulted in a shift in priorities for the research team and a lessening of involvement in the project from the Associated Partner.

Issues of academic integrity: critique vs advocacy.

In working with Associated Partners, HERA project teams have encountered Associated Partners who simply want a research team to endorse the work they do and to avoid asking difficult questions regarding the working practices of industry, contested histories or ethics. Examples of these tensions include HERA researchers working alongside travel companies to deliver talks to tourists about the damaging consequences of tourism in the Arctic region (JRPII: Arctic Encounters) and festivals attempting to edit the historical work researchers were carrying out in order to play down criticism of their pasts and moments of contestation (JRPI: Rhythm Changes). Within these contexts, Associated Partners may feel that research work that is too critical of cultural practices (even when they are historically situated) could lead to reputational damage; organisations may want researchers to endorse the work they are doing in order to present a ‘cleaner’ version of their pasts, policy decisions, or colonial histories. In most instances, transparency in outlining the nature of research and potential findings is key to ensuring a productive relationship.

Personnel changes

The strength of partnerships between HERA projects and Associated Partners often lies in the close relationships formed between researchers and individuals working in external contexts. When key personnel leave partner organisations, collaborations between project teams and Associated Partners can weaken. In most instances, it is good to ensure that clear agreements are in place and that communication between research teams and Associated Partners is not limited to personal relationships.

Pressure of working with national organisations

In putting together project proposals, HERA teams often feel pressured to include Associated Partners of national or international standing (e.g. national archives, museums, broadcasters), usually in an attempt to demonstrate the national and international significance of the research and thus strengthen the application. However, there have been several examples where, once projects have commenced, these national organisations had limited time for engagement due to shifting demands, changing priorities (as discussed above), limited resources, or policies that mean they cannot be seen to favour one research consortium over other requests. When planned partnerships with national organisations have stalled, HERA projects have often found rewarding and meaningful collaborations with local partners, ranging from city galleries to local history museums and specialist archives.

Capitalising on unexpected opportunities

The changing priorities of Associated Partners often force project teams to seek alternative partnerships. However, once research is under way, such partners are often relatively easy to find. In many cases, projects have been approached by stakeholders they had not written into the original project outline. Thus, most projects will be presented with opportunities to develop additional collaborations with new partners. Some of these may be more useful than others and projects need to decide which opportunities work best for them and offer the best research and impact outcomes. Whilst new partnership working is obviously time and resource intensive, some of the most fruitful and impactful partnerships have occurred through collaborations formed following the announcement of awards.

The HERA Knowledge Exchange Steering Group has established a Knowledge Exchange award scheme that can help to support projects to deliver KE and public engagement activities that have the potential to lead to impact not foreseen at the proposal stage of the project. Awards (usually between €5,000-€10,000) can be used to help projects develop new relationships with partners.

When relationships breakdown, don’t work or fall through

Sometime partnerships conceived at the project proposal stage simply do not materialise. Researchers and partners find that there are no longer mutual interests in undertaking research and so new partnerships can be sought. However, there are also times when partnerships break down once research is underway. This can happen when the clarity of the partnership and mutual benefits are unclear, or where personal relationships become breakdown. The Knowledge Exchange section of this toolkit offers some tips on Developing a Successful Partnership.


Scaling Up Impact

Impact does not happen overnight and it is rare that humanities impact happens in a single big splash. Instead, impact is more frequently something that grows incrementally out of a relationship with non-academic partners. Partners may be the direct beneficiaries of the research or they may act as brokers or gatekeepers to wider social benefits to the research. In both cases, trust and belief in the research is vital to embracing the benefits it may offer.

Stimulating impact usually starts by developing meaningful relationships between HERA project members and Associated Partners, where research questions are co-produced and the potential benefits of research are discussed. These conversations build the trust that is the foundation for impact. Working on ‘safe’ collaborations that are of obvious mutual benefit to both partners and project researchers can also help to build trust and grow impact incrementally.

Even if you have big ambitions it can be useful to start small. Testing out collaborations and scaling them up once both sides have developed confidence can be a good way forward. Small to medium size, or local, organisations often make the ‘getting to know each other’ process easier than large, heavily managerial organisations. They may also be willing to introduce you to other partners with whom they work, developing scalability and sharing research benefits in an organic manner. Be realistic in terms of whether the relationship you have with your APs is ‘real’ or more of a ‘headline’.

Some of the most impactful HERA projects have worked with small groups of people and have had deep, long-lasting effects on individuals by scaling up contact or interventions with these groups over the project duration. Other projects have reached out to many thousands of people and have scaled up interventions by increasing the number of people who benefit from the research, although the impact on individuals may been shallower and more transient. Both these approaches (and those in between) are valid ways of scaling impact. In all cases, a period of testing and gradual building of impact can be useful in ensuring success.


The Politics and Ethics of Impact

Impact is frequently assumed to be positive but not all impacts are necessarily beneficial. There have been rare cases where HERA projects decided to halt an intervention or relationship because they recognised that the anticipated benefits were unlikely to materialise and negative impacts might have occurred; we don’t always know how research will affect behaviour. It is therefore incumbent upon humanities researchers to consider the ethical and moral dimensions of their work.

The nature of humanities research means that scholars are often acutely aware of their positionality and that of others. This has been particularly important for projects working, for example, with indigenous groups, under-privileged or socially marginalised communities. It is therefore important to consider the question, ‘Whom do we speak for?’. We can also ask about the relationship between humanities research and political activism. Is this part of the social role of the humanities? To what extent might working with some APs compromise academic integrity? Can a desire to ‘help’ sometimes be misplaced?


Common Concerns and Pitfalls

Concern: Impact monitoring takes a lot of time and effort that I ought to be directing towards my research.

Impact monitoring does require investment of time and energy but it offers research benefits, can offer new research directions or opportunities, and is necessary in order to understand the effects of the research. Impact monitoring can be done in a relatively light touch way using a variety of methods (see above). The key is to ensure that you put in place monitoring for each public engagement and knowledge exchange activity, and engage in regular dialogue with partners.

Concern: I cannot pay staff time for Associated Partners from my budget. How can I expect impact?

Funding structures are not always ideal. Talk to the HERA Handling Agency about how you can use funds to help associated partners. Even if you cannot pay for staff time, you may be able to help with other kinds of costs to facilitate participation in the project. The HERA experience is that even if you cannot pay for staff time, if stakeholders see benefit in your research then impact will follow.

Concern: My project doesn’t lend itself to impact. I feel that I am being pushed in a direction that compromises freedom of intellectual enquiry.

You are not being asked to change your research questions. Not all projects can be expected to be equally impactful.


FAQs

Q: What is the difference between dissemination and impact?

A: Dissemination is the means by which findings are sent out into the world, such as publication, films, blogs, conversations, presentations or exhibitions. Impact is the effect that these findings have on people – how do they change what they do as a result.


Useful Resources

During the early months of 2020, a survey was designed and sent out to researchers previously involved with HERA-funded projects. As part of this survey, we asked researchers to tell us about the techniques, processes and tools they used to monitor the impact of their work. Researchers were asked to list those resources, and to indicate when they were used. Some researchers created resources during their projects, before moving to other techniques once their projects had ended. Others maintained use of a certain set of techniques both during and after the official project period. Researchers were also asked whether they would be prepared to share some of the resources they used with other HERA-funded projects.

In this section, we present some examples of how different methods for monitoring and evaluation have been used by HERA projects, along with some comments about that process provided by survey respondents. Alongside this, we highlight some other potentially useful resources you may wish to consider in your own work.

Collection of social media data (e.g. Twitter mentions)

It is now common for research projects to have an online presence in the form of a project website, or on social media channels. Both are useful ways of developing public engagement and disseminating information and findings about a project. These channels are also locations where members of the public can engage with your work through discussion and sharing. The HERA-funded Identity, Citizenship and Nationhood in the Post-Genome Era is one such example. This project’s Twitter account showcased their work, and situated the project within debates and activities related to their research area through sharing related tweets.

Tweet from the HERA-funded Identity, Citizenship and Nationhood in the Post-Genome Era project

Tweet from the HERA-funded Identity, Citizenship and Nationhood in the Post-Genome Era project

There are a number of ways evidence of this type of engagement can be relatively easily gathered and analysed. With a small number of freely available tools, data around a social media profile or a specific hashtag can be gathered and analysed, leading to useful insight regarding how a project or particular activities are being reaching the public. The following quote from a HERA-funded researcher responding to the HERA survey, demonstrates how social media data can be useful in terms of measuring, monitoring and growing engagement:

“As the project involved some specific social media projects (using Tumblr and Twitter), data was useful in relation to tracking our target audience and their engagement in the project. Social media and press coverage was also used to drum up interest in the project conference and to give a voice to participants and to capture the use and reach of the project more broadly.”

If you’re considering using social media in similar ways, some useful tips would include

  • Setting up social media accounts and monitoring at the beginning of a project, and - if using more than one channel - try to select a username that is available on all channels.
  • Set up monitoring and data capture before you begin using social media channels, so you can capture activity as it develops - most social media channels will limit the extent to which you retrospectively gather this information.
  • Consider using a unique #hashtag and encourage others to use that in discussions.
  • Discuss with your project team how the channel will be used. For example, will you use it simply to promote project activities, or will it be used to engage in wider debates in your field?

Further reading on collection of social media data

The Social Media Analytics: Using Data to Understand Public Conversations guide from the Digital Media Research Centre at QUT (Australia)

Edited by academic researchers and published via MIT Press, Digital Research Confidential: The Secrets of Studying Behavior Online provides behind-the-scenes stories of how Internet research projects actually get done.

The How to Use Twitter Analytics: The Complete Guide for Marketers website from social media company Hootsuite provides an overview of the analytical tools available within the Twitter interface.

Audience measurement (e.g. ticket sales, visitor numbers)

Regardless of your specific research area, it is likely your planned activities will involve the organisation of one or more public-facing events at various stages of your research project. Examples of public events could include:

  • Initial consultation events with stakeholders and communities
  • Training events for volunteers and research staff
  • Symposia
  • Exhibitions
  • Performances

During these events, and depending on the stage you are at in your project, your aims will likely be related to areas such as imparting project information, gathering responses or other primary data, or the dissemination of findings. Each event type affords the opportunity for your project to capture information about - and from - the communities of stakeholders your project may be impactful for.

Blog post describing an event organised by the HERA-funded project, Music Migrations in the Early Modern Age: The Meeting of the European East, West and South

Blog post describing an event organised by the HERA-funded project, Music Migrations in the Early Modern Age: The Meeting of the European East, West and South

Collecting information on public or stakeholder visitor numbers can also be useful in other areas of your project, such as dissemination or follow-up activities. As one HERA-funded researcher responding to our survey described, “As head of various conferences, I keep an eye on who participates, and were they are. We also target them for follow-up events (via e-mail, Facebook and out webpage).”

There are a number of ways you can gather information about your events, including:

  • Visitor numbers/ticket sales: Using a third-party booking system, such as Eventbrite, can provide an easy way of gathering data about the number of people who attend. In the case of an exhibition, or other type of event that takes place over a period of time, this data can be used to plot how attendance rose or fell over time.
  • Demographic information: As well as capturing how many people attend, and when, events are also an opportunity to capture information about your visitors.
  • ‘Vox pops’ and comments: During events, you can attempt to gather comments from attendees, either in the form of written comments - using something similar to a visitor book or evaluation form, or through the creation of audio, visual or video records of your event (see Creating Media section below)
  • Working with museums (or similar): If your event is held in conjunction with a project partner such as a museum, it is likely they will already be collecting information about visitor numbers as a condition of their own funding, or other for other organisational reasons. It is possible you will be able to negotiate access to some or all of this data, providing that access is within GDPR regulations.

Further reading on audience measurement

Eventbrite tutorial on how to gather data around your event.

Napoli, P.M., 2011. Ratings and audience measurement. The handbook of media audiences, pp.286-301.

Stein, R. and Wyman, B., 2014. Seeing the forest and the trees: How engagement analytics can help museums connect to audiences at scale. In Museums and the Web.

Taneja, H., 2016. Using commercial audience measurement data in academic research. Communication Methods and Measures, 10(2-3), pp.176-178.

Tutorial from Eventhosts.org on audience measurement.

Tutorial from OnThinkTanks on measuring the impact of events.

Collecting press and media coverage

Your host university will likely have a press office, media relations team or PR specialist(s) assigned to your research area, school or faculty. They can not only help you with identifying, negotiating, securing and evaluating media coverage, they will also have resources, systems and contacts which may help you to increase the profile, visibility and impact of your research. See also: creating a press release

Cover image of the Anthropology Today magazine, featuring coverage of the HERA-funded project, Identity, Citizenship and Nationhood in the Post-Genome Era

Cover image of the Anthropology Today magazine, featuring coverage of the HERA-funded project, Identity, Citizenship and Nationhood in the Post-Genome Era

Guidance, support and management of external communications by these experts can range from engaging on your behalf with print, online and broadcast journalists at regional, national and international levels, to planning a full media strategy or campaign, and developing audiences, focus groups, advocates, partners and other parties essential to your project. Media coverage, regardless of the platform or outlet, generally has a value or worth – either in advertising equivalent or through reader, listener or viewer reach – and can reinforce or supplement other marketing and communications methods such as paid-for online and offline promotion, social media, SEO (Search Engine Optimisation) and branding.

To achieve maximum success using this type of expertise and make the most of opportunities, it is critical that communications and media work are factored in to your research plan very early on. By incorporating PR into your strategy at funding bid submission stage, this can lead to positive campaign work and mainstream and sector-specific media coverage across TV, print and online. This in turn can lead to higher engagement with project participants, further industry/sectors partnerships, and deeper project impact across key demographics in key regional and national areas. Lyle Bignon, Senior External Relations Officer at Birmingham City University (UK)

Alongside this strategic activity, and if you are a Google user, you may also want to consider setting up Google Alerts around your project. The service will send emails when it finds new results—such as web pages, newspaper articles, blogs, or scientific research—that match a particular search term. Entering your project name, or specific elements of your project – such as reports or events – will You can also automate the writing of these results to a spreadsheet using the IFTTT service. See this tutorial on how to set up Google Alerts and have them written to a spreadsheet.

Further reading on collecting press and media coverage

This FastTrack Impact article outlines some of the different ways you can evidence impact from media engagement.

This European Commission factsheet provides an overview of media assessment tools and some tips on how to communicate the results to help evidence the impact of your activities.

From the Health sciences, a guide to measuring the impact of your media communications, which also contains a useful table explaining different types of impact and communications.

In an article for Nature, Dr Caroline Kamau outlines how she used TV, radio and publication interviews in her research.

This report from The Lear Center provides an overview of measuring media impact, including a section (p8) on how to define media impact.

Creating media to showcase impact (e.g. video shorts, podcasts)

Many people now regularly engage with online video and other digital media, such as podcasts. Internet-enabled devices are common, and on-demand media streaming services are increasingly popular. As such, creating media for this type or consumption, and with on-demand delivery mechanisms in mind, is a potentially useful way of reaching audiences with information about your research.

This type of content is also a dynamic way of showcasing any impact your work may have had. For example, if you work has helped a particular community or group of stakeholders understand a particular issue or concept, or else has involved that group in an activity pertinent to your research (such as a performance, or exhibition), then you may wish to capture that in video, photographic or audio form.

With the regular deployment monitoring and evaluation processes, a body of evidence around project activity, audiences and impact can be amassed alongside a research project’s main objectives and work packages designed to meet project milestones. Impact also frequently takes place after a project ends, and can take up to a decade for the benefits of a project to come to fruition. Where possible, it is therefore useful to continue regular light touch engagement with project partners and stakeholders after the official project end date.

The official YouTube channel of the HERA-funded project, Modernist Reinventions of the Rural Landscapes

The official YouTube channel of the HERA-funded project, Modernist Reinventions of the Rural Landscapes

1. Creating content

Seek assistance. Although creating audio and video content has in recent times been made easier by available technologies (it is possible, for example, to shoot and edit video on a Smartphone), the process can nevertheless be time-consuming and daunting. You may wish to consider building in a budget for this type of activity within your project plan, but this may not always be feasible. However, within your University, you may have access to resources and expertise that could assist you. For example, if you have a Media (or similar) faculty, you may be able to involve students who can use your video project as a means of developing their skills.

Try to keep it short and to the point. You may have hosted a conference and have filmed all of the talks. Whilst it may be advantageous to make these videos available online in some form, you may wish to consider producing a short, edited overview of the day for a more general audience.

Plan for regular content. If possible, try to think about a regular release of material and – when creating content – consider how it may be divided up into separate pieces that can be made available at different times. For example, in the aforementioned scenario where conference talks were filmed, you may want to consider releasing different talks and different times, each of which with some supporting promotion.

Think about channels, use and access. It is likely you will host digital media on one or more 3rd party channels. For example, it is likely that video content will be uploaded to YouTube, or a similar service. Before creating or editing your content, research how similar work has been presented and explore the affordances of the systems concerned. YouTube, for example, allows content creators to add captions to videos, which may be used to direct users to links elsewhere on the internet.

2. Promoting content

Create very short snippets for promotion. From a short, edited highlights video or podcast, consider also creating short ‘adverts’ that can be used on social media platforms and elsewhere. These could take the form of 30-second clips, or else still images, that can be used as a means of engaging users and directing them to longer-form content elsewhere.

Use Social Media and other channels. Once you have created some media content that showcases your input, you want that to reach as wide an audience as possible. If you have created social media or other online channels for your project (such as a website), you can use these to. Remember that the audience your project reaches on one system (Twitter) may be different to the audience you reach on another (Facebook), and these audiences may in turn be entirely separate from those who regularly read your project website. By promoting your media content across platforms, you will increase the likelihood of reaching a wider audience.

Speak to your University Press Office and project partners. The press/PR department at your host institution may be able to develop a media release around your content, and can also promote it via their internal and external communications channels. Likewise, and if your content features or discusses a project partner (for example, a museum), their PR department may wish to discuss ways it could be used.

Ask your audience to share, tag and comment. If people are engaging with your work in online environments, it is likely they have an interest in it. Can these audiences be mobilised to help widen the discussion? When posting links to your work on social media or other channels, encourage people to share it with others.

3. Measuring engagement

Many of the online channels you will use for media content (e.g. YouTube for video, Twitter for information sharing and discussion) will also have mechanisms for the capture of analytics. This information can be useful in two ways:

It can provide additional evidence for the reach of your work. The number of views, clicks, replies, comments, etc. can help bolster narratives around reach for a piece of work. Some channels also provide demographic information, which can help you understand and narrate the places / publics where your work is resonating.

It can help you develop better content in future. The engagement metrics offered by third party channels can also help you understand which types are working well.

Further reading on creating media to showcase impact

University of St Andrew guide to Showcasing research through content

ERC page showcasing podcasts created by researchers

In this blog post, Mark Read discusses ‘How to turn your research findings into a video that people might actually want to watch’.

Repository of academic podcasts – organised by discipline – from H-Net (Humanities and Social Sciences Online)

On this FastTrackImpact blog, you will find a discussion on ‘How to make a podcast that generates research impact in 10 easy (and free) steps’

The History of Philosophy Without Any Gaps and Sodajerker on Songwriting are two very different research projects that use podcasting as their primary means of dissemination.

Czaran, E., Wolski, M. and Richardson, J., 2017. Improving research impact through the use of media. Open Information Science, 1(1), pp.41-55.


References

References from the Public Engagement Toolkit

Caddy, J (ed). 2005. Evaluating Public Participation in Policy Making. OECD Publishing.

Barnett, C.; Mahony, N. 2011. Segmenting Publics. National Co-ordinating centre for Public Engagement (UK).

Burns, D; Taylor, M. 2000. Auditing community participation: An assessment handbook.

Föllmer, G. and Badenoch, A., 2018. Transnationalizing radio research: New approaches to an old medium (p. 314). transcript Verlag.

GDPR.EU. 2020. Complete guide to GDPR compliance. https://gdpr.eu

Jay, G. 2010. The Engaged Humanities: Principles and Practices of Public Scholarship and Teaching. Imagining America. 15.

Hennen, L.; Pfersdorf, S. 2014. Public Engagement - Promises, demands and fields of practice. The Engage2020 Consortium.

Morris Hargreaves McIntyre. 2020. Culture Segments Report.

National Co-ordinating Centre for Public Engagement. 2018. What is Public Engagement.

The Engage2020 Consortium. 2014. Public Engagement Methods and Tools.

The Engage2020 Consortium. 2014. Report on Current Praxis of Policies and Activities Supporting Societal Engagement in Research and Innovation.

Spicer, S. 2012. Evaluating your engagement activities - Developing an evaluation plan. University of Manchester.

References from the Knowledge Exchange Toolkit

Arts Council England. 2014. The Value of Arts and Culture to People and Society. An Evidence Review. Arts Council England.

Engaged Research. Society & Higher Education. Addressing Grand Societal Challenges Together. 2017. IUA.

IRC Council of Europe Report on Cultural Participation and Inclusive Societies 2016.

Crossick, G. 2009. So who now believes in the transfer of widgets? Goldsmiths University of London. https://www.theculturecapitalexchange.co.uk/wp-content/uploads/2016/06/Who-Now-Believes-in-the-Transfer-of-Widgets.pdf

Fazey, I., Bunse, L., Msika, J. Pinke, M., Preedy, K., Evely, A., Lambert, E., Hastings, E., Morris, S. and Reed, M. 2014. Evaluating knowledge exchange in interdisciplinary and multi-stakeholder research. Global Environmental Change: Human and Policy Dimensions 25: 204-220

Holm, P., Jarrick, A., and Scott, D. 2015. Humanities World Report. Palgrave Macmillan.

Kings College London and Digital Science 2015. The nature, scale and beneficiaries of research impact: An initial analysis of Research Excellence Framework (REF) 2014 impact case studies. Research Report 2015/01. HEFCE

Moreton, S. 2015. Rethinking ‘knowledge exchange’: new approaches to collaborative work in the arts and humanities. International Journal of Cultural Policy 22(1) 110-115.

Munro, E. 2016. Iluminating the practice of Knowledge Exchange as a ‘pathway to impact’ within an Arts and Humanities Research Council ‘Creative Economy Knowledge Exchange project. Geoforum 71: 44-51.

Responsible Partnering. Joining forces in a world of open innovation: guidelines for collaborative research and knowledge transfer between science and industry. 2009. EIRMA, EUA, EARTO, ProTon Europe.

Upton, S. 2013. Guidance on planning and demonstrating effective policy engagement. AHRC

Williamson, J., Cloonan, M., and Frith, S. 2011. Having an impact? Academics, the music industries and the problem of knowledge, International Journal of Cultural Policy 17(5): 459-474.

References from the Impact Toolkit

Academy of Finland, 2016. The State of Scientific Research in Finland 2016. Broader impact of research in society. Academy of Finland.

Bate, J, ed (2011), The Public Value of the Humanities. Bloomsbury

Benneworth, P.; Gulbrandson, M.; Hazelkorn, E. 2016. The Impact and Future of Arts and Humanities Research, Palgrave Macmillan.

Bulaitis, Z., 2018. Measuring impact in the humanities: Learning from accountability and economics in a contemporary history of cultural value

Hazelkorn, E., 2015. Making an impact: New directions for arts and humanities research. Arts and humanities in higher education, 14(1), pp.25-44.

Holm, P., Jarrick, A. and Scott, D., 2015. . Humanities world report 2015

Levitt, R., Celia, C., Diepeveen, S., Ni Chonaill, S., Rabinovich, L., and Tiessen, J. 2010. Assessing the impact of arts and humanities research at the University of Cambridge. University of Cambridge.

Martin, B. 2011. The Research Excellence Framework and the “Impact Agenda”: Are we Creating a Frankenstein Monster? Research Evaluation, 20/3: 247–54.

Muhonen, R., Benneworth, P. and Olmos-Peñuela, J. 2020. From productive interactions to impact pathways: Understanding the key dimensions in developing SSH research societal impact. Research Evaluation, Volume 29, Issue 1, January 2020, Pages 34–47.

Nussbaum, M. 2010, Not for profit: why democracy needs the humanities, Princeton University Press

Reale,E., Avramov, D., Canhial, K., Donovan, C., Flecha, R., Holm, P. Larkin, C., Lepori, B., Mosoni-Fried, J., Oliver, E., Primeri, E., Puigvert, L., Scharnhorst, A., Schubert, A., Soler, M., Soòs, S., Sordé, T., Travis, C., and Van Horik, R. 2018. A review of literature on evaluating the scientific, social and political impact of social sciences and humanities research, Research Evaluation, Volume 27, Issue 4, October 2018, Pages 298–308.

Reed, M.S. 2018. The Research Impact Handbook [2nd edition], Fast Track Impact.

Research Council of Australia 2018. Framework. Engagement and Impact Assessment. Australian Government, Australian Research Council.

Sivertsen, G. and Meijer, I. 2020. Normal versus extraordinary societal impact: how to understand, evaluate, and improve research activities in their relations to society?. Research Evaluation, Volume 29, Issue 1, January 2020, Pages 66–70,

Small, H. 2013. The Value of the Humanities. New York: Oxford University Press.

Sonkoly, G. and Vahtikari, T, 2018. Innovation in Cultural Heritage Research: for an Integrated European Research Policy, European Commission.