CW20 - 2020-03-31 to 2020-04-02
Zeta - HP6-CW20
Hackday Idea Proposer: Emma Rand
“Storyboarding Sustainability”
Context / Research Domain
Many research domains where PIs may not have an awareness of reproducibility and sustainability best practice, may not consider it is relevant to their group or may not know where to start.
Problem
PIs are not always aware of the need to consider sustainability from the start of their project. They may be unable to reproduce data, e.g. reproducing figures which were created by a PhD student who has moved on. They may not build time into grants for ensuring sustainability/reproducibility. Alternatively, the PI is aware of gaps in their understanding and little idea of where to start addressing this problem.
Solution
We want to produce a storyboard/script for a 10 minute video which can be sent to PIs. The video will:
- Make the point that it applies to their research group
- Outline clear benefits of working sustainably
- Outline issues that arise by not doing so
- Suggest key questions they can ask their group members
- Signpost some fundamental small steps they can do quickly/easily
- Signpost training resources for their group members and for themselves.
The script and storyboard will be made available on GitHub so that groups or institutions can easily produce their own video. Ideally, it will be easily tailored to different domains, e.g. ‘hard’ sciences, social sciences, digital humanities.
We could ask our CW20 attendee colleagues for horror stories for non-sustainable approaches to give anecdotes.
Diagrams / Illustrations
You can include diagrams in this section. Please ensure you have the right to use the image(s), and include an attribution if applicable.
1. Output would be a storyboard for a video (~10 mins) to persuade PIs to lead their research groups into working sustainably.
2. The key themes:
1. Identify what best makes the point that it applies to their research group even if they don’t do software. Needs to be encapsulated in the video title
2. Articulate the imperatives/benefits of working sustainably in a way PIs will recognise as directly useful to them in terms of saved time/increased productivity or impact or research integrity
3. Suggest key questions they can ask their group members
4. Signpost some fundamental small steps they can do quickly/easily
5. Signpost training resources for their group members and for themselves.
Tell a story: follow a PI through their journey to working more sustainably. Graphic novel. Somebody shows a PI that is is do-able and what to do
- Identify what best makes the point that it applies to their research group even if they don’t do software. Needs to be encapsulated in the video title
- Relatable character and reference ‘scandals’ in repro
- Power pose - did not replicate: newspapers headline “Power posing doesn’t replicate!” ?
- Excel gene accession example?
- “Ghost” of past code/data/PhD students/PIs
- Outline clear benefits of working sustainably
- Saving time and money
- Read reviewers comments asking for a change to a figure; frustrated PI trying to find files, recreating a figure from scratch vs a PI just changing a variable and pushing a button.
- Phd student relay vs journey that each phd student has to start
- Building research group resources
- Have a virtual phd student from the past inducting/training new phd students. Or, in a similar, futuristic scenario that’s impossible for now, we could picture a lab/department member backing up their mind’s drive as a way of cumulative knowledge and version control. The final message would be that, at present, this is done on lab logs and databases, StackExchange, Git/GitHub,…
- Increasing impact (Ref), increasing citations and visibility, more collaborations, raising personal/group profile. Examples? Reference for effect:
- Increased citations with open data: https://arxiv.org/abs/1907.02565
- This is more about open access, so maybe not quite it though.. (https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0203156)
- Increased connections & networks - Cross domain connections. Access to a world-wide support network
- Saving time and money
- Outline issues that arise by not doing so
- Collect. Mistakes.
- Signpost some fundamental small steps they can do quickly/easily (need to be high level e.g., encapsulate notions of version control rather saying learn git).
- Suggested techniques (and then have corresponding resources listed later):
- Recording general practices such as contacting specific technical support, SSI, library, etc. For instance, when a Freedom of Information Request is made, it is published, to save processing time in future.
- Version control (including hosting)
- Data repositories
- List of resources used
- …
- Central place to share and collaborate
- E.g. Open Research Group github organisation/ gitlab, shared drive
- Have a system for organising shared files (e.g. think FAIR but locally)
- Find people doing it/ supporting it: Institute’s own open science group, library. RSE group, UKRN, domain specific, user groups
- Signpost training resources to your group members
- Highlight resources such as the Carpentries, Turing Way, the Software Sustainability Institute
- Suggested techniques (and then have corresponding resources listed later):
STORY BOARD
INTRO
| |
WHY DO OPEN & SUSTAINABLE RESEARCH?
| |
| ISSUE 1 Replication issues: Power pose - did not replicate: newspapers headline “Power posing doesn’t replicate!”? | SOLUTION 1 Code-based analysis (vs point-and-click like SPSS) allows you and others to audit. Releasing data and code allows others to attempt to replicate. +++? |
| ISSUE 2 Sharing data (whenever possible) and results (including null results) is a moral obligation (research funding often from taxes) | SOLUTION 2 Share Data on an open data repository (your institution might have one), preferably one which gives a DOI or permanent link? |
| ISSUE 3 Excel gene accession example? | SOLUTION 3 |
| ISSUE 4 “Ghost” of past code/data/PhD students/PIs Phd student relay vs journey that each phd student has to start Building research group resources Have a virtual phd student from the past inducting/training new phd students. Or, in a similar, futuristic scenario that’s impossible for now, we could picture a lab/department member backing up their mind’s drive as a way of cumulative knowledge and version control. The final message would be that, at present, this is done on lab logs and databases, StackExchange, Git/GitHub,... | SOLUTION 4 |
| ISSUE 5 Read reviewers comments asking for a change to a figure; frustrated PI trying to find files, recreating a figure from scratch vs a PI just changing a variable and pushing a button. | SOLUTION 5 Easy to re-run code if written following best practices and well documented. |
| ISSUE 6 No one’s citing my work :( | SOLUTION 6 increasing impact (REF), increasing citations and visibility, more collaborations, raising personal/group profile. Examples? Reference for effect: Increased citations with open data: https://arxiv.org/abs/1907.02565 https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0203156 |
| ISSUE 7 I’m all alone, no one gets me :( | SOLUTION 7 Increased connections & networks - Cross domain connections. Access to a world-wide support network. “Found my tribe!” |
| ISSUE 8 I do not know/understand this. This is too difficult. I have never written code before. | SOLUTION 8 Gaining new skills, increased confidence and personal development. |
HOW DO I GET THERE?
| SMALL STEPS YOU CAN TAKE NOW
|
FURTHER RESOURCES
| |
The presentation (5 minutes)
Demo consists of walking through the slides with an introduction of the aims.
Criteria
5minutes - scored 1 - 5 in each category
1. Novelty, creativity, coolness and/or usefulness
Define problem clearly:
We are doing a sales pitch for a video which explains to PIs/researchers the benefits of performing “sustainable research”. We developed a number of slides, which we’ll show in the demo (and are in this link). The slides form a storyboard of the video, with accompanying notes explaining the narrative. This document further details the creative discussion and motivation. We intend the video to be appealing and not too information dense with the aim of motivating change.
The proposed video aims to promote sustainable research practices across all scientific domains - casting a wide net over all PIs and group or lab leads that need help and guidance in this area but do not necessarily identify themselves as people who write scientific code. PIs who haven’t previously been exposed to best practice should become aware of the benefits (and the pitfalls of not following).
2. Implementation and infrastructure
The concepts included in the storyboard are not novel, but the formulation of the video storyboard is.
The storyboard can be shown in the demo and conveys our vision of what the video should contain and the style of the presentation.
Video made with OBS-Studio and stock music from: https://www.bensound.com
3. Demo and presentation
Emma Rand, Reka Solymos, Iain Barrass, Pablo Bernabeu, Esther Plomp,Aleks Nenadic Jonathan Frawley
(jonathan sharing screen paused on first slide) Introduction (Emma): 30 second intro what we were aiming to do - writing a storyboard for a video which would be a sales pitch for working sustainably to PIs who may not identify their research groups outputting software.
(jonathan sharing screen play video )Mock-up video: https://drive.google.com/file/d/1Bh89T7ALt3qxuVeUGT7TBgsSxZrON5zl/view
(jonathan sharing screen pauses video and switches to github )Next steps (Aleks):
- How to get involved with the project: https://github.com/anenadic/research-sustainability-storyboard/blob/master/README.md
- Documentation for the project and a list of issues that need working on
- Help us recreate the video and publicise/share the storyboard at your groups and institutions
Judging criteria (Pablo):
- How we’ve met the criteria, mentioning concrete examples
Jonathan to show this!
4. Project transparency
For generating the storyboard (and these notes) we used various collaboration tools (Zoom, Slack, Google Doc and Slides) shared between the team members. The team did not generate any source code but the project documentation is kept at GitHub: https://github.com/anenadic/research-sustainability-storyboard.
5. Future potential
One hopes that the storyboard would be developed into a full video. Equally, the storyboard remains available for other interested people to develop (including customizing it for a particular specific setting/discipline).
We hope that the storyboard will inspire and encourage more PIs and group leads to start implementing (some of the) best practices around open and reproducible research and joining the community.
The idea of this video development process will hopefully inspire similar efforts reflecting other aspects of open research.
6. Team work
The work was amenable to being split between team members. Once we had content arranged, individual slides could be generated in parallel. Art work could proceed (and the “clean” versions created) independently; these notes were also written. Overall final review was completed with all team members.
This work was non-technical and mostly creative.
We definitely had more ideas working together than we would separately. We used google slides.
Atmosphere was good, everyone contributed in interesting and unexpected ways. There were no real disagreements. Discussions
Everyone was very friendly and we had fun. Agreed!