- Education and academic field
- Professional developer
- How time is spent
- Previous employment
- Collaboration and training
- Publications and citations
- Open source and DOI
- Good practices
- Tools and programming languages
- Job satisfaction
- Research software engineer
This section contains the information about the type of education the participants have, as well as their highest degree obtained.
We asked the participants, in which field they are working. With that question, it is possible to see which current field employed the most of RSE/RSD. The questions was specific to each country and was multiple choice. Each participant could choose several fields. We then calculate the different proportion by dividing each field by the total of participants that have selected at least one option.
- What is the highest level of education you have attained? (one choice list)
- In which discipline is your highest academic qualification? (one choice list)
- List any professional qualifications you hold (free text)
|Highest level of education for New Zealand||Count||Percentage||Percentage in 2018||Difference with previous year|
Alongside of question about education level we also asked the participants in which field they finished their highest level of education. Here again the propositions were specific to each countries so the comparison is difficult despite lot of overlapping in the categories.
|Field of education for New Zealand||Count||Percentage||Percentage in 2018||Difference with previous year|
|Physics and Astronomy||5||17.86||10.81||7.05|
|Electrical & Electronic Engineering||3||10.71||5.41||5.31|
|Geography & Environmental Sciences||2||7.14||2.7||4.44|
|Agriculture & Forestry||1||3.57||nan||nan|
|Classics & Ancient History||1||3.57||nan||nan|
|field of work for New Zealand||Count||Percentage||Percentage in 2018||Difference with previous year|
|Physics and Astronomy||8||28.57||24.32||4.25|
|Geography & Environmental Sciences||8||28.57||40.54||-11.97|
|Agriculture & Forestry||3||10.71||8.11||2.61|
|Business & Management Studies||2||7.14||0||7.14|
|Aeronautical & Manufacturing Engineering||2||7.14||5.41||1.74|
|Electrical & Electronic Engineering||1||3.57||10.81||-7.24|
|Anatomy & Physiology||1||3.57||2.7||0.87|
|Communication & Media Studies||1||3.57||2.7||0.87|
|Classics & Ancient History||1||3.57||0||3.57|
|Art & Design||0||0||2.7||-2.7|
|Accounting & Finance||0||0||2.7||-2.7|
In this section we investigate the relationship between RSEs/RSDs and their own experience in software development Understandably, we expect them having several years of software development experience. However, as shown in previous years, it is not necessarily reflected upon their own feeling of being considered as professional.
Questions in this section:
- Do you consider yourself a professional software developer? (Yes/No)
- How many years of software development experience do you have? (integer)
|Professional developer for New Zealand||Count||Percentage||Percentage in 2018||Difference with previous year|
|How many years of software development experience for New Zealand (without 95 percentile)||Results in 2022||Results in 2018|
RSE/RSE are supposed to be an hybrid role, compared to pure software developer. They bring a knowledge from their field but also are developing software. To capture this different tasks they may do during their work, we asked them how they spend their time but also how they wish to spend their time to investigate any difference between what they do and what they want to do.
Respondents were asked how much time is spent in a particular activity using a Likert scale from from 1 (None at all) to 10 (All my time).
The same questions asked them how much time they wanted to spend on these activities. With that it was possible to see if discrepancies exist between what they actually do and what they want to do.
To read the results, when the bars shift to the right (in blue), it means they reported positive values (from 6 to 10); when the bars are on the left (in red), it means they reported more negative values (relative to the scale). Each bar has a number that represents the percentage of participants that selected that value. The total bar represents 100%.
To calculate the difference between what they want and what they do, we subtract the answers to the the time that they wished to have spent from the the answer to actual time spent. It is therefore possible to understand the results as:
- The result is zero: The time spent matches, they do as much as they want.
- The result is negative: They wish to spend less time to do that activity
- The result is positive: They wish to spend more time to do that activity
All questions were asked on a 1 to 10 Likert scale.
- On average, how much of your time is spent developing software?
- On average, how much of your time is spent on research?
- On average, how much of your time is spent on management?
- On average, how much of your time is spent on teaching?
- On average, how much of your time is spent on other activities?
Several questions were about the participants’ previous job. The idea is to collect insights of their career path and understand what their motivations are to be an RSE.
We also asked the participants to rank the reasons why they chose their actual position among 8 different ones:
- Desire to work in a research environment
- Freedom to choose own working practices
- Desire to advance research
- I want to learn new skills
- Opportunity to develop software
- Flexible working hours
- Ability to work across disciplines
- Opportunity for career advancement
- The salary
- Where was your previous job based? (single choice)
- Rank the following factors dependent on how strongly they influenced your decision to accept your current position (ranking)
|Where the previous job was based for New Zealand||Count||Percentage||Percentage in 2018||Difference with previous year|
|This is my first job||1||4||nan||nan|
|Top reason to choose current job for New Zealand||Count||Percentage||Percentage in 2018||Difference with previous year|
|Desire to advance research||5||19.23||13.89||5.34|
|Desire to work in a research environment||4||15.38||22.22||-6.84|
|Flexible working hours||3||11.54||2.78||8.76|
|Opportunity to develop software||3||11.54||13.89||-2.35|
|Freedom to choose own working practices||3||11.54||22.22||-10.68|
|I want to learn new skills||3||11.54||5.56||5.98|
|Ability to work across disciplines||1||3.85||5.56||-1.71|
|Opportunity for career advancement||1||3.85||5.56||-1.71|
Questions in this section:
- Who uses the code that you write? (one choice)
- Do you always work with the same researchers, or do you regularly change the researchers you work with? (one choice)
- Are you part of a dedicated research software group within your institution? (yes-no)
- How many software projects are you currently involved in? (numeric)
- How many people who develop software typically work on your projects? (numeric)
- On average, how many times a year do you take part in providing training? (numeric)
- What training programs are you involved with? (free text)
|Developing code for others for New Zealand||Count||Percentage||Percentage in 2018||Difference with previous year|
|0 - Mostly me||2||7.69||2.7||4.99|
|5 - Mostly other people||8||30.77||32.43||-1.66|
|Working with same researchers for New Zealand||Count||Percentage||Percentage in 2018||Difference with previous year|
|Different researchers, same research group||6||23.08||8.82||14.25|
|Regularly change researcher(s)||13||50||41.18||8.82|
|Member of a dedicated group for New Zealand||Count||Percentage||Percentage in 2018||Difference with previous year|
|Number of software projects for New Zealand||Count||Percentage||Percentage in 2018||Difference with previous year|
|Number of software developers per projects for New Zealand||Count||Percentage||Percentage in 2018||Difference with previous year|
|Number of time per year providing training for New Zealand (without 95 percentile)||Results in 2022||Results in 2018|
RSEs is an hybrid role between a researcher and a software developer. We investigated both of these aspects concerning publication and dissemination of their work, one on the traditional aspect of it (publications and conference).
One essential aspect of career in academia is the publications and the conferences to gain recognition. However, the role of RSE being less about writing articles than creating the infrastructure and the software for the article to exist, there is some fear that they will fail to have recognition through the papers and conferences.
Questions in the section:
- In general, when your software contributes to a paper, are you acknowledged in that paper? (one choice)
- Have you presented your software work at a conference or workshop? (yes-no)
- At which conference(s)/workshop(s) have you presented your software work? (free text)
|Acknowledgment in paper for New Zealand||Count||Percentage||Percentage in 2018||Difference with previous year|
|Not mentioned at all||1||4.17||17.65||-13.48|
|Acknowledged in the main text||2||8.33||8.82||-0.49|
|Acknowledged in acknowledgements section||6||25||20.59||4.41|
|Named as co-author||15||62.5||44.12||18.38|
|Named as main author||nan||nan||nan||nan|
|Did you participate in conference for New Zealand||Count||Percentage||Percentage in 2018||Difference with previous year|
RSEs is an hybrid role between a researcher and a software developer. We investigated both of these aspects concerning publication and dissemination of their work, one on the traditional aspect of it (publications and conference) and, as developed here, on the more software aspect (open source and DOI).
We asked the participants if they have ever released their work under open source licence but also questions about the referencing system. We asked them how often they reference software, and if they use DOI for it, and which tools for it.
We also asked them if they have an ORCID ID, a system that gives a unique reference ID for the researcher.
Questions in this section:
- How often do you use an open-source licence for your software? (likert scale)
- How often do you reference software directly or the papers describing the software? (likert scale)
- How often do you associate your software with a Digital Object Identifier (DOI)? (likert scale)
- Which tools do you use to mint a DOI (e.g. local library, Zenodo)? (free text)
- Do you have an ORCID ID? (yes-no)
|Open source use for New Zealand||Count||Percentage||Percentage in 2018||Difference with previous year|
|1 (None at all)||nan||nan||nan||nan|
|10 (All the time)||13||50||50||0|
|Citation of software for New Zealand||Count||Percentage||Percentage in 2018||Difference with previous year|
|1 (None at all)||nan||nan||nan||nan|
|10 (All the time)||7||33.33||29.41||3.92|
|Use of Digital Object Identifier for New Zealand||Count||Percentage||Percentage in 2018||Difference with previous year|
|1 (None at all)||nan||nan||nan||nan|
|10 (All the time)||2||9.52||2.94||6.58|
|Using ORCID for New Zealand||Count||Percentage||Percentage in 2018||Difference with previous year|
This section comprises sections that focus on the technical and development aspects of the RSEs’ work. They aim to understand good practices in developing software.
We chose two broad measures to provide an insight into sustainability: the bus factor and technical hand over planning.
The bus factor is a measure of the number of developers who understand a specific software project and could, with only a cursory review of the project, maintain or extend the code. A project with a bus factor of 1 is completely reliant on only one developer. If this developer finds new employment, becomes ill or is hit by the titular bus, then the project will fail. A high bus factor provides some confidence that the project can be sustained even if a developer leaves.
A technical hand over plan is used to introduce a new developer to a software project. These plans cover basic information, such as the license and location of the software, a repository, a description of the software architecture, a summary of development plans and any other information that a new developer would need to understand the software. A project that has written (and maintained) a technical hand over plan can withstand the departure of a developer, even a key developer, significantly better than one without such a plan.
Developing software requires a set of good practices to ensure the quality of the subsequent analysis as well as the robustness of the developed software, to name a few of important aspects. We wanted to see if the implementation of some simple but essential good practices were a reality beside the bus factor and technical hand over planning.
When developing software, version control and testing can be seen as tool to enhance the quality of the developed software, especially considering the importance of code review and sharing in public funded places such as academia.
For testing, we asked the participants to choose any of the following testing methods:
- Automated testing with continuous integration
- Test engineers conduct testing
- Developers conduct own testing
- No formal testing but users provide feedback
- No formal testing
Test engineers conducting testing is the most robust testing method but may not be possible in smaller projects while no formal testing should not occur in any ideal scenario, regardless of the size of the project.
We also asked the participants if they use any version control tools through a list of choice. And finally we asked them which repository they are currently using for their most important project.
|Bus factor for New Zealand||Count||Percentage||Percentage in 2018||Difference with previous year|
|Presence of transition plan for New Zealand||Count||Percentage||Percentage in 2018||Difference with previous year|
|Use of version control for New Zealand||Count||Percentage||Percentage in 2018||Difference with previous year|
|Testing strategies for New Zealand||Count||Percentage||Percentage in 2018||Difference with previous year|
|No formal testing||3||10.71||16.22||-5.5|
|No formal testing but users provide feedback||9||32.14||40.54||-8.4|
|The developers do their own testing||17||60.71||78.38||-17.66|
|Test engineers conduct testing||3||10.71||0||10.71|
|Automated testing with continuous integration||15||53.57||0||53.57|
On technical details we wanted to know which of the programming languages are mostly used by the RSEs. We give them a multi-choice list inspired by the results published by Stackoverflow.
We also wanted to know which operating system they use for work.
Questions in this section:
- Which operating system do you primarily use for development? (one choice)
- What programming languages do you use at work? Please select all that apply. (multiple choice)
|Programming languages for New Zealand||Count||Percentage||Percentage in 2018||Difference with previous year|
|other. What programming languages do you use at work? Please select all that apply.||1||3.57||0||3.57|
|Operating systems for New Zealand||Count||Percentage||Percentage in 2018||Difference with previous year|
Job satisfaction is an essential pulse to take about a community’s health. It helps to track the evolution and the current state of the RSEs within their role and to catch any sign of structural or organisational dysfunction that are translated into well-being. There are a lot of different metrics to measure the quality of a job on a personal and psychological level . Several models exist to understand the link between different factors of job satisfaction and turnover intention –. Turnover intention is an important measure that is highly associated with the risk of employees leaving the organisation . Job satisfaction is important in retaining RSEs. Perceived employability provides information on how workers values their own skills in regard of the market. To measure the different attitudes toward the RSE role, we used scales that have been created in , , , . These are Likert scale , which are 5 point ordinal scales graduated from Strongly disagree to Strongly agree. Each scale is composed of several so called items (i.e. questions) that each measure one attitude.
Beside these specific concepts we asked more general question about their satisfaction in their current position and their satisfaction with their career in general with a range of answers from 0 (not at all satisfied) to 10 (completely satisfied).
The specific questions about their job satisfaction reflect, in general, the same opinion as the two more generic questions. However, the granularity helps to identify a couple of issues that would not appears with generic questions:
- Recognition: These questions ask if the RSEs feel that they receive enough information about their work and their performance.
- The turnover intention: These questions aim to measure the desire to quit their current position.
- The perceived employability: This concept is linked to the previous one. People may not have the intention to leave their jobs, not because they like it, but because they fear they are not employable.
- The possibility of progression: This question aims to study the possibility of evolution for the RSEs, if information is available and if they see a possibility of evolution within their current career. This is the only questions that clearly received negative answers.
Questions in this section:
All questions were asked in a Likert scale.
- In general, how satisfied are you with your current position?
- In general, how satisfied are you with your career?
- Do you feel that your contribution to research is recognised by your supervisor/line manager?
- Do you feel that your contribution to research is recognised by the researchers you work with?
- Do you feel that your contribution to research is recognised by your institution?
- How often do you consider leaving your job?
- I would accept another job at the same compensation level if I was offered it
- It would not be very difficult for me to get an equivalent job in a different institution
- My experience is in demand on the labour market
- It is likely that I will gain a promotion within my current group
- The process I have to complete to gain a promotion is clear and understandable
- There are many opportunities within my chosen career plan
- It is likely that my next position will be an Research Software Engineer / Research
- B. Aziri, “Job satisfaction: A literature review,” vol. 3, no. 4, pp. 77–86.
- N. De Cuyper, S. Mauno, U. Kinnunen, and A. Mkikangas, “The role of job resources in the relation between perceived employability and turnover intention: A prospective two-sample study,” vol. 78, no. 2, pp. 253–263.
- A. B. Bakker and E. Demerouti, “The job demands-resources model: State of the art,” vol. 22, no. 3, pp. 309–328.
- G. H. L. Cheng and D. K. S. Chan, “Who Suffers More from Job Insecurity? A Meta-Analytic Review.” vol. 57, no. 2, p. 272.
- E. R. Thompson and F. T. Phua, “A brief index of affective job satisfaction,” vol. 37, no. 3, pp. 275–307.
- L. Greenhalgh and Z. Rosenblatt, “Job insecurity: Toward conceptual clarity,” pp. 438–448.
- R. Likert, “A technique for the measurement of attitudes.” vol. 22, no. 140, p. 55.
In this section we wanted to know if the participants are member or not of local organisations and if they are interested to participate to conference specific for RSE.
We also asked them to tell them which skills is important as RSE and which they and to acquire for their current role.
- Are you a member of an association of Research Software Developers (e.g. AUS-RSE, CANARIE, DE-RSE, NZ_RSE, UK RSE, …)? (yes-no)
- Would you be interested in joining such an organisation? (yes-no)
- What is important for such an organisation? (multiple choice)
- Would you like to attend a conference about software development in academia? (yes-no)
- How did you learn the skills you need to become an Research Software Engineer / Research Software Developer? (free text)
- What three skills would you like to acquire or improve to help your work as a Research Software Engineer/ Research Software Developer? The skills can be technical and non-technical (free text)
|RSE Member for New Zealand||Count||Percentage||Percentage in 2018||Difference with previous year|
|Joining a RSE/RSD association for New Zealand||Count||Percentage||Percentage in 2018||Difference with previous year|
|What is important for such an organisation for New Zealand||Count||Percentage||Percentage in 2018||Difference with previous year|
|Research software standards and interoperability definition||8||28.57||8.11||20.46|
|other. What would you hope to get out of such an organisation (check all that apply)?||3||10.71||0||10.71|
|Attending a national conference of RSE/RSD for New Zealand||Count||Percentage||Percentage in 2018||Difference with previous year|