Scientometric analysis of the publishing behaviour of EU + UK authors in engineering education and further afield

ABSTRACT

The authors present a scientometric procedure comparing engineering education (EE) publication output in different countries. Selected European countries were compared using a snapshot of authors published in EE journals during a two-year period – 895 in all. The entire publication careers of these authors – 39,322 publications – were analysed to determine the breakdown of educational and non-educational publications. Spain and the UK produced the most publications, and we propose explanations based on relevant national policies. France, Germany, and Italy had notably fewer EE publications relative to their general engineering and science research outputs, whereas Portugal, Ireland, and three Nordic countries were the opposite. Countries varied widely in the ratio of educational to non-educational publications. Non-educational publications typically had a greater impact on authors’ h-index values. We believe this procedure can longitudinally map and compare EE publication output in and across Europe, providing a valuable resource for policy-makers and researchers in the region.

KEYWORDS:

• Scientometrics
• citation analysis
• engineering education research
• Europe
• bibliometrics

Introduction

Published research on EE can be broadly divided into two groups: studies that looked at broad tendencies in the field and those that focused on particular countries (e.g. US, UK, Portugal, Australia, Malaysia) or small groups of countries (e.g. the Nordic countries, Spain and Portugal).

Within a European context, the authors only identified one study that takes a Europe-wide perspective to look at EE publication patterns (Lima and Mesquita 2018) and the approach it adopted has significant limitations. The present study aims to provide a more complete comparison of European output by applying scientometric analysis. In addition, we propose that our procedure can be adopted in future work to track EE publication evolution within the region.

We firstly take a snapshot of 895 authors in European countries that published in the leading EE journals in the years 2018 and 2019. We then go on to look at the entire publishing careers of these authors.

Literature review

There has been a growing interest in the evolution of EE as a field of inquiry since the turn of the century. Froyd and Lohmann (2014) used criteria for defining the field of science education research (Fensham 2004) to point out that while engineering education has been seen as an area of interest for educators since the end of the nineteenth century, over the last two decades there have been significant indicators of a transition to an interdisciplinary, more scholarly field of scientific inquiry into engineering education.

However, Klassen and Case (2022) recently published an article that takes a global look at the scholarship in this field to date and they conclude that ‘The argument for engineering education research as a strongly classified field has served value in establishing legitimacy and associated resources in some contexts but has not yet delivered a unique knowledge base for such legitimation’.

We have only been able to identify one study that compared all the European countries in terms of their EE publication output. This investigation by Lima and Mesquita (2018) analysed the Scopus database using the search-term ‘engineering education’ and identified 4604 journals articles from European affiliated authors published between 1970 and 2017. Based on their study, these authors concluded that engineering education research was growing in Europe and had surpassed the USA by 2018, but that Europe’s output relative to the whole world was decreasing. However, as these authors based their entire analysis on the presence of this single search-term, it is likely their sample included many articles that were technically rather than educationally focussed. Of the 25 journals they included, many did not have education as their main focus: eight were engineering journals while four were devoted to educational technology. In addition the authors did not apply any value criterion to their search results.

Moving from the general to the particular, we find a range of studies:

Borrego and Bernhard (2011) have compared Northern and Central European approaches to EER with those of the US using a framework from the European didaktik tradition, which focuses on answering the w-questions of education. Borrego and Olds (2011) employed an analysis of National Science Foundation funded projects as a way of characterising development in engineering education research in the US while Williams and Alias (2011) used a scientometric approach to track the evolution of EE publication in Malaysia. Dart and Cunningham-Nelson (2020) used textural analysis to identify publication trends in the Australasian context.

Neto and Williams (2017) analysed historical studies of the European Journal of Engineering Education (EJEE) to provide insights on the European context. Other studies looked at specific European national contexts such as the Nordic countries, the UK and Portugal (Edström et al. 2018; Nyamapfene and Williams 2017; van Hattum-Janssen, Williams, and Nunes de Oliveira 2015; Williams, Wankat, and Neto 2018; Wint and Nyamapfene 2021).

A small set of data from the Australian context was originally reported based on analysis of three EE journals (Valentine 2020). The present authors went on to compare the EE publication profile of scholars based in two Southern European countries, Spain and Portugal (Valentine and Williams 2021a), and four Nordic ones, Denmark, Sweden, Finland and Norway (Valentine and Williams 2021b), and these six European countries with Australia (Valentine and Williams 2021c).

While the publications listed above present a range of scientometric approaches that have been gathering traction to study engineering education publications in recent years, related fields such as science education (Wang et al. 2023), computing education (Apiola et al. 2022; López-Pernas, Saqr, and Apiola 2023), and mathematics education (Akin and Güzeller 2022) have also seen increasing attention being directed to scientometric analysis.

Motivation for the study

In line with the EJEE scope which encourages submissions that combine scholarliness with usefulness for improving engineering education, the primary motivation for collecting and analysing the data presented here was to provide a resource for EE researchers and policy makers in European countries. Although there are macro aspects of research policy determined at EU level (for example the Horizon Europe and Erasmus + programmes), most policy with respect to engineering education research is determined at either national or institutional level, the only exception we are aware of being the Nordic Network which has taken a regional approach in supporting engineering education research. For this reason, the authors have opted for a country-based unit of study.

Comparative data at country level is expected to be useful for decision makers at national and institutional level considering changes in engineering education for example with respect to providing funding for projects, hiring of staff or the creation and accreditation of PhD programmes. Apart from the value of such empirical data for policy makers, we see it being useful to European engineering education practitioners in general while being particularly valuable to scholars setting out on a path to doctoral research. As there are many European countries not currently offering PhD programmes in EE (Wint et al. 2023) there has been a tendency for would-be candidates to move country to pursue a PhD in the field.

In addition, a robust procedure for collecting and comparing data can serve as a baseline for the collection of longitudinal data to measure progress in the evolution of EE publication output at country level.

Methodology

As the only previous attempt to provide data on engineering education publishing output at country level, Lima and Mesquita (2018), had the limitations described earlier, the authors set out to provide more granular and detailed data that could serve as both a resource and as a baseline for future research.

The authors adopt a pragmatic world-view (Creswell and Creswell 2017, 27) in approaching this investigation and opted for a quantitative method (Creswell and Creswell, 2017, 106)

Towne and Shavelson (2002) identify three categories of research question for scientific research in education:

• Description – What is happening?

• Cause – Is there a systematic effect?

• Process or mechanism – Why or how is it happening?

Given that this type of country-based comparative scientometric analysis is relatively new in EE, it is to be expected that they can be characterised within Towne and Shavelson’s first category. We set out to address three research questions:

1. What can we learn by comparing the EE published output by authors in the EU + UK countries with the same country’s output in scientific and engineering (S & E) technical fields?

We hypothesised that the patterns would be broadly similar for most European countries.

2.	For Europe-based authors publishing research in education and in non-educational fields, what can we learn by comparing the respective outputs during their entire publication careers?
3.	What insights for policy makers, EE researchers and in particular future doctoral candidates are provided from the analysis of the h-index of Europe-based authors that publish research in education and in non-educational fields?

The data in responding to questions two and three can be important in recruiting and promotion processes where EE scholars may be in competition with colleagues who publish predominantly technical research.

Procedure

While there are many bibliometric analysis techniques or methods (Donthu et al. 2021; Zupic and Čater 2015), this study focuses on specific indicators that are widely used in bibliometric research: number of publications (Haustein and Larivière 2015), citation analysis (Haustein and Larivière 2015), distribution of publications by type (Hall 2011), and h-index (Donthu et al. 2021).

This study also introduces one new bibliometric indicator that has not been reported in the literature; the distribution of educational and non-educational publications. The creation and usage of this new bibliometric indicator was significant because it was necessary to be able to answer research question three. The creation of this new bibliometric indicator was novel because (to the best of the authors knowledge), no studies in the existing literature have previously attempted to determine the distribution of educational and non-educational research publications for a set of authors. Therefore, this is the first study to present this style of analysis in the literature.

Figure 1 shows the outline of how data was gathered and analysed in this study. The steps were grouped into five main stages: country selection, selecting the data source, data selection and processing, data collection, and classification.

Figure 1. Outline of how data was gathered and analysed.

The remainder of this section will discuss each of these sections in detail. The headings of each section match those in Figure 1 for clarity of the procedure.

In summary, we opted to identify the number of EU and UK affiliated authors publishing in 13 EE journals in the 2018–2019 period and then to analyse their entire publication careers in both educational and non-educational fields and to see how this influenced their publication records.

The time period of 2018–2019 was selected as this was before the COVID-19 pandemic. It was necessary to select a two-year period to ensure that there were sufficient numbers of authors for meaningful analysis. The time period 2019–2020 was not used as this would have introduced the occurrence of the COVID-19 pandemic as a possible variable which may have notably influenced the results during 2020.

Identify target countries

Altogether there were 28 countries considered for analysis – the 27 EU countries and also the UK which was an EU member up to January 2020 and thus was part of the union during the period in which we collected data. Only countries with at least ten affiliated authors published in the period 2018–2019 were included in the final synthesis. This means that the initial list of 28 countries was later reduced to 17 as is explained in the relevant section below.

It is important to note that the number of authors from each country may change on a yearly basis due to the differing number of publications and authors each year – this is important to understand, but is a factor that cannot be controlled. This means that the data presented in this study may vary if the analysis was conducted on authors who published in years other than 2018–2019. This is a limitation of the study. For context, Appendix 4 shows the number of authors for 2018, 2019 and the neighbouring years (2017, 2020), to understand how stable the conclusions are. As shown, the number of authors from each country can vary on a year-by-year basis. Note that the number of authors in Appendix 4 is based on the authors’ location at the time of publication (where the other data in this study is based on the author’s location in 2021, as explained in the methodology). This explains why the numbers in Appendix 4 differ from Table 2, for example.

Select research database

Scopus was selected as the sole research database because it is a large multi-disciplinary research database which was needed to ensure that authors’ publications from across a wide diversity of research disciplines were likely to be recorded. Scopus was also selected over alternatives such as Web of Science because it has indexed more publications, and some prominent engineering education journals were not indexed by other research databases (e.g. Australasian Journal of Engineering Education was not indexed by Web of Science at the time of writing). It was also not suitable to combine the use of Scopus with another research database, because the number of citations a paper can vary slightly between different research databases, which would pose a problem for citation analysis if records from multiple research databases were combined.

Data were gathered from the Scopus API (http://api.elsevier.com and http://www.scopus.com) in 2021 using the pybliometrics Python library (Rose and John 2019). Data was gathered over several months due to limitations of the Scopus API which only permits download of data about 10,000 articles per week.

Identify engineering education journals that published articles in 2018–2019

A comprehensive list of EE publications from each of the respective countries was required. To create this list, thirteen research journals relevant to the field of engineering education were consulted (Table 1). The journals were identified by conducting a search on Scopus. The initial criterion for selection was that the journal title indicates an EE focus by inclusion of ‘engineering’ along with ‘education’ or ‘pedagogy’. This identified a list of 22 possible journals. Following this, several journals were excluded based on exclusion criteria which were inductively created.

Table 1. EE journals included in the study.

#	Source Journal for EE Authors (sorted alphabetically)
1	Advances in Engineering Education
2	Australasian Journal of Engineering Education
3	Education for Chemical Engineers
4	European Journal of Engineering Education
5	Global Journal of Engineering Education
6	IEEE Transactions on Education
7	International Journal of Electrical Engineering Education (now International Journal of Electrical Engineering and Education)
8	International Journal of Engineering Education
9	International Journal of Engineering Pedagogy
10	International Journal of Mechanical Engineering Education
11	Journal of Engineering Education
12	Journal of Engineering Education Transformations
13	Journal of Professional Issues in Engineering Education and Practice (now Journal of Civil Engineering Education)

Criteria for excluding a journal included that:

1.	the journal must be currently still active (at the time of analysis) This excluded: Chemical Engineering Education (inactive since 2017) Engineering Education (inactive since 2014) International Journal Of Applied Engineering Education (inactive since 1992)
2.	the journal must focus solely on engineering education, and not other disciplines This excluded: World Transactions On Engineering And Technology Education Engineering Science And Education Journal International Journal Of Cognitive Research In Science Engineering And Education Journal of Technical Education and Training
3.	the journal must focus on engineering education as the primary focus, rather than technology in education or software applications This excluded: Computer Applications in Engineering Education
4.	the journal must focus on engineering education at the tertiary or university level This excluded: International Journal Of Continuing Engineering Education And Life Long Learning Journal Of Pre College Engineering Education Research.

Identify all articles in these journals published 2018–2019

For each journal, a list of all the publications published by the venue in 2018–2019 (inclusive) were retrieved. The purpose of this was to gather a comprehensive set of EE publications from which to gather information about EE authors. Publication types such as editorials, letters, erratum or notes were excluded.

Retrieve list of all authors from each of the selected countries

For each country, the list of all authors who had published at least one article between 2018 and 2019 (inclusive) was considered. The affiliation information in Scopus was used to establish which country (or countries) each author was affiliated with. Author affiliations were based on Scopus information for September 2021. If an author was affiliated with multiple countries, then they were listed for each. Thus we have 895 unique authors but 901 authors overall allowing for 6 with dual affiliation (see details in Appendix 2)

Exclude countries with less than 10 authors

Eleven countries with less than ten authors (Hungary, Lithuania, Malta, Cyprus, Czech Republic, Croatia, Bulgaria, Estonia, Latvia, Luxembourg, and Romania) – including those with no authors – were excluded to aid readability of the data due to the very small number of authors. This meant that seventeen countries were included in the final synthesis.

Retrieve full publication history of each author from research database

Comprehensive details for each author were then retrieved from Scopus. This included their full publication history in all fields. For subsequent analysis, only articles, conference papers, reviews, book, and book chapters were included. Other publication types such as editorials, letters, erratum or notes were excluded. Key details of each publication were captured including, but not limited to, document title (Scopus field: ‘title’), publication name (e.g. JEE) (Scopus field: ‘publicationName’), document publication year (Scopus field: ‘coverDate’), document type (e.g. article) (Scopus field: ‘subtype’), author keywords (Scopus field: ‘authkeywords’), subject areas (Scopus field: ‘subject_areas’), citation count (note that this can change over time; this is a limitation of the study), and DOI. A total of 39,322 publications until the end of 2020 were captured for the authors (see Appendix 2).

Classify papers as educational or non-educational

Publications were subsequently classified as being either educationally focused or non-educationally focussed. The purpose of this was to build an understanding of how educational and non-educational publications contribute to the research track record of each author. Because this involved analysis of thousands of publication records, it was not feasible to do this manually. Therefore, a computer-aided approach was required to assist with automating the process: an algorithm was created, using a combination of keyword search and Scopus data fields.

An extensive manual scoping search involving several iterations, coupled with subsequent testing, was undertaken to identify suitable combinations of Scopus data fields and keywords (this is similar to how a search string is constructed during the scoping search stage of systematic literature review).

A publication was deemed to be educationally focussed if:

1. any of the following three Scopus data fields:

‘authkeywords’ i.e. author keywords – the custom terms which authors are able to use to describe the contents of their publication.

‘subject_areas’ i.e. The subject areas in the Scopus databased used to classify the journal – the such as ‘Biotechnology’, ‘Education’, ‘Computer Science’ (miscellaneous). Scopus explains that for subject areas, ‘classification is done by in-house experts at the moment the serial title is set up for Scopus coverage; the classification is based on the aims and scope of the title, and on the content it publishes.’ (Scopus 2022)

‘publicationName’ i.e. the name of the journal such as ‘Journal of Engineering Education’, ‘Chemistry Education Research and Practice’, ‘Journal of Environmental Management’

included any of the following terms

   ○ ‘education’, ‘student’, ‘teach’, ‘tutor’, ‘novice’, ‘MOOC’, ‘ASEE’, ‘SEFI’

OR

2. the Scopus ‘title’ data field i.e. the author defined title of the research publication (not the title of the journal)

included the term ‘learn’

○ AND the term ‘learn’ appeared at once outside the term ‘machine learn’

The inclusion of criterion 2 was necessary because ‘learn’ was identified as a term that was absolutely essential for some papers to be correctly flagged as educational (i.e. there were no other terms which may have worked). However, an issue arose where papers in ‘machine learning’ were then often flagged as educational when they were not (this is also why ‘learn’ was restricted to the ‘title’ field). To try and address this issue, it was required that ‘learn’ appeared at least once in the title outside the context of the term ‘machine learn’. This increased the accuracy, but some machine learning publications were still incorrectly flagged as being educationally focused.

To test the efficacy and accuracy of this algorithm (compared to human judgement), a random subset of 670 publications were manually coded by the authors as being either educationally focused or non-educationally focused. This was then compared to the output of the algorithm.

∙	400 papers from the Portugal, Spain authors were checked
◦	there was a 99.7% agreement between human judgement and the algorithm
∙	270 papers from the Denmark, Finland, Sweden authors were checked
◦	there was a 97.4% agreement between human judgement and the algorithm

There was an overall 98.8% agreement between authors and the algorithm (6 false positives, and 2 false negatives). This was deemed to be acceptable accuracy for analysing the larger dataset and making conclusions (with the acknowledged limitation that about 1.2% of publications may be incorrectly flagged).

Synthesise information about authors’ publications

Following this, information for each of the 895 authors was then established, including:

• the number of years the author had been publishing, and how long they had been publishing educational papers

• the distribution of the publications by document type including articles, conference papers, book chapters, books, and reviews.

• the percentage of publications which were educationally focussed

• the number of citations on educational and non-educational publications

• the author’s overall h-index, and that of their educational publications, and non-educational publications

Results

Distribution of authors by country

We began by identifying the country affiliation of the authors that published in the 13 EE journals indexed by SCOPUS that make up our total sample (Table 2).

Table 2. Summary of the number of authors from each country, and the total number of educational and non-educational papers by authors from each country (authors from 13 EER journals).

Country/ territory	Number of authors	Total career number of educational papers Total (%)	Total career number of non-educational papers Total (%)
Austria	28	239 (44.0%)	304 (56.0%)
Belgium	11	175 (41.2%)	250 (58.8%)
Denmark	23	316 (33.2%)	636 (66.8%)
Finland	21	433 (28.3%)	1097 (71.7%)
France	20	125 (23.6%)	405 (76.4%)
Germany	42	333 (17.6%)	1564 (82.4%)
Greece	44	696 (46.9%)	788 (53.1%)
Ireland	17	336 (73.5%)	121 (26.5%)
Italy	38	128 (5.6%)	2163 (94.4%)
Netherlands	11	81 (31.9%)	173 (68.1%)
Poland	22	108 (30.0%)	239 (70.0%)
Portugal	57	635 (27.7%)	1654 (72.3%)
Slovakia	26	244 (47.0%)	315 (53.0%)
Slovenia	15	109 (23.6%)	353 (76.4%)
Spain	381	3739 (19.5%)	15405 (80.5%)
Sweden	25	363 (23.5%)	1184 (76.5%)
United Kingdom	120	754 (14.1%)	4600 (85.9%)
Total	901

Table 2 demonstrates that Spain had by far the highest number of authors (381). The United Kingdom was second with 120 authors. Other countries with more than 30 authors included Portugal (56), Greece (44), Germany (42), and Italy (38).

We then applied a value criterion to our search by identifying the authors who published in the three engineering education journals listed by Scimago in May 2022 as being both in the first quartile in the Education category and also in the first quartile for one or more technical categories such as Miscellaneous Engineering or Chemical Engineering. This included the European Journal of Engineering Education, IEEE Transactions on Education, and Journal of Engineering Education. The purpose of this was to understand whether authors from certain countries were more likely to publish in first quartile journals.

Table 3 shows that the countries in our sample with 10 or more authors who published in the first quartile journals were from the United Kingdom, Spain, Portugal, Sweden, Finland, Ireland, and Germany. Several countries had no authors who had published in the first quartile journals (Austria, Hungary, Serbia, Slovakia, Slovenia), while the remainder had under ten authors who had published in the first quartile journals.

Table 3. Number of authors from each country who published in Q1 engineering education journals in 2018–2019 (based on Scimago rankings).

Country	Number of authors in all 13 journals	European Journal of Engineering Education (EJEE) authors	Journal of Engineering Education (JEE) authors	IEEE TOE authors	Unique number of Q1 authors	Population (2023 figures rounded to nearest million)	Authors per million population
Austria	28	0	0	0	0	9	3.1
Belgium	11	7	1	0	8	12	0.9
Denmark	23	6	0	3	9	6	3.8
Finland	21	14	0	0	14	6	3.5
France	20	8	0	0	8	65	0.3
Germany	42	10	0	0	10	84	0.5
Greece	44	1	0	3	4	10	4.4
Ireland	17	12	1	0	13	5	3.4
Italy	38	1	0	5	6	60	0.6
Netherlands	11	8	0	1	9	18	0.6
Poland	22	0	0	1	1	38	0.6
Portugal	56	27	0	0	27	10	5.6
Slovakia	26	0	0	0	0	5	5.2
Slovenia	15	0	0	0	0	2	7.5
Spain	381	21	0	19	40	47	8.1
Sweden	25	16	0	0	16	10	2.5
United Kingdom	120	36	1	8	45	68	1.8
Total	901	167	3	40	210

Distribution of educational and non-educational publications from a national perspective

Table 2 shows a breakdown of the total number of educational and non-educational publications by authors from each country (i.e. the sum of all educational publications by all authors from a country). As shown, most countries have produced more non-educational publications. Exceptions include Ireland as its authors had considerably more educational than non-educational publications and Belgium and the Netherlands which have a similar number of educational and non-educational publications.

We were interested to understand the characteristics of a ‘typical’ individual author from each country. A possible limitation of this information is that it aggregates the total number of publications by all the authors from a given country. Thus, authors who have had a long research career and published many publications will have a much larger impact on these numbers than authors who have only recently started their research careers. To be able to make generalised research profiles which represented a ‘typical’ individual author from each country, it was necessary that the generalised researcher profile would not be heavily biased by researchers with a long research career. The approach that was adopted was to consider the research track record of each author as having the same weighing. This meant giving the same weighting to researchers who had 12 or 100 publications, for example. Therefore, it was decided to build the generalised research profiles by converting the raw numbers associated with each author into ratios of their overall publications. These could then be averaged across all the authors from a given country, to build the research profile of a ‘typical’ individual author. The results of this are shown in Table 4.

To clarify as an example, Table 2 shows that the total number of educational publications by authors from Austria was 239, and the total number of non-educational publications by authors from Austria was 304. Dividing by the number of authors (28) gave the numbers shown in Table 4; 8.5 educational publications on average, and 10.9 educational publications on average. This was then converted to a ratio (column 4 in Table 4) to enable easier comparison between the countries.

Table 4. Distribution of publications as educational or non-educational, categorised by country. N represents the number of authors from that country.

		Mean number of publications for an author from country
Country	Number of authors	Educational	Non-Educational	Ratio (Educational to Non-Educational)	Rank
Austria	28	8.5	10.9	0.79: 1	3
Belgium	11	15.9	22.7	0.70: 1	5
Denmark	23	13.7	27.7	0.50: 1	6
Finland	21	20.6	52.2	0.39: 1	9
France	20	6.3	20.3	0.31: 1	11
Germany	42	7.9	37.2	0.21: 1	15
Greece	44	15.8	17.9	0.88: 1	2
Ireland	17	19.8	7.1	2.78: 1	1
Italy	38	3.4	56.9	0.06: 1	17
Netherlands	11	7.4	15.7	0.47: 1	7
Poland	22	4.9	10.9	0.45: 1	8
Portugal	57	11.1	29.0	0.38: 1	10
Slovakia	26	9.4	12.1	0.77: 1	4
Slovenia	15	7.3	23.5	0.31: 1	11
Spain	381	9.8	40.4	0.24: 1	14
Sweden	25	14.5	47.4	0.31: 1	11
United Kingdom	120	6.3	38.3	0.16: 1	16

Table 4 demonstrates that the publication patterns of authors from different countries in our sample was variable. On average, authors from 16 countries published more non-educational papers than educational papers, and only authors from 1 country (Ireland) tended to publish more educational papers than non-educational papers. Authors from Ireland in our sample published the most educational papers on average (2.78 educational papers per non-educational paper), while authors from Italy published the fewest educational papers on average (0.06 educational papers per non-educational paper). Authors from Austria (ratio of 0.79:1), Belgium (0.70:1), Slovakia (0.77:1) and Greece (0.88:1) had similar publication rates of educational and non-educational papers, on average.

Distribution of educational and non-educational publications by type from a national perspective

We also examined whether the educational publications were in journals or in other publication venues such as conference proceedings or book chapters (Table 5). The relevant Scopus document types were ‘article’, ‘book chapter’, ‘conference paper’, and ‘review’.

‘Review’ is a document type classification used by Scopus which tends to be applied to certain publications such as systematic and narrative literature reviews. However, it is important to note that application of this classification can differ by publication venue (for reasons Scopus does not make clear, this is a limitation). Some venues classify literature reviews as an ‘article’ while others classify it as a ‘review’. Publications of ‘review’ and ‘article’ were not combined, as it was considered important to see the number of ‘review’ studies separately. As a result, publications classified by Scopus as a ‘review’ were analysed and presented separately to articles.

Table 5 shows the mean composition of individual authors’ educational publications from each country (not the entire country). This was calculated by determining the total number of relevant publications for each type (e.g. articles) by authors in the respective country, then dividing this by the number of authors.

Table 5 shows that journal articles and conference papers are widely published by authors from all countries. In comparison to the overall number of journal articles and conference papers, the number of book chapters published by the authors is very limited. This demonstrates that the authors do not publish many book chapters, either in educational or non-educational fields.

Table 5. Distribution of publications by type, categorised by country. N represents the number of authors from that country.

			Mean number of publications by an author in country
Country	Number of authors	Publication Type	Articles	Book Chapters	Conference Papers	Reviews
Austria	28	Educational	1.8	0.4	6.3	0.0
Austria	28	Non-Educational	4.3	0.6	5.6	0.2
Belgium	11	Educational	6.3	0.3	9.2	0.2
Belgium	11	Non-Educational	12.0	0.0	10.5	0.2
Denmark	23	Educational	4.8	1.5	7.1	0.3
Denmark	23	Non-Educational	17.5	4.0	4.1	1.8
Finland	21	Educational	8.2	0.6	11.7	0.1
Finland	21	Non-Educational	17.7	1.4	32.7	0.4
France	20	Educational	2.9	0.2	3.1	0.1
France	20	Non-Educational	6.9	0.6	12.8	0.1
Germany	42	Educational	2.0	0.3	5.5	0.1
Germany	42	Non-Educational	13.0	2.6	20.2	1.0
Greece	44	Educational	7.3	0.7	7.5	0.4
Greece	44	Non-Educational	7.3	0.7	9.8	0.2
Ireland	17	Educational	6.1	0.4	12.9	0.2
Ireland	17	Non-Educational	3.6	0.2	3.2	0.2
Italy	38	Educational	2.5	0.1	0.7	0.1
Italy	38	Non-Educational	34.3	3.4	18.1	1.0
Netherlands	11	Educational	2.5	0.1	4.8	0.0
Netherlands	11	Non-Educational	7.3	1.2	6.9	0.3
Poland	22	Educational	3.5	0.0	1.5	0.0
Poland	22	Non-Educational	8.2	0.1	2.2	0.4
Portugal	57	Educational	3.7	0.3	6.7	0.4
Portugal	57	Non-Educational	17.4	0.9	9.9	0.7
Slovakia	26	Educational	4.4	0.1	4.6	0.3
Slovakia	26	Non-Educational	5.3	0.3	6.2	0.3
Slovenia	15	Educational	5.7	0.0	1.5	0.1
Slovenia	15	Non-Educational	12.9	0.2	10.0	0.5
Spain	381	Educational	4.5	0.2	4.9	0.1
Spain	381	Non-Educational	26.5	1.1	11.9	0.9
Sweden	25	Educational	6.0	0.2	8.2	0.1
Sweden	25	Non-Educational	22.3	0.7	23.4	0.8
United Kingdom	120	Educational	3.5	0.2	2.5	0.1
United Kingdom	120	Non-Educational	22.7	1.3	13.1	1.1

Authors from Finland, Greece, Belgium, Ireland and Sweden have the highest number of educational-focused articles on average with 8.2, 7.3, 6.3, 6.1 and 6.0, respectively. Authors from Austria have the lowest number of educational-focused journal articles on average with 1.8.

Authors from Ireland, Finland, Belgium and Sweden have the highest number of educational-focused conference papers on average with 12.9, 11.7, 9.2, and 8.2, respectively. Authors from Italy have the lowest number of educational-focused conference papers on average with 0.7.

Authors from ten countries (Austria, Belgium, Denmark, Finland, Germany, Ireland, Netherlands, Portugal, Spain, Sweden) tend to publish more conference papers than articles which are educational-focused. In contrast, authors from Italy, Poland, Slovenia, and United Kingdom tend to publish more articles than conference papers which are educational-focused. The remaining countries (France, Greece, Slovakia) tend to publish educational-focused articles and conference papers at similar rates. This variation suggests that researchers from different countries may have very different approaches for publishing educational papers.

h-index of authors from each country

Finally we calculated how the educational and non-educational publications affected the authors’ overall h-index values (Table 6).

Table 6. Comparison of the h-index of all publications, only educational publications, and only non-educational publications, based on mean value of individual authors from each country. N represents the number of authors from that country.

Country	Number of authors	h-index of all publications Mean	h-index of only educational publications Mean	h-index of only non-educational publications Mean	Ratio of mean h-index of educational publications to non-educational publications
Austria	28	4.4	2.5	2.9	1: 1.16
Belgium	11	8.6	3.7	6.4	1: 1.73
Denmark	23	8.5	3.7	5.7	1: 1.54
Finland	21	10.0	5.6	6.5	1: 1.16
France	20	5.1	2.2	4.2	1: 1.91
Germany	42	6.4	2.3	5.0	1: 2.17
Greece	44	5.7	4.0	3.1	1.29: 1
Ireland	17	4.5	3.2	1.6	1: 2:00
Italy	38	11.9	1.4	11.4	1: 8.14
Netherlands	11	6.0	1.9	4.7	1: 2.47
Poland	22	3.9	2.0	2.5	1: 1.25
Portugal	57	8.2	2.6	6.9	1: 2.65
Slovakia	26	4.0	2.6	2.6	1: 1.00
Slovenia	15	6.1	2.7	4.8	1: 1.78
Spain	381	11.7	2.7	10.6	1: 3.93
Sweden	25	10.4	4.0	7.3	1: 1.83
United Kingdom	120	9.3	2.1	8.4	1: 4.00

The non-educational publications h-index was notably higher for the majority of countries. The only countries where the educational publications h-index was higher than the non-educational publications h-index were Greece, and Ireland. The h-index of educational and non-educational publications was broadly similar for Slovakia, Austria and Finland.

Discussion

Overall output

There are a number of sources providing comparative data on the scientific publication output of European Countries. Table 7 column 3 shows the global scientific output for European countries according to Nature Index (2019–2020) while column 4 has the output for Engineering Publications indexed in Scopus for Western European countries (Scimago 2021). Although there are some differences in the way samples and data are compiled and presented by these two sources, we see that overall the place of countries in these tables is relatively consistent. These data can be compared with the ranking of EE publications in our sample.

Table 7. Ranking of EE publications in Q1 journals with output in global scientific and engineering domains.

Ranking	EE publication output in Q1 journals	Global scientific output	Engineering output
1	United Kingdom	Germany	Germany
2	Spain	United Kingdom	United Kingdom
3	Sweden	France	Italy
4	Portugal	Spain	France
5	Finland	Italy	Spain
6	Denmark	Netherlands	Netherlands
7	Ireland	Sweden	Sweden
8	Germany	Belgium	Portugal
9	France	Denmark	Belgium
10	Netherlands	Austria	Denmark
11	Italy	Poland	Austria
12	Greece	Finland	Finland
13	Belgium	Czech Republic	Greece
14	Poland	Ireland	Ireland
15	Slovenia*	Portugal	Cyprus
16	Slovakia*	Greece	Luxembourg
17	Austria*	Hungary	Malta

*Had no EE papers in Q1 sample.

From Tables 2 and 7, we can see two notable phenomena:

• Spain and the UK stand out in terms of the high number of authors published in EE although in the former only 10% were in Q1 journals.

• The output of certain countries deviates from what we might have expected based on their position in global league tables that collate scientific and engineering (GSE) technical research publications in general. Germany, France and Italy have lower EER output compared with their position in GSE tables while Portugal Sweden, Finland, Denmark and Ireland are higher (Table 7).

We will now look in more detail at these findings at individual country level and consider explanations for patterns identified.

Spain

The high output from Spain (Table 2) could be explained by the national regulations governing career progression that apply to all academics in public HE institutions (Valentine and Williams 2021a). The Spanish system involves 6-yearly evaluations based on an accumulation of ‘merits’ as defined nationally by the ANECA accreditation agency (2020); these are quantitatively defined targets that favour publication in JCR-indexed journals. This can give rise to a publish or perish perception among engineering educators. Furthermore, as the requirements for merit accumulation via journal publication in educational journals are slightly lower than for specialised engineering journals, ambitious faculty may identify education journals as priority outlets for career-based reasons regardless of their commitment to education.

UK

Given the UK’s position in scientific publishing rankings such as in Table 7, it is not surprising that it appears as a high EER contributor. As in the case of Spain, the high UK output in journals (Table 2) may also be the result of a national publish or perish policy in that all universities are subject to the Research Excellence Framework (REF), which is used to determine the allocation of ‘quality-related’ government research funding within the UK (Wint and Nyamapfene 2021) and takes place every 6 years. The REF leads to national league tables of HEIs and can have a major impact on the life of an engineering school. Its criteria prioritise publication in high impact journals.

Germany, France and Italy

Given their high rankings in GSE rankings (Table 7), it is surprising that these three countries are less well represented in EE authorship. This suggests that EE as a field is not seen as a priority by engineering faculty in these countries. We have not encountered an explanation for these findings and this suggests a need for more comparative research into the contexts of these countries within the European research sphere. For example, it would be of interest to establish how much research is published in national conferences and not in English as is the case of scholarship of teaching and learning papers in Germany – such studies would not show up in our Scopus analysis.

Nordic countries

We see in Table 7 that these three countries tend to be higher in the EE ranking than their positions in the GSE columns. This trend aligns with the reported growth of a strong Community of Practice in these countries (Edström et al. 2018) following the creation in 2009 of NNEER (Nordic Network for Engineering Education Research) with funding from the research council of the Nordic Ministerial Council (NordForsk). The vitality of EE in this region may also be a reflection of the fact that there are more PhD programmes in EE (5) available in these three countries than in the rest of Europe combined (2) according to the online list maintained by the American Society for Engineering Education's Student Division.¹

Portugal and Ireland

These two countries appear higher in our sample than their GSE ranking might suggest (Table 7).

In the case of Ireland, although the number of authors in our sample was relatively small (17), 13 out of 17 (76%) of the authors from Ireland had published in Q1 journals during 2018–2019 (Table 3) which suggests there has been a focus on EER there. This aligns with data presented in a recent paper (Wint et al. 2022) that suggests a number of institutions clearly support PhD research projects in engineering education and that publications in the field count towards promotion.

In the case of Portugal, there have been two previous publications:

By contrast with Spain and the UK, although Portuguese faculty are subject to evaluation processes, these are more loosely defined and allow more flexibility at the level of individual higher education institutions (Valentine and Williams 2021a).

It is interesting to compare the data in Table 2 for 2018–2019 with that in the earlier study (van Hattum-Janssen, Williams, and Nunes de Oliveira 2015) that looked at Portuguese EER publication in the period 2000–2012. That study reported an increase in output in the years 2011 and 2012 when there was an average of 13 publications per annum. The majority of these however were in non-Quartile 1 journals. The authors of that paper concluded that EER research in Portugal was evolving positively and indeed if we now compare the earlier data with the output from Portugal in Table 3 we see that this trend has continued in quantitative terms, annual output has almost doubled and that this has also resulted in significantly more publications in Quartile 1 journals.

In the 2015 article, the authors noted that with regard to EE in Portugal there was ‘little structural support and the financial support received for such research has been modest’. They also commented that there were no existing PhD programmes in the area. To the best of the present authors’ knowledge, this situation has not altered in the intervening years and this suggests the question: if research in EE receives little structural support or funding in Portugal, why has it been on the increase? One possible contributory factor was the founding in 2011 of SPEE, the Portuguese Society for Engineering Education. This organisation initiated a biennial international conference (CISPEE), organises an in-person forum for engineering educators, liaises with local, national and international decision-makers and publishes a quarterly newsletter. This activity may have played a part in nurturing EER in the country but more detailed analysis is called for in future work.

Moving on to focus on the data in Tables 4–6, we again encounter notable patterns when we compare the countries.

Educational ratio

Table 4 presents the ratio of educational to non-educational publications for the entire careers of the authors identified in Table 2. The reader can see in Appendices 1a and 1b a random sample of 100 exemplar papers generated by an aleatory algorithm from the 39,322 publications in our sample. It will be noted that the non-educational papers are typically technical engineering papers.

In general, the authors in our sample produced more non-educational articles than educational ones in their careers (Table 4), Ireland being the only exception. This is particularly noticeable for countries like Spain, UK, France, Italy and Germany all of whom are in the upper region of publication ranking tables for Global Science and for Engineering output in Table 7.

Articles versus conference papers

Table 5 shows that there appears to be quite a range in the priority assigned to conference papers: whereas authors from the majority of the countries in our sample published more in journals, it is notable that authors in five countries, Austria, Germany, Ireland, the Netherlands and Sweden published more conference papers than journal articles. This could be a reflection of the academic evaluation processes in the different countries, with journal articles given a high priority in countries like Spain and the UK while less rigid evaluation procedures in other countries can serve to encourage educators participation in conferences for their value in sharing ideas, learning and networking.

The trends for educational publications noted in Table 5 are also apparent, broadly speaking, in the case of non-educational publications.

h-index values

In Table 6 we see that there is a general trend for non-education publications to influence h-index values more than educational ones, Greece, Ireland and Slovakia being the only countries where educational publications have a strong influence.

This reflects a generalised phenomenon that was noted in the 1970s by citation analysis pioneer Ernest Garfield – founder of the ISI system and credited with being the initiator of the journal impact factor concept – when he observed that ‘citation potential can vary significantly from one field to another’ (Garfield 1979). In general, engineering education articles tend to have much lower citation rates than those in specialised engineering fields. This can be seen in the impact factor of journals: for example, the most cited journal in the field of EE, Journal of Engineering Education, has a 2020 impact factor (IF) of 3.146, the highest across all education fields is the Review of Educational Research with an IF of 13.5, while those of the three highest ranked in the field of Mechanical Engineering are Nature Materials 43.84, Materials Science and Engineering: R: Reports 36.21 and Advanced Materials 30.85 (Valentine and Williams 2021c).

Overall patterns

The author’s experience in sharing these comparative data on publication patterns during workshops and meetings in Europe has been that engineering educators and researchers are eager to get a picture of how their own national context compares with that of other countries and that there are relatively few sources of empirical data available.

We believe that the data and analysis presented here will help clarify the current state of the art in the countries featured in our sample. The main takeaways are that there is a considerable range in publication patterns across the EU + UK, Spain and the UK being leaders with regard to the quantity of journal publications. At the same time, there are countries such as Germany, France and Italy, that feature highly in the ranking of engineering and scientific publications but appear further down the ranking of engineering education output.

The importance given to education publications versus non-educational ones also varies considerably. The trend for non-education publications (typically technical ones) to contribute more to the h-index value of an author will also be an important consideration for some researchers.

Limitations

The most significant limitation of the present study is the fact that our sample of authors was gathered from those who published in (at least) one of thirteen EER journals over a two-year window between 2018 and 2019 (inclusive). This was due to the time required to download information about the 39,322 papers in our sample from SCOPUS. Future iterations of the procedure will allow us to amplify our sample to include broader time intervals.

A second limitation arises from the fact that for technical reasons (of the Scopus API) the author affiliations are assigned based on what countries Scopus reports they are currently affiliated to on 29 September 2021. So authors who moved country between 2018 and 2021 could be incorrectly assigned. However, we believe there is a sufficiently low inter-country mobility to allow us to believe that the majority of the 895 authors in our sample are correctly attributed.

Machine analysis of text data is always open to a level of error but, as shown earlier, manually checking 670 papers showed a high level of accuracy for the procedure adopted. We see qualitative data collection on regulations and policy at national level as an important complement to the quantitative approach adopted here.

A different type of limitation arises when attempting to propose hypotheses regarding the link between our findings and the EER context of the countries studied. As much of the contextual information at national level is not available in English we looked to existing research publications to provide such information. As we explain in the literature review, there is little published material available to provide background information on regulations and policy in each of the EU countries with respect to EER.

Future research

The authors have identified and initiated two future lines of investigation.

• recognising that there is a need for more contextual information, we aim to collect data on the EER context of the countries included in the present study by sharing the current data via international events such as conferences and webinars and inviting contributions from colleagues in the various countries. This can involve qualitative approaches such as interviews and focus groups.

• in the longer term, we intend to use the data presented here as a baseline to enable longitudinal studies of EER evolution at country level based upon the scientometric procedures presented in the present paper.

Conclusions

This paper presents a scientometric procedure that allows comparison of the engineering education publication in different countries. The procedure is implemented to compare European countries by taking a snapshot of researchers published in EER journals over a two-year period – 895 in all. This allowed us to compare the publication output from each country. We then analysed the entire publication careers of these authors to see how many of their publications were educational and how this impacted their h-index values.

Looking first at the output in the period 2018–2019 we note wide disparities between the various European countries and while we propose possible explanations for some of these, findings for other countries and Germany, France and Italy in particular await analysis in a future study.

Countries also varied widely in the ratio of educational to non-educational publications. In addition, our findings suggest that non-educational publications had a greater impact on authors’ h-index values than their educational output and this is in keeping with literature relating to other fields of inquiry.

We believe this approach can be valuable in future studies and that it can have a role in longitudinally mapping and comparing engineering education publication in and across Europe and can provide a valuable resource for policy-makers and researchers in general, but in particular future doctoral candidates, in the region by facilitating an evidence-based approach to mapping what is being done and what may need to be done to increase the quality of engineering education across the EU + UK region.

Acknowledgement

This work is partially financed by Portuguese funds through the FCT - Foundation for Science and Technology, I.P., under the project UIDB/00097/2020.

Disclosure statement

No potential conflict of interest was reported by the author(s). The second author was one of the 895 authors in the data set studied.

Additional information

Funding

This work is partially financed by Portuguese funds through the FCT – Foundation for Science and Technology, I.P., [project UIDB/00097/2020].

Notes on contributors

Andrew Valentine

Andrew Valentine is a Teaching Fellow in the School of Computing and Information Systems and the University of Melbourne, Australia. He initially completed a dual degree in electronics engineering and computer science at RMIT University, where he subsequently completed a PhD in engineering education. He was a postdoctoral research fellow at the University of Western Australia, and then a lecturer at the University of Queensland before taking up his current position. His primary research interests are fostering creativity skills in engineering, novel educational technologies and technology enhanced learning, scientometrics, development of curricula, and building students’ employability skills .

Bill Williams

Bill Williams originally trained as a chemist at UCC, Ireland and went on to work in education in Ireland, UK, Eritrea, Kenya, Mozambique and Portugal. He serves as an associate editor of the European Journal of Engineering Education and senior associate editor for the Journal of Engineering Education. He is a researcher at the Centre for Management Studies (CEGIST) of Instituto Superior Técnico, University of Lisbon, is Professor Emeritus of Setúbal Polytechnic Institute, Portugal and Adjunct Senior Research Fellow at TUDublin, Ireland. He is a founder member of the Portuguese Society for Engineering Education (SPEE).

Notes

1 http://engineeringeducationlist.pbworks.com/w/page/27610307/Engineering%20Education%20Departments%20and%20Programs%20(Graduate).

Appendices

Appendix 1a

Table

Randomly generated list of 50 non-educational titles
A novel method for energy measurement of short optical pulses
Bonding Insights from Structural and Spectroscopic Comparisons of {SnW5} and {TiW5} Alkoxido- and Aryloxido-Substituted Lindqvist Polyoxometalates
Rheology, microstructural characterisation and physical stability of W/α-PINENE/W emulsions formulated with copolymers
Optimisation of H2 production through minimisation of CO2 emissions by mixed cultures of purple phototrophic bacteria in aqueous samples
Can Personal Values Help to Manage Workers’ Occupational Safety and Health Behaviour?
A simple DAQ-card based bioimpedance measurement system
A delay-fractioning approach to stability analysis of networked control systems with time-varying delay
Periodic NLC phase grating for tuneable PBG applications
Structural manipulation of hydrogen bond networks using sulphonated phosphane ligands and their complexes: Competition and interplay between strong and weak hydrogen bonds
Sustainability assessment of electrodialysis powered by photovoltaic solar energy for freshwater production
Hydrogels with 3D gradient of mechanical properties
Assessing multiview framework (MF) comprehensibility and efficiency: A replicated experiment
Substrate Integrated Waveguides Structures Using Frequency Selective Surfaces Operating in Stop-Band (SBFSS-SIW)
Explorations of honeycomb topologies for network-on-chip
Through the data modelling process of Turimov, an ontology-based project for mobile intelligent systems
An intraventricular soft robotic pulsatile assist device for right ventricular heart failure
Study of the effect of a geothermal heat exchanger over the ground
Monitoring human body motions during earthquakes
Microwave-assisted extraction in goji berries: Effect on composition and bioactivity, evaluated through conventional and nonconventional methodologies
Virtualisation-based techniques for the design, management and implementation of future 5G systems with network slicing
PTGuide – a platform for personal trainers and customers
The stress intensity of mixed mode cracks determined by digital image correlation
Cost competitive ‘soft sensor’ for determining product recovery in industrial methanol
Viscous flow through microfabricated axisymmetric contraction/expansion geometries
An integrated process for biomass pyrolysis oil upgrading: A synergistic approach
Amination Reaction of Cyclohexanol over a Commercial Ni-Based Catalyst, Part I: Influence of Operating Conditions
Analysis, design and development of novel, low profile 2.487 GHz microstrip antenna
Hydrogen from biogas: Catalytic dry reforming in a two zone fluidised bed reactor with membranes
Enzymatic reactors for the removal of recalcitrant compounds in wastewater
QoS-aware real-time composition algorithms for service-based applications
A frequency independent method for adaptive correction of time interleaved analog to digital converters
Benchmarking environmental and operational parameters through eco-efficiency criteria for dairy farms
Thread fork/join techniques for multi-level parallelism exploitation in NUMA multiprocessors
A smart framework for mobile botnet detection using static analysis
Fully differential current-mode CMOS triode translinear multiplier
Nitrogen and hydrogen related infrared absorption in CVD diamond films
Key microbial communities steering the functioning of anaerobic digesters during hydraulic and organic overloading shocks
Evaluation of [C 3mim][NTf 2] as Solvent for the Liquid-Liquid Extraction of Benzene from Mixtures of Benzene and Hexane
Selection of materials with potential in sensible thermal energy storage
A greedy heuristic approximation scheduling algorithm for 3D multicore processors
Regional analysis of the annual maximum daily rainfall in the province of Malaga (southern Spain) using the principal component analysis
Bioinspired structures for core sandwich composites produced by fused deposition modelling
Control of tokamaks using ASTRA – Matlab Integration
Multiview Imaging with Real-Time Microwave Camera from Known Positions
ITTSAE: A set of interactive software tools for time series analysis education
A Machine Learning approach to perform Physical Activity classification using a Sensorised Crutch Tip
QR-codes applied to architecture data and teaching
The catalytic activity of Fe-containing SiBEA zeolites in Fischer-Tropsch synthesis
HEMET: Mathematical model of biochemical pathways for simulation and prediction of HEpatocyte METabolism
Frequency selective properties of coaxial transmission lines loaded with combined artificial inclusions

Appendix 1b

Table

Randomly generated list of 50 educational titles	Journal
Supporting online coordination of learning teams through mobile devices	IJEE
Temporal analysis for dropout prediction using self-regulated learning strategies in self-paced MOOCs	IJEE
Clustering projects for eLearning interoperability	IJEE
A system to support asynchronous collaborative learning tasks using PDAs	IEEETOE
PBL and computer programming – the seven steps method with adaptations	EJEE
Increasing student responsibility in design projects with agile methods	IJEE
Developing pre-laboratory videos for enhancing student preparedness	EJEE
Evaluating the role of collaboration scripts as group guiding tools in activities of educational robotics: Conclusions from three case studies	IEEETOE
A method to evaluate accessibility in E-learning education systems	IEEETOE
A component model for standardised web-based education	IJEE
Intelligent tutoring interface for technology enhanced learning in a course of computer network design	IJEE
Emerging technologies for ICT based education for dyscalculia: Implications for computer engineering education	IJEP
Listening to students as a way of improving teaching: Application of QFD-based techniques to a final year subject	IJEE
iBridge – Participative Cross-Generational Approach with Educational Robotics	IJEP
Provision of distance learning services over Interactive Digital TV with MHP	IJEE
Distributed knowledge-based computer-aided control education environment	IJEE
Educating future managers in higher engineering education	IJEP
GRASSROOTS: How to get lecturers to go digital? Advanced use of Blackboard for online testing in Aircraft Structural Design courses	EJEE
Exploring the application of process mining to support self-regulated learning: An initial analysis with video lectures	IJEE
Enhancing the development of multidisciplinary skills in engineering students by promoting industry and university synergy	IJEE
Examining exemplarity in problem-based engineering education for sustainability	JEET
A participative pedagogical approach to knowledge comprehension based on students preferential learning styles	EJEE
Developing a methodological taxonomy of EER papers	EJEE
Understanding comics. A comparison between children and adults through a coherence/incoherence paradigm in an eye-tracking study	IJEEE
The empirical research on human knowledge processing in natural language within engineering education	IJEP
Trialogical learning supported by knowledge practices environment	EJEE
A reclassification of markers for mixed reality environments	IJEP
Undesigned cooperation within a serious game: Observations during a mechanical engineering course	IJEP
Student feedback in engineering: A discipline-specific overview and background	EJEE
Micro flip teaching – An innovative model to promote the active involvement of students	IJEE
An example of application in mobile learning technologies	IEEETOE
Learning analytics for the precise evaluation of student effectiveness with educational resources and activities	IJEE
ADS-B transmitter/receiver simulation to decode real aircraft trajectories with software defined radios	IJEEE
Catering to the needs of the ‘digital natives’ or educating the ‘net generation"?	IEEETOE
Team teaching implementation in engineering education: teacher perceptions and experiences	EJEE
Using game-based learning in virtual worlds to teach electronic and electrical engineering	IJEP
Learning-by-Doing: The Chem-E-Car Competition® in the University of Cantabria as case study	ECE
Informal tools in formal contexts: Development of a model to assess the acceptance of mobile technologies among teachers	IJEE
Postgraduate research supervision quality: Rethinking the value of doctoral supervision to design an integrative framework	EJEE
The European Project Semester at ISEP (EPS@ISEP) programme: Implementation results and ideas for improvement	IJEP
Educational Technology in the Age of Natural Interfaces and Deep Learning	IJEE
May I teach you? Students’ behaviour when lectured by robotic vs. human teachers	IJEE
A proposal to develop and assess professional skills in engineering final year projects	IJEE
Competency position of Bachelor's degree in education	GJEE
Communities of practice environment (CoPE): Democratic CSCW for group production and e-learning	IJEE
Conversational agent to promote students’ productive talk: The effect of solicited vs. unsolicited agent intervention	IEEETOE
Enriching student HIV awareness by digital storytelling	EJEE
Strong classification system for wear identification on milling processes using computer vision and ensemble learning	IJEE
Representing data visualisation goals and tasks through meta-modeling to tailor information dashboards	IJEE
Infrared thermography as a useful tool to improve learning in heat transfer related subjects	IJEE

Appendix 2

Overall number of EE authors and publications included in the study

Table

	Total number of authors	Total number of publications
Only Unique Entries Considered	895	39,322
Total Number of Entries (authors affiliated with more than country counted each time)	901	40,065
Authors affiliated with more than one country	6	743

Appendix 3

Number of publications from each country published in Q1 engineering education journals in 2018–2019 (based on Scimago rankings).

Table

Country	Number of JEE publications	Number of EJEE publications	Number of IEEE TOE publications	Total number of Q1 papers
Austria	0	0	0	0
Belgium	1	1	0	2
Denmark	0	5	1	6
Finland	0	7	1	8
France	0	3	1	4
Germany	0	4	0	4
Greece	0	1	1	2
Ireland	0	5	0	5
Italy	0	1	1	2
Netherlands	0	1	1	2
Poland	0	0	1	1
Portugal	0	9	2	11
Slovakia	0	0	0	0
Slovenia	0	0	0	0
Spain	0	6	6	12
Sweden	0	10	1	11
United Kingdom	1	15	5	21
Total	2	68	21	91

Appendix 4

Number of total authors from each country who published in the 13 engineering education journals in 2017–2020 (based on the authors location at the time of publication) (duplicate authors in each year not removed).

Table

Country	2017 Total number of authors (Number of publications)	2018 Total number of authors (Number of publications)	2019 Total number of authors (Number of publications)	2020 Total number of authors (Number of publications)
Austria	2 (1)	20 (3)	16 (7)	1 (1)
Belgium	10 (2)	8 (2)	2 (2)	18 (5)
Denmark	28 (12)	21 (7)	7 (3)	22 (9)
Finland	11 (4)	19 (10)	10 (5)	7 (3)
France	12 (7)	12 (5)	6 (2)	32 (12)
Germany	13 (7)	14 (6)	22 (9)	23 (11)
Greece	9 (4)	25 (8)	24 (9)	17 (8)
Ireland	10 (6)	4 (4)	13 (6)	18 (6)
Italy	9 (6)	16 (6)	37 (12)	8 (2)
Netherlands	6 (2)	2 (2)	1 (1)	37 (7)
Poland	7 (7)	14 (9)	8 (6)	10 (7)
Portugal	34 (10)	30 (7)	45 (14)	20 (7)
Slovakia	9 (3)	17 (5)	17 (7)	14 (4)
Slovenia	15 (7)	10 (5)	4 (2)	5 (2)
Spain	208 (65)	201 (55)	215 (57)	135 (48)
Sweden	21 (10)	12 (8)	20 (9)	17 (9)
United Kingdom	55 (24)	80 (33)	55 (24)	92 (30)