711
Views
0
CrossRef citations to date
0
Altmetric
Management

The typology and determinant of performance measurement for public sector organizations – a literature review

ORCID Icon, ORCID Icon, ORCID Icon & ORCID Icon
Article: 2315681 | Received 08 Feb 2023, Accepted 02 Feb 2024, Published online: 26 Feb 2024

Abstract

Public sector organization is very influential. However, due to the limitations of the papers discussing the topic of performance measurement for public sector organizations, thus this research explores existing research on this topic. The main objective of this research was to know the issue of performance measurement in public sector organizations. The systematic literature review method was used to explore different issues related to performance measurement for public sector organizations. In this research, various type of performance measurement for public sector organizations is described. Based on the findings, we suggest concerning determinants of performance measurement for public sector organizations at individual and organizational levels as the fundamental performance measurement elements, due to the lack and the limitation of the research concerning individuals as a critical element. The source of the literature from the Scopus Preview from 2013 to 2022 was taken by implementing the typology agenda. The result proposes a performance measurement typology based on the unit, level, measures, target, and realization. Besides, the result confirms that there has not been in-depth research on performance measurement for public sector organizations specifically on the public sector especially mixed-method research approaches from emerging and developing countries of the individual. The contribution of this research is as a reference material in encouraging more effective policies and evaluation in the implementation of public sector performance measurement.

1. Introduction

Arranging a performance measurement framework (PMF) to plot the specifics of a non-profit organization (NPO) is a challenging mission (Moura et al., Citation2020). The notion of the social element as design qualifications is a critical topic for arranging a PMF. Throughout the development of the study in PMF, various schemes have been used for an NPO. A framework that is commonly adopted by organizations and discussed in the literature is the balanced scorecard (Kaplan & Norton, Citation1992). The balanced scorecard (BSC) is designed to be applicated with a target on the public sector organization (PSO) such as government organizations at the local or national level (Hoque, Citation2014). Even there are numerous measurement approach has been arranged, the BSC has been commonly debated, evaluated, and adopted in the last two decades (Speklé & Verbeeten, Citation2014).

Furthermore, even though research on the PMF is advancing, but not on research PMF focusing on the PSO (Moxham, Citation2009). PMF has been widely discussed in PSO in the last ten years. PSO is studied as a sort of NPO (Valentinov, Citation2011). The challenge is due to there being no consensus on the NPO definition and typology. Various categories of organizations can be grouped into NPO. It comprises colleges, healthcare institutions, voluntary institutions, labor institutions, regulatory bureaus, professional federations foundations, social companies, associations, and philanthropic (Moxham, Citation2009; Valentinov, Citation2011). Thus, this research recognizes them as NPOs. However, experts debate the adoption of the profit framework of PMF for the inadequate of a robust theoretical basic (Almeida Prado Cestari et al., Citation2018; Borst et al., Citation2014). Consequently, most of the PMF made by the consultant agency are eligible to perform the intended PMF’s target of NPO due to the lack of a rigid theoretical basis (Mouchamps, Citation2014). Previous research on PMF as a kind of NPO organization reflection found that PMF frequently fails due to dissimilar perceptions and concerns of the stakeholders throughout the implementation (Leotta & Ruggeri, Citation2017). That diversity must not be neglected. The adoption of the BSC in a rehabilitation institution should deal with both the recipients’ and the economic viewpoints due to the need to satisfy the recipients and keep income stable (Martello et al., Citation2016). Regardless of the use of BSC in university, the model was not able to catch the main role of this type of institution, and the quality assurance application only slightly expressed the system (Reda, Citation2017). The adoption of the BSC in the educational background must be arranged with a distinctive element that meets the organizational policy due to the original element, such as financial, recipients, internal operation, and training and development, which are not absolutely appropriate. Research by Keser Ozmantar and Gedikoglu (Citation2016), found the need for practitioners as the fifth additional element of BSC.

Furthermore, arranging a PMF for NPO, especially for the public sector is very demanding. The PMF maker should calculate all elements that affect the strategy, such as legality, the involved participants’ requirements, companies’ parameters, and the affection one for another. It comprises the aspects, challenges, determinants, and incentives. The target of this organization is chasing social goals rather than monetary profit for their stakeholders or companions. The requirement to have a measurable and accountable performance evaluation for public sector organizations is very critical. However, the literature on this topic is quite limited and there is a need to study the performance measurement of this organization especially the determinant of the PMF so that the leader of the organization can get insight related to this organization (Moura et al., Citation2020). Besides, the research on public sector performance measurement has been hindered due to the absence of a general conceptual systematic classification and principle descriptions (Alach, Citation2017). Therefore, the objective of this research is to explore the current state of the art of PMF in the public sector and the determinants of PMF in public sector organizations.

The hypothesis in this study is that important factors in performance measurement for public sector organizations at the individual and organizational levels as elements of performance measurement are more contextual and actual. In addition, there is a lack of and limited previous research on performance measurement in the public sector that conducts performance measurement. Typology is based on unit, level, measure, target, and realization. Since there is no exclusive research on the adoption of performance measurement in Indonesia, future research can discuss the adoption of performance measurement in Indonesia.

2. Literature review

Even there is the universalization of the public sector and private sector to become too simple (Steccolini, Citation2019). Regarding that fact, the difference between those sectors actually has declined (Bogt et al., Citation2015), some researchers suggest for see the context of the analysis comprises control, ownership, and finances (Rainey & Jung, Citation2015). Borders among sectors may not be as rigid and need more study. besides, the diversity among sectors can simply be elaborated, which has directed to an unfruitful typology of the organizational public sector as the complex and organized private sector as simple (Mazzucato, Citation2018; Cohen, Citation2019; Cohen et al., Citation2019). There are some features that are accurate for organizations that work in the public context, that draft practical scenery in which performance measurement research is conducted (Chenhall et al., Citation2017). For example, the monetary performance of the profit company can usually be analyzed by examining cash flow or income. While those performance measurements in the public sector are quite rare (Hofstede, Citation2011, Citation2018). Then, the public organization collaborates with other stakeholders to obtain the target. Some social goals become materialized in the future years. This condition makes detecting and calculating the performance of that definite interventions or program very interesting (ter Bogt et al., Citation2015) Regarding this, as leaders in private company companies produce benefits for shareholders, the leaders in the public company generally have a broader array of stakeholders to complete, such as inhabitants, legislator, and interest groups. Their task has been claimed unclear. Numerous organizations are identifying inclusive performance measurement outside the economic indicator (Nudurupati et al., Citation2011). These non-financial measures such as value, recipients’ happiness, and waiting time were calculated. The study of the public sector is a unique research condition (Burgess et al., Citation2021).

In the last five decades, the quantification of performance has always been the core of numerous transformation progressions in the public sector of numerous countries. Performance assessment has been conducted in the past, such as in the 19th century to the implementation of the assessment to the UK and the USA teachers’ performance (Pollitt & Bouckaert, Citation2009). In the past ten years, public sector organizations in numerous developed countries improved the adoption of performance measurement but decreased other management regulations such as input, guidelines, and parameters. Nowadays most developed countries adopt performance measurement for their central public sector organization. The search for efficiency and effectiveness is the driver of performance measurement adoption (Newberry, Citation2020). The efficiency due to the 2008 financial crisis forced numerous governments to be concerned about performance measurement. However, this condition leads to the outlay of other management controls. The government in Europe was provoked by and transformed their concern in the assessment of performance measurement (Bracci et al., Citation2015). Numerous academicians have also shown their interest in performance measurement adoption (Budding & Helden, Citation2022). Debate on this topic also occurred such as the argument of the negative effect of performance measurement (van der Kolk, Citation2022) or the other political agenda (Lapsley & Miller, Citation2019). The positive and negative effects may also occur on organizational policy (Speklé & Verbeeten, Citation2014).

Many factors influence the adoption of performance measurements, such as internal stimuli, external stimuli, processes, and changes (Waggoner et al., Citation1999). Two cases of public service organizations in Italy showed that one of the two organizations was successful. The problems were the factors of the vision of the organization, internal confrontation, and external impact. The adoption should also calculate the external and internal factors (Bracci et al., Citation2017) and legal aspects, or there will be confrontation (Barbato & Turri, Citation2017). The process was challenging due to the requirements of the legal and stakeholders.

There are numerous transformations in the public sector toward professionalism (Kroll & Proeller, Citation2013) due to the financial necessity for efficiency. But the performance measurement in the public sector is debatable due to the various stakeholder’s need to satisfy (Borst et al., Citation2014; Putera et al., Citation2022b). Consequently, the measurement should be complex. Then the attempt to design was limited (Lee & Nowell, Citation2015). There should be more studies on this topic in the public sector which consider the limitation of the resources, the perspective of the society as the recipients, and the multi stakeholders’ requirements.

Performance management facilitates leaders to supervise performance (Kroll & Proeller, Citation2013). Performance management has three grades of measures when arranging and adopting: (1) the individual measure that conducts the calculation of the efficiency and effectivity of activity; (2) the group of measures that give an understanding of organizational performance; (3) the required infrastructure to accumulate, examine, distribute and implement regarding information and measures (Neely et al., Citation2005). Some definitions of performance measurement over time (see ). This study’s main objective is to find out the research gap on PMF and its antecedents. So, it is critical to limit the concerned theme of the study to be analyzed.

Figure 1. Conceptual discussion on performance measurement over time. Source: processed from authors, 2023.

Figure 1. Conceptual discussion on performance measurement over time. Source: processed from authors, 2023.

3. Method

3.1. Ethics statement

Neither approval by the institutional review board nor obtainment of informed consent was required since this was a literature-based study.

3.2. Study design

This study uses the bibliometric analysis method with data sources from literature studies from various scientific journals. The primary data used in this research was taken from the Scopus database. The author chose the Scopus database because it has complete data and is also one of the databases with the highest rating in various scientific fields. And they are also equipped with various literature studies to improve research accuracy and get the best conclusions (Abdillah, Buchari, et al., Citation2023; Abdillah, Widianingsih, et al., Citation2023; Muhtar et al., Citation2023).

3.3. Data collection

The context of the study literature review is the ‘performance measurement’ and ‘public sector’. The approach applied is a systematic review. A systematic review is an approach to knowing, asses, and constructing the whole related result of the papers discussing specific questions, certain themes, or areas of research (Kitchenham, Citation2004; Putera et al., Citation2022a). The researchers retrieved articles from the Scopus database that was conducted on 18 January 2023. The research strategy uses Scopus data TITLE-ABS-KEY (performance AND measurement AND systems, AND public AND sector). Results from identification and exploration based on 3 criteria relevant is with the topic of performance measurement for public sector organizations which refers to (1) Suitability with the research topic; (2) Connectedness to the topic of research; and (3) Research implications found or recommended (Abdillah, Buchari, et al., Citation2023; Abdillah, Widianingsih, et al., Citation2023; Muhtar et al., Citation2023; Putera et al., Citation2022a).

Based on , we can see the steps of data collection carried out by researchers, as follows:

Figure 2. Retrieval process of this study (Putera et al., Citation2020; Widianingsih et al., Citation2021).

Figure 2. Retrieval process of this study (Putera et al., Citation2020; Widianingsih et al., Citation2021).

Step 1: Identification.

The search of document on online bibliometrics. Searching for articles was conducted online by the keywords’ performance measurement’ and ‘public sector’ in the Scopus Preview on January 2023. This step of searching with no restriction year finds 727 documents.

Step 2: Screening.

Regarding the title and abstract, the document issued that focus on the’ performance measurement for the public sector’ and ‘the determinants’ were selected. Consequently, the number of papers was reduced to 328 documents.

Step 3: Eligibility.

During the eligibility phase, there were 133 documents selected. These papers examine ‘performance measurement for the public sector’ and ‘the determinants’, from the perspective of sociology, economics, and management.

Step 4: Included.

The last step was to select 38 documents that fit the criteria, namely papers examining’ performance measurement for the public sector’ and ‘the determinants’.

3.4. Data analysis

This research focused the topic of the study on’ performance measurement’ and ‘public sector’. Therefore, prioritizing the study’s topic is’ performance measurement’ and ‘public sector’. The urgency to concern in the research paper analyses’ performance measurement’ and ‘public sector’ is crucial to explore the research gap other than the selected issue in contrast to an investigation of the extensive problem.

Contemplation of the definite extensive theme:’ performance measurement’ and ‘public sector’ in other topics’, to make sure this research focuses on the research topic, the selected documents also facilitate the documents related to the application of ‘performance measurement’ and ‘public sector’, in other fields. Since ‘performance measurement’ and ‘public sector’ comprehends the measurement, selecting articles in other not exclusive to this topic is viewed as needed.

This study’s aim paper selection was made by choosing a specific research bibliography. As exposed in , the choices from research catalogs were implemented. This study selects the papers from Scopus, as those search engines have a broad bibliography collection of the documents. The reliable and relevant exploration papers from those search engines are carefully chosen and analyzed. Nevertheless, that method may imply numerous reports and be inefficient in classifying the articles. Therefore, to discover the related papers, it is also probable to organize keywords in advance and determine the bases of the documents, such as a specific source, to limit the papers’ results.

This research examines the chosen studied articles by implementing depth-paper analyses. This research also analyzed every selected report to a specific phase until we know the core of the research information, objective, and result. Afterward, the researchers categorized the papers by types of context: ‘advanced and developing countries’, methodology being conducted which allied to the objectives of the research, implication, and methodology being implemented by the issue’s papers analyzed. Finally, this paper discussed the theme of those papers.

By the stated classification above, it is crucial to boundary the debate of this study, considering the publishers’ and papers’ editions. This research still requires expert perspectives to confirm the study categorization; and tools like information searching and text examination (Walczak & Kellogg, Citation2015). That explanation describes why a rigid-based paper categorization scheme fits the need of this research (Denyer et al., Citation2008). Many studies are concerned with performance measurement, such as the program performance as the object to examine (Ferdilan et al., Citation2021).

Typology is an ‘organized system of kinds’ that lead to improved thought of complicated facts (Collier et al., Citation2012; Kluge, Citation2000). But, the lack of clarity and consistency ruins academic research, as well as practical. Description and agreement are critical for any systematic search for knowledge (Choong, Citation2014). Without a compatible and definitive theory, then the study is problematic. Nor is it only an ivory tower consideration. Practical adoption is also hindered. To reach this objective, this paper conducted the following phase. It first described performance measurement and state some areas with its implementation, implying that these complications as a result of weak theory at the underlying level. Examples of theoretical distractions are noted. Afterward, the paper seeks to the categorization pattern, in generic and by analyzing and evaluating some general patterns applied in the research of performance measurement. Constructed based on the pattern, a new approach to categorization is constructed on a more proper barometer. This paper concludes by recording the value of the classification and the possible extension. A series of iterative examinations were conducted to assure the validity of the classification, concerning the correlation, similarity, and contrasting, and uniqueness (Kluge, Citation2000). The finding was what could be organized as a theory rather than an informative classification (Collier et al., Citation2012).

4. Results

There are 38 papers about management factors that influence the manifestation of ‘performance measurement’ and ‘public sector’ as shown in . The ‘performance measurement’ and ‘public sector’ varies from quantitative, qualitative, and mixed-method. Some management factors that lead to ‘performance measurement’ and ‘public sector’, including in the individual and organization. Most of the papers were conducted in Europe and organizational level as the unit analysis.

Table 1. Reviewed papers.

Declaring the unit analysis is crucial in analyzing the data. The unit analysis can be the person or other things, such as individuals, groups, organizations, nations, and skills due to the limitless object of the research (S. Kumar, Citation2018).

There is an almost limitless variety of potential units of analysis in social research. Even individuals are the most common unit of study, yet, various research questions can be answered more effectively via the study of other kinds of units. Thus, social scientists can study anything that stands on social life. They could be also a person, aggregate level of groups or organizations, the institutions in a special, or cultural and social context (Rosenberg, Citation1968). John and Lofland (Citation1995) divided the unit of analysis into roles, organizations, relationships, and social world. They could be also a person, group, space, and social (Yurdusev, Citation1993). While in performance measurement research, the unit of analysis commonly on the individual, department, and organization (van der Kolk, Citation2022). Thus, the various units of analysis in this study are the individual and the organization due to the most common unit of analysis are those units of analysis.

The Scopus search engines led the number with the keywords: ‘performance measurement’, and ‘public sector’, = 727 articles. Therefore, the articles were chosen and analyzed due to the correlation of the limitation of the issue. The following phase to narrow the papers was based on the peer-reviewed title, abstract, and duplication. The results were 38 papers. The final step was skimming, scanning, and thoroughly reading the papers that discussed ‘performance measurement for the public sector’. Some studies finding in illustrates based on the keyword being applied are not associated with the boundary or context of the theme of the issue, are too far from the correlation to ‘performance measurement for the public sector’, or the article does not discuss this theme were deleted, such as a paper examining the great green wall in the Sahara to get an insight of the SWOT analysis of the Sahara restoration (Sarr et al., Citation2022) to get noticed the novelty of the current research. The result was that 38 papers discussed performance measurement for public sector organizations development published between 2013 and 2022 ().

Figure 3. Number of chosen papers yearly.

Figure 3. Number of chosen papers yearly.

Nevertheless, some chosen articles were not planned, which expresses that the current research has been limited. The classification of the paper’s topic was founded on the awareness that implementing the performance measurement concept that concerns the public sector.

Unit of analysis form as a typology: individual and organizational was chosen explicitly because those forms are known differently in practice founded on which kind of unit analysis is being analyzed. The selected papers are shown in .

This research shows the assortment of papers based on this base. Some documents produced by the exploration activity through the Scopus Preview discuss ‘performance measurement’, and ‘public sector’, in this research. Some were comprised, and some were omitted, due to the nature of the papers. Some papers discussed performance measurement as an additional issue and elaborated lightly, some stating the terms of performance measurement without elaborating more deeply. Some have no definite approach or research practice that quotes the phenomenon of performance measurement. Those types of papers were excluded.

4.1. Assortment of papers based on country, setting

Regarding , this research shows that the leading recent research on PMF has been carried out in the context of the public sector. This research analyses numerous methods connected to the context of PMF assortment. Nevertheless, PMF for public sector research papers based on the context of the country’s origin is mainly from the Europe countries’ perspectives or ‘west countries’. Primarily the topic of performance measurement papers is written by authors from the West and in the category of advanced economic countries. There are ten articles from Italy (Agostino et al., Citation2014; Barbato et al., Citation2018; Barbato & Turri, Citation2017; Bassani et al., Citation2022; Carlucci et al., Citation2014; Cepiku et al., Citation2017; Ippolito et al., Citation2022; Mauro, Citation2019; Poli et al., Citation2018; Sardi et al., Citation2022), Finland with 4 articles (Kallio et al., Citation2020; Mättö et al., Citation2020; Rajala et al., Citation2018; Stříteská & Sein, Citation2021), Canada with two articles (O’Neill et al., Citation2022; Sayed et al., Citation2022), Australia with two articles (Elbashir et al., Citation2022; Rana et al., Citation2019), While other Europe countries just have a paper each: (Siverbo et al., Citation2019), Czech (Krupička, Citation2021), Norwegian (Narayan, Citation2020; Stříteská & Sein, Citation2021), New Zealand (Narayan, Citation2020), France (Simonet, Citation2020), Poland (Dobija et al., Citation2019), Russia (Kalgin, Citation2016). There are also articles from Indonesia with three articles (Jurnali & Siti-Nabiha, Citation2015; Sofyani et al., Citation2018; Syachbrani & Akbar, Citation2020), Sweden with two articles (Avby et al., Citation2019; Stříteská & Sein, Citation2021), South Africa with two articles (Malakoane et al., Citation2022; Ndevu & Muller, Citation2018), Sudan with an article written by Alboushra et al., (Citation2015) and Thailand (Srimai, Citation2015) as other than West countries. Besides, there are also five papers written in the global context (Betto et al., Citation2022; Domokos & Szolnoki, Citation2020; J. Kumar et al., Citation2022; Lemire et al., Citation2013; Zheng et al., Citation2019).

Interestingly, there are many papers from Italy discussing the reformation of the government that force the public sector to adopt performance measurement. Besides, there is Syachbrani & Akbar (Citation2020) from Indonesia that claimed performance measurement for public sector organizations with poor performance even have been transforming in twenty years ‘organization culture’. Further research on the case of performance measurement adoption in Indonesia’s public sector organizations will be fascinating.

Further research on the implementation of another country will be exciting such as research on performance measurement for public sector organizations development from USA, Africa, and developing ‘West’ countries or advanced non-West economic countries and other populous emerging countries in Asia besides Indonesia, such as India. The ‘other’ perspectives will contribute to the theoretical and practical implications.

Besides, the context of the papers is mostly discussing the government and health. This fact is very critical for the policymakers and academicians toward learning the theoretical foundation of performance measurement adoption in the government setting because the performance measurement adoption is directed by the government, but there is still poor adoption, such as the case in Indonesia as stated by Syachbrani & Akbar (Citation2020) ().

Figure 4. The setting of the research.

Figure 4. The setting of the research.

4.2. Typology of the paper is based on the research methodology

The chosen paper’s methodology method was studied deeply to know the study’s position, the type of method used, and the results and limitations of the current research. The approach analyses concern is sampling procedure, approach, and suggested solution throughout the study. It is crucial to see this classification to know the concept of performance measurement in the public sector organization from the perception of the approach being applied to find the nature of recent academics’ state on this issue. Most of the previous research has involved the methodological perspective from a qualitative such as through semi-structured interviews and case studies. Previous research has also used quantitative form a survey methodology and a mathematical statistic approach, i.e., regression analysis. Some others are mixed method approaches that give broader analyses compared to just one approach: qualitative or quantitative method.

shows that most papers are analyzed based on qualitative approaches. In contrast, the other articles are analyzed by quantitative method and mixed-method. Interestingly, most articles explore the performance measurement and propose the framework without validating the framework through the quantitative method. Further research validating the proposed framework will be needed ().

Figure 5. Research method.

Figure 5. Research method.

4.3. Typology of papers based on the unit analysis

The chosen paper’s methodology method was studied deeply to know the position of the study and what type of unit analysis is for the performance measurement for public sector organizations’ development. It is crucial to see this classification to know the unit analysis of the literature to know the research gaps to fill.

shows that most papers discuss the organizational level (95%). Besides, there is a paper analyzed from an individual and another paper discussed from an organizational and individual perspective. Performance measurement is not only about the individual who runs the organization or the organization itself, but Performance Measurement need help from various actors and systems. To know how to promote Performance Measurement, especially for public sector organizations that have limited resources, there should be further research on the individual and both individual and organization levels to enhance the knowledge of this area ().

Figure 6. Unit analysis.

Figure 6. Unit analysis.

5. Discussion

The current research on the performance measurement adoption for public sector organizations shows a crucial need to get a solution to the transformation (George et al., Citation2019; Siverbo et al., Citation2019). In the rise of performance measurement adoption for public sector organizations, most of the literature is from Europe, with just a few from Asia, Africa, the USA, and Australia. It is interesting due to the numerous papers are from Asia: Indonesia. It shows that the performance measurement adoption for public sector organizations has not only spread in Europe but also in Asia, especially in Indonesia even with the poor transformation of performance measurement adoption. Indonesia as an emerging economy country in Asia expansive in the performance measurement adoption. Syachbrani & Akbar (Citation2020) stated that after 20 years of adopting performance measurement, the result is not significant. Learning from other countries, the government realizes the intervention at the individual and organizational level, so that result of the transformation will be maximum.

The adoption of performance measurement is much more crucial. These research findings confirm that the research method is still quite limited for mixed-method and quantitative approaches. The literature is just in the phase of exploring the information through observation or case study.

Performance measurement as a theoretical field could be challenging to describe (Choong, Citation2014; Singh et al., Citation2023). However, it is critical to conduct precisely that as a first action against establishing a classification. Some researchers have proposed that the critical aspect is the adoption of quantitative parameters to calculate organizational movement, work, and performance (Choong, Citation2013; Sitopu et al., Citation2021; Putera et al., Citation2022b). To broader the picture, some researchers have proposed that qualitative should be comprised (García-Aracil & Palomares-Montero, Citation2010). For the objective of this research, performance measurement is stated as the ‘application of the data to calculate organizational work, movement, and performance; this then mixed quantitative and qualitative elements’. Performance management is a richer area; it comprises performance measurement and the adoption of performance intelligence for the objective of the proposal and implementation (Kloot & Martin, Citation2000; Nudurupati et al., 2021; Robert et al., Citation2020). As this research is concerned with performance measurement, this research focuses on the performance management theory, as are considerable cross-overs (Audenaert et al., Citation2019; Murphy, Citation2019). Performance measurements of quantitative and qualitative parameters of some categories (Ferreira & Otley, Citation2009).

Examples of theoretical distractions are noted. Afterward, the paper seeks to the categorization pattern, in generic and by analyzing and evaluating some general patterns applied in the research of performance measurement. Constructed based on the pattern, a new approach categorization is constructed on the more proper barometer. This paper concludes by recording the value of the classification and the possible extension. A series of iterative examinations were conducted to assure the validity of the classification, concerning the correlation, similarity, contrast, and uniqueness (Kluge, Citation2000). The finding was what could be organized as a theory rather than an informative classification (Collier et al., Citation2012).

To fill those targets, this typology is based on findings in and is also affected by literature (Alach, Citation2017; Flynn, Citation1986; Smith, Citation1990). While the previous literature states the typology into four elements: level, measures, target, and actual, this research extended the element into five elements. The reason is due to the measurement performance measurement and state of some areas with its implementation, implying that these complications as a result of weak theory at the underlying level. Some efforts have been conducted to fix this problem (Lewis, Citation2015).

The public sector performance measurement literature does not comprise numerous efforts to explicitly seek and compare the theory and the practical. The vast majority of research are concerned with the design and implementation of performance measurement model and systems, the reaction of actors and organization to performance measurement, and the construction of normative suggestion for enhanced practical (Bititci et al., Citation2012; Johnsen, Citation2005). The literature on performance measurement divides the classification into four major groups, Fitzgerald, BSC, Strategic Value Framework, and outcome framework. The literature on the performance of measurement mostly conducts on the level of the organization, while at the same time, the unit of the individual also influences the result of the performance measurement adoption. Uncalculating the individual aspect as a critical influencing aspect will affect the adoption process, for example, the behavior of individuals who conduct manipulation due to the intervention just concern does not comprise the detail of individual behavior Kalgin (Citation2016). This research suggests comprising the unit of intervention as the fundamental of performance measurement (e.g., organizational, and individual) ().

Figure 7. Proposed typology.

Figure 7. Proposed typology.

The unit of intervention could be divided into two parts: individual and organization. Most of the previous research in discusses the intervention in the unit of organization. Just a paper examines the performance measurement in the unit of individuals Kalgin (Citation2016) and an article examined from the perspective of individual and organization (Dobija et al., (Citation2019). While the perspective of the intervention on the organization could be based on the organization or individual; or both organization and individual. Furthermore, performance measurement could lead to misinformation if the movement (Kravchuk & Schack, Citation2014; Cohen, Citation2019; Cohen et al., Citation2019) as the organization and individual have their goals. The reasoning is the correlation of among the organization’s movement and the individual goals. The application of individuals should be led by the organization’s goals. Otherwise, the conflict will come up in the case of individual behavior who conduct manipulation due to the intervention just concern do not comprise the detail of individual behavior Kalgin (Citation2016). Besides, when as the previous research stated the fundamental divisions are the level, this research found it insufficient no to dividing the nature of the performance issue being reviewed. This research, then, put the unit of intervention as the fundamental.

The next is the level of performance. It is stated that those were arranged in a causal chain which is claimed that the under-level influenced the shift of the upper level. The level of performance is generic enough to be adopted in the entire scope of the public organization. Those five levels are divided into five levels (Alach, Citation2017) and need to be validated (Flynn, Citation1986):

  1. The outcome or the intended final condition is the effect of the action applied. An example is the number of smokers. Different public sector organizations may focus on different results, such as those related to health (such as life expectancy), law enforcement (crime rates), or municipal government (economic performance within its jurisdiction), but the goals themselves are universal.

  2. The impact is ‘the transitional efforts undertaken to a result by the products provided by the entity’. The public sector experiences a wide variety of effects.

  3. The output is ‘the transitional efforts undertaken to a result by the products provided by the entity’. These are the first results from the outputs and are frequently referred to as ‘intermediate outcomes’ to differentiate them from ‘real outcomes’, which are the final alterations.

  4. Processes are activities inside the reporting entity that transform inputs into outputs. The results are not shared with any other parties, and the processes are not used elsewhere in the manufacturing process. Planning and budgeting, information technology, and human resources are all examples of procedures that are likely to be highly generalized, despite the fact that they may be used by vastly diverse public sector organizations.

  5. Input is the operations of the reporting entity to consume inputs in order to generate results or outputs. Inputs, like processes, tend to be very standard.

The third is the measures of performance. The operations of the reporting entity consume inputs in order to generate results or outputs. Inputs, like processes, tend to be very standard. Land, labor, and capital are the pillars of conventional economic models; these concepts may be renamed property and infrastructure, personnel, and money in public sector organizations. It’s possible that certain businesses have very distinct needs for their inputs, such as fresh meat for a public sector manufacturing company or fresh produce for a public school. In conclusion, inputs permit processes, which generate results, which have effects, which have consequences, which ultimately lead to outcomes (Smith, Citation1995).

The fourth is the target. Goals are ‘intended states for quantitative and qualitative performance evaluations’. The target number of surgeries throughout the reporting period and the intended average cost per output are both examples of such information that are readily understandable. In terms of consequences, it’s more convoluted. Desired effects and outcomes are goals, however general they may be since the phrase ‘desired’ indicates an intentional rather than descriptive assertion. However, context is crucial: ‘fewer individuals smoking’ might be an effective measure if it is only an assessment of the present condition, or it could be an effective aim if the reporting entity wants to see fewer smokers.

Because they are aimed after rather than just descriptive, all organizational goals may be categorized as targets. This encompasses broader, long-term objectives. Goals for the average cost per employee or any other lower-level aim are not clearly distinct from more qualitative goals, such as those found in vision statements.

The fifth is realization. The realizations are ‘qualitative and quantitative assessments of states of performance’, To put it simply, actuals are the outcomes that the reporting entity has accomplished in relation to predefined performance metrics. They provide a vivid picture. Despite appearances, typology allows for estimated levels of performance to be included in actuals. The reason for this is that estimates are just another kind of observation, albeit one that relies on old data rather than real-time information.

These findings could contribute to the policy maker as the tools to implement performance measurement in their regions. Besides, the findings will be contributing to the theoretical framework of performance measurement at the individual and organizational levels.

6. Implications

The theoretical implications in this study offer significant implications for research and theories that contribute to the literature on the development of the concept of performance measurement of public sector organizations. The practical implications of this research as reference material, evaluation and governance in public sector organizations (government).

7. Conclusion

This research has analyzed the scholarly research on performance measurement for public sector organizations. The literature review suggests gaps in the study of performance measurement related to based on individual and organizational intervention could influence the impact of organizational performance and could be another future research. It is possible to explore the complexity.

Nevertheless, the analyses of a fit performance measurement could expose novel understanding from the limited source of insight by applying inclusiveness. In the current literature, the performance measurement adoption could be examined by an individual and organization at the fundamental level. The typology should be based on the unit, level, measures, target, and realization. Since there has not been exclusive research about performance measurement adoption in Indonesia, future research could discuss the performance measurement adoption in Indonesia, and another populous countries such as China, India, or Brazil.

This research also suggests the limitation of this paper as the following research opportunity. The current research strategy facilitates the literature review from the Scopus Preview database. Therefore, due to the research limitation, future research may be enhanced the database from Web of Science and Google Scholar. This research inspires scholars to see this opportunity for the following literature review of the social, cultural, and political context in performance measurement from an inclusive viewpoint. These findings would contribute to future performance measurement and handling of problems related to performance measurement through the knowledge of the current study and the feasibility of public sector organizations. This research sees it crucial for academics to analyze this issue in the following research deeply. Such research findings will contribute from practical and theoretical sides.

Disclosure statement

No potential conflict of interest was reported by the author(s).

Additional information

Notes on contributors

Doris Febriyanti

Doris Febriyanti is a Doctoral Student and Assistant Professor in the Administrative Sciences Programme, Faculty of Social and Political Sciences, Universitas Padjadjaran, Bandung, Indonesia. Her research interests relate to Local Government Studies, Organization Public Sector, and Artificial Intelligence in Government.

Ida Widianingsih

Ida Widianingsih is a Professor at the Public Administration Department and Vice Dean for Learning, Student, and Research Affairs of the Faculty of Social and Political Sciences, Universitas Padjadjaran, Indonesia. Her research interests relate to public administration and development issues, inclusive development policy, and participatory governance.

Asep Sumaryana

Asep Sumaryana is a Lecturer at the Department of Public Administration, Faculty of Social and Political Sciences, Padjadjaran University, Indonesia. His research is related to Dynamic Systems, Public Organizations, and Public Management.

Rd. Ahmad Buchari

Rd. Ahmad Buchari is a Lecturer at the Public Administration Department, Faculty of Social and Political Sciences, Padjadjaran University, Indonesia. His research relates to Local Government, Public Policy Leadership, and Disaster Management.

References

  • Abdillah, A., Buchari, R. A., Widianingsih, I., & Nurasa, H. (2023). Climate change governance for urban resilience for Indonesia: A systematic literature review. Cogent Social Sciences, 9(1), 1. https://doi.org/10.1080/23311886.2023.2235170
  • Abdillah, A., Widianingsih, I., Buchari, R. A., & Nurasa, H. (2023). Implications of urban farming on urban resilience in Indonesia : Systematic literature review and research identification. Cogent Food & Agriculture ISSN, 9(1), 2216484. https://doi.org/10.1080/23311932.2023.2216484
  • Agostino, D., Steenhuisen, B., Arnaboldi, M., & de Bruijn, H. (2014). PMS development in local public transport: Comparing Milan and Amsterdam. Transport Policy, 33, 26–20. https://doi.org/10.1016/j.tranpol.2014.02.007
  • Alach, Z. (2017). Towards a standard conceptual typology of public sector performance measurement. Kotuitui, 12(1), 56–69. https://doi.org/10.1080/1177083X.2016.1225579
  • Alboushra, M. A., Md Shahbudin, A. S., & Abdalla, Y. A. (2015). Understanding challenges of performance measurement in a public university: Evidence from Sudan. Asian Social Science, 11(15), 10–21. https://doi.org/10.5539/ass.v11n15p10
  • Almeida Prado Cestari, J. M., Pinheiro de Lima, E., Deschamps, F., Morton Van Aken, E., Treinta, F., & Moura, L. F. (2018). A case study extension methodology for performance measurement diagnosis in nonprofit organizations. International Journal of Production Economics, 203, 225–238. https://doi.org/10.1016/j.ijpe.2018.06.018
  • Audenaert, M., Decramer, A., George, B., Verschuere, B., & Waeyenberg, T. V. (2019). When employee performance management affects individual innovation in public organizations: The role of consistency and LMX. The International Journal of Human Resource Management, 30(5), 815–834. https://doi.org/10.1080/09585192.2016.1239220
  • Avby, G., Kjellström, S., & Andersson Bäck, M. (2019). Tending to innovate in Swedish primary health care: A qualitative study. BMC Health Services Research, 19(1), 42. https://doi.org/10.1186/s12913-019-3874-y
  • Barbato, G., Salvadori, A., & Turri, M. (2018). There’s a lid for every pot! The relationship between performance measurement and administrative activities in Italian ministries. Cogent Business & Management, 5(1), 1527965. https://doi.org/10.1080/23311975.2018.1527965
  • Barbato, G., & Turri, M. (2017). Understanding public performance measurement through theoretical pluralism. International Journal of Public Sector Management, 30(1), 15–30. https://doi.org/10.1108/IJPSM-11-2015-0202
  • Bassani, G., Leardini, C., Campedelli, B., & Moggi, S. (2022). The dynamic use of a balanced scorecard in an Italian public hospital. The International Journal of Health Planning and Management, 37(3), 1781–1798. https://doi.org/10.1002/hpm.3440
  • Betto, F., Sardi, A., Garengo, P., & Sorano, E. (2022). The evolution of balanced scorecard in healthcare: A systematic review of its design, implementation, use, and review. International Journal of Environmental Research and Public Health, 19(16), 10291. https://doi.org/10.3390/ijerph191610291
  • Bititci, U., Garengo, P., Dörfler, V., & Nudurupati, S. (2012). Performance measurement: Challenges for tomorrow. International Journal of Management Reviews, 14(3), 305–327. https://doi.org/10.1111/j.1468-2370.2011.00318.x
  • Borst, R., Lako, C., & de Vries, M. (2014). Is performance measurement applicable in the public sector? A comparative study of attitudes among Dutch officials. International Journal of Public Administration, 37(13), 922–931. https://doi.org/10.1080/01900692.2014.944988
  • Bracci, E., Humphrey, C., Moll, J., & Steccolini, I. (2015). Public sector accounting, accountability and austerity: More than balancing the books? Accounting, Auditing & Accountability Journal, 28(6), 878–908. https://doi.org/10.1108/AAAJ-06-2015-2090
  • Bracci, E., Maran, L., & Inglis, R. (2017). Examining the process of performance measurement system design and implementation in two Italian public service organizations. Financial Accountability & Management, 33(4), 406–421. https://doi.org/10.1111/faam.12131
  • Budding, T., & Helden, J. v. (2022). Theme: Politicians’ use of accounting information. Editorial: Unraveling politicians’ use and non-use of accounting information. Public Money & Management , 42(3), 137–139. https://doi.org/10.1080/09540962.2022.2028467
  • Burgess, S., Metcalfe, R., & Sadoff, S. (2021). Understanding the response to financial and non-financial incentives in education: Field experimental evidence using high-stakes assessments. Economics of Education Review, 85, 102195. https://doi.org/10.1016/j.econedurev.2021.102195
  • Carlucci, D., Schiuma, G., & Sole, F. (2014). The adoption and implementation of performance measurement process in Italian public organisations: The influence of political, cultural and rational factors. Production Planning & Control, 26(5), 1–14. https://doi.org/10.1080/09537287.2014.906678
  • Cepiku, D., Hinna, A., Scarozza, D., & Savignon, A. B. (2017). Performance information use in public administration: an exploratory study of determinants and effects. Journal of Management & Governance, 21(4), 963–991. https://doi.org/10.1007/s10997-016-9371-3
  • Chenhall, R. H., Hall, M., & Smith, D. (2017). The expressive role of performance measurement systems: A field study of a mental health development project. Accounting, Organizations and Society, 63, 60–75. https://doi.org/10.1016/j.aos.2014.11.002
  • Choong, K. K. (2013). Understanding the features of performance measurement system: A literature review. In Measuring Business Excellence, 17(4), 102–121. https://doi.org/10.1108/MBE-05-2012-0031
  • Choong, K. K. (2014). The fundamentals of performance measurement systems: A systematic approach to theory and a research agenda. International Journal of Productivity and Performance Management, 63(7), 879–922. https://doi.org/10.1108/IJPPM-01-2013-0015
  • Cohen, H. B. (2019). An inconvenient truth about leadership development. Organizational Dynamics, 48), (1), 8–15. https://doi.org/10.1016/j.orgdyn.2017.10.002
  • Cohen, S., Manes Rossi, F., Caperchione, E., & Brusca, I. (2019). Local government administration systems and local government accounting information needs: Is there a mismatch? International Review of Administrative Sciences, 85(4), 708–725. https://doi.org/10.1177/0020852317748732
  • Collier, D., LaPorte, J., & Seawright, J. (2012). Putting typologies to work: Concept formation, measurement, and analytic rigor. Political Research Quarterly, 65(1), 217–232. https://doi.org/10.1177/1065912912437162
  • Denyer, D., Tranfield, D., & van Aken, J. E. (2008). Developing design propositions through research synthesis. Organization Studies, 29(3), 393–413. https://doi.org/10.1177/0170840607088020
  • Dobija, D., Górska, A. M., Grossi, G., & Strzelczyk, W. (2019). Rational and symbolic uses of performance measurement: Experiences from Polish universities. Accounting, Auditing & Accountability Journal, 32(3), 750–781. https://doi.org/10.1108/AAAJ-08-2017-3106
  • Domokos, L., & Szolnoki, D. W. (2020). Audit performance measurement model and the main areas of performance management. Pénzügyi Szemle = Public Finance Quarterly, 65(Special Issue), 7–22. https://doi.org/10.35551/PFQ_2020_s_1_1
  • Effectiveness of Entrepreneur Development Program Training, Chennai. (2018). A report submitted in partial fulfillment of the requirements for the award of degree of Master of Business Administration of Pondicherry University. Submitted by Mr. SakthiNarayanan.
  • Elbashir, M. Z., Sutton, S. G., Arnold, V., & Collier, P. A. (2022). Leveraging business intelligence systems to enhance management control and business process performance in the public sector. Meditari Accountancy Research, 30(4), 914–940. https://doi.org/10.1108/MEDAR-04-2021-1287
  • Ferdilan, R., Dhewanto, W., & Rustiadi, S. (2021). Evaluations of an entrepreneurship development program: A systematic literature review. JEMA: Jurnal Ilmiah Bidang Akuntansi Dan Manajemen, 18(2), 107. https://doi.org/10.31106/jema.v18i2.11461
  • Ferreira, A., & Otley, D. (2009). The design and use of performance management systems: An extended framework for analysis. Management Accounting Research, 20(4), 263–282. https://doi.org/10.1016/j.mar.2009.07.003
  • Flynn, N. (1986). Performance measurement in public sector services. Policy & Politics, 14(3), 389–404. https://doi.org/10.1332/030557386782628172
  • García-Aracil, A., & Palomares-Montero, D. (2010). Examining benchmark indicator systems for the evaluation of higher education institutions. Higher Education, 60(2), 217–234. https://doi.org/10.1007/s10734-009-9296-8
  • George, B., Walker, R. M., & Monster, J. (2019). Does strategic planning improve organizational performance? A meta-analysis. Public Administration Review, 79(6), 810–819. https://doi.org/10.1111/puar.13104
  • Hofstede, G. (2011). Dimensionalizing cultures: The Hofstede model in context. Online Readings in Psychology and Culture, 2(1), 8. https://doi.org/10.9707/2307-0919.1014
  • Hofstede, G. (2018). National culture. Hofstede Insights.
  • Hoque, Z. (2014). 20 years of studies on the balanced scorecard: Trends, accomplishments, gaps and opportunities for future research. The British Accounting Review, 46(1), 33–59. https://doi.org/10.1016/j.bar.2013.10.003
  • Ippolito, A., Sorrentino, M., Capalbo, F., & di Pietro, A. (2022). How technological innovations in performance measurement systems overcome management challenges in healthcare. International Journal of Productivity and Performance Management, 1(1), 1.
  • John, L., & Lofland, L. (1995). Analysing social settings: A guide to qualitative observation and analysis. Thomson Wadsworth.
  • Johnsen, Å. (2005). What does 25 years of experience tell us about the state of performance measurement in public policy and management? Public Money and Management, 25(1), 9–17. https://doi.org/10.1111/j.1467-9302.2005.00445.x
  • Jurnali, T., & Siti-Nabiha, A. K. (2015). Performance management system for local government: The Indonesian experience. Global Business Review, 16(3), 351–363. https://doi.org/10.1177/0972150915569923
  • Kalgin, A. (2016). Implementation of performance management in regional government in Russia: Evidence of data manipulation. Public Management Review, 18(1), 110–138. https://doi.org/10.1080/14719037.2014.965271
  • Kallio, T. J., Kallio, K. M., & Blomberg, A. (2020). From professional bureaucracy to competitive bureaucracy – redefining universities’ organization principles, performance measurement criteria, and reason for being. Qualitative Research in Accounting & Management, 17(1), 82–108. https://doi.org/10.1108/QRAM-10-2019-0111
  • Kaplan, R. S., & Norton, D. P. (1992). The balanced scorecard–measures that drive performance. Harvard Business Review, 70(1), 71–79.
  • Keser Ozmantar, Z., & Gedikoglu, T. (2016). Design principles for the development of the balanced scorecard. International Journal of Educational Management, 30(5), 622–634. https://doi.org/10.1108/IJEM-01-2015-0005
  • Kitchenham, B. (2004). NICTA technical report: Procedures for performing systematic reviews (Vol. 33). Keele University.
  • Kloot, L., & Martin, J. (2000). Strategic performance management: A balanced approach to performance management issues in local government. Management Accounting Research, 11(2), 231–251. https://doi.org/10.1006/mare.2000.0130
  • Klovienė, R., Gimžauskienė, E., Stravinskienė, J., & Misiūnas, D. (2016). Measuring performance: Case of Lithuanian municipalities. Engineering Economics, 27(2), 213–220. https://doi.org/10.5755/j01.ee.27.2.14333
  • Kluge, S. (2000). Empirically grounded construction of types and typologies in qualitative social research. Forum Qualitative Sozialforschung/Forum: Qualitative Social Research, 1(1), 14.
  • Kravchuk, R. S., & Schack, R. W. (2014). Designing effective performance-measurement systems under the government performance and results act of 1993. Public Administration Review, 56(4), 348. https://doi.org/10.2307/976376
  • Kroll, A., & Proeller, I. (2013). Managing and measuring performance in public and nonprofit organizations: an integrated approach. International Journal of Public Sector Management, 26(1), 74–85. https://doi.org/10.1108/09513551311293435
  • Krupička, J. (2021). The performance management design in public hospitals: A case study. NISPAcee Journal of Public Administration and Policy, 14(1), 107–133. https://doi.org/10.2478/nispa-2021-0005
  • Kumar, J., Prince, N., & Baker, H. K. (2022). Balanced scorecard: A systematic literature review and future research issues. FIIB Business Review, 11(2), 147–161. https://doi.org/10.1177/23197145211049625
  • Kumar, S. (2018). Understanding different issues of unit of analysis in a business research journal of general ManaGeMent research. Journal of General Management Research, 5, 70–82.
  • Lapsley, I., & Miller, P. (2019). Transforming the public sector: 1998–2018. Accounting, Auditing & Accountability Journal, 32(8), 2211–2252. https://doi.org/10.1108/AAAJ-06-2018-3511
  • Lee, C., & Nowell, B. (2015). A framework for assessing the performance of nonprofit organizations. American Journal of Evaluation, 36(3), 299–319. https://doi.org/10.1177/1098214014545828
  • Lemire, M., Demers-Payette, O., & Jefferson-Falardeau, J. (2013). Dissemination of performance information and continuous improvement: A narrative systematic review. Journal of Health Organization and Management, 27(4), 449–478. https://doi.org/10.1108/JHOM-08-2011-0082
  • Leotta, A., & Ruggeri, D. (2017). Performance measurement system innovations in hospitals as translation processes. Accounting, Auditing & Accountability Journal, 30(4), 955–978. https://doi.org/10.1108/AAAJ-01-2014-1580
  • Lewis, J. M. (2015). The politics and consequences of performance measurement. Policy and Society, 34(1), 1–12. https://doi.org/10.1016/j.polsoc.2015.03.001
  • Malakoane, B., Heunis, J. C., Chikobvu, P., Kigozi, N. G., & Kruger, W. H. (2022). Improving public health sector service delivery in the Free State, South Africa: Development of a provincial intervention model. BMC Health Services Research, 22(1) https://doi.org/10.1186/s12913-022-07777-x
  • Martello, M., Watson, J. G., & Fischer, M. J. (2016). Implementing a balanced scorecard in a not-for-profit organization. Journal of Business & Economics Research (JBER), 14(3), 61–74. https://doi.org/10.19030/jber.v14i3.9746
  • Mättö, T., Anttonen, J., Järvenpää, M., & Rautiainen, A. (2020). Legitimacy and relevance of a performance measurement system in a Finnish public-sector case. Qualitative Research in Accounting & Management, 17(2), 177–199. https://doi.org/10.1108/QRAM-04-2018-0027
  • Mauro, S. G. (2019). Public sector performance-based budgeting in Italy. In Governance and public management (pp. 125–140). Springer. https://doi.org/10.1007/978-3-030-02077-4_6
  • Mazzucato, M. (2018). Mission-oriented innovation policies: Challenges and opportunities. Industrial and Corporate Change, 27(5), 803–815. https://doi.org/10.1093/icc/dty034
  • Mouchamps, H. (2014). Weighing elephants with kitchen scales: The relevance of traditional performance measurement tools for social enterprises. International Journal of Productivity and Performance Management, 63(6), 727–745. https://doi.org/10.1108/IJPPM-09-2013-0158
  • Moura, L. F., Pinheiro de Lima, E., Deschamps, F., M. Van Aken, E., Gouvea Da Costa, S. E., Tavares Treintaa, F., Almeida Prado Cestari, J. M., & Assumpção Silva, R. (2020). Factors for performance measurement systems design in nonprofit organizations and public administration. Measuring Business Excellence, 24(3), 377–399. https://doi.org/10.1108/MBE-10-2019-0102
  • Moxham, C. (2009). Performance measurement: Examining the applicability of the existing body of knowledge to nonprofit organisations. International Journal of Operations & Production Management, 29(7), 740–763. https://doi.org/10.1108/01443570910971405
  • Muhtar, E. A., Abdillah, A., Widianingsih, I., & Adikancana, Q. M. (2023). Smart villages, rural development and community vulnerability in Indonesia: A bibliometric analysis. Cogent Social Sciences, 9(1), 2219118. https://doi.org/10.1080/23311886.2023.2219118
  • Murphy, K. R. (2019). Performance evaluation will not die, but it should. Human Resource Management Journal, 30(1), 13–31. https://doi.org/10.1111/1748-8583.12259
  • Narayan, A. K. (2020). The development and use of performance measures in New Zealand tertiary education institutions. Accounting History, 25(2), 193–218. https://doi.org/10.1177/1032373219842383
  • Ndevu, Z. J., & Muller, K. (2018). Operationalising performance management in local government: The use of the balanced scorecard. SA Journal of Human Resource Management, 16 https://doi.org/10.4102/sajhrm.v16i0.977
  • Neely, A., Gregory, M., & Platts, K. (2005). Performance measurement system design: A literature review and research agenda. International Journal of Operations and Production Management, 25(12), 1228–1263. https://doi.org/10.1108/01443570510633639
  • Newberry, S. (2020). Policy conflict: The influence of fiscal targets on reform of New Zealand’s natural disaster fund. Financial Accountability & Management, 36(2), 189–206. https://doi.org/10.1111/faam.12232
  • Nudurupati, S. S., Bititci, U. S., Kumar, V., & Chan, F. T. S. (2011). State of the art literature review on performance measurement. Computers & Industrial Engineering, 60(2), 279–290. https://doi.org/10.1016/j.cie.2010.11.010
  • O’Neill, M., de Prophetis, E., Allin, S., Pinto, A. D., Smith, R. W., di Ruggiero, E., Schwartz, R., Pawa, J., Ammi, M., & Rosella, L. C. (2022). “We cobble together a storyline of system performance using a diversity of things”: A qualitative study of perspectives on public health performance measurement in Canada. Archives of Public Health, 80(1), 177. https://doi.org/10.1186/s13690-022-00931-1
  • Poli, M., Cornolti, D., Pardini, S., & Iervasi, G. (2018). How and why to implement a performance management system in public research institutions: The approach and the experience of a large multidisciplinary Italian centre. International Journal for Quality Research, 12(3), 757–772. https://doi.org/10.18421/IJQR12.03-13
  • Pollitt, C., & Bouckaert, G. (2009). Continuity and change in public policy and management. Elgar. https://doi.org/10.4337/9781849802291
  • Pudovkin, A. I., & Garfield, E. (2002). Algorithmic procedure for finding semantically related journals. Journal of the American Society for Information Science and Technology, 53(13), 1113–1119. https://doi.org/10.1002/asi.10153
  • Putera, P. B., Suryanto, S., Ningrum, S., Widianingsih, I., & Rianto, Y. (2022a). Three decades of discourse on science, technology and innovation in national innovation system: A bibliometric analysis (1990 – 2020). Cogent Social Sciences, 8(1). https://doi.org/10.1080/23311886.2022.2109854
  • Putera, P. B., Widianingsih, Ida., Ningrum, S., Suryanto, S., & Rianto, Yan. (2022b). Overcoming the COVID-19 Pandemic in Indonesia: A Science, technology, and innovation (STI) policy perspective. Health Policy and Technology, 11(3), 100650.https://doi.org/10.1016/j.hlpt.2022.100650 PMC: 35813992
  • Putera, P. B., Suryanto, S., Ningrum, S., & Widianingsih, I. (2020). A bibliometric analysis of articles on innovation systems in Scopus journals written by authors from Indonesia, Singapore, and Malaysia. Science Editing, 7(2), 177–183. https://doi.org/10.6087/kcse.214
  • Rainey, H. G., & Jung, C. S. (2015). A conceptual framework for analysis of goal ambiguity in public organizations. Journal of Public Administration Research and Theory, 25(1), 71–99. https://doi.org/10.1093/jopart/muu040
  • Rajala, T., Laihonen, H., & Haapala, P. (2018). Why is dialogue on performance challenging in the public sector? Measuring Business Excellence, 22(2), 117–129. https://doi.org/10.1108/MBE-06-2017-0032
  • Rana, T., Hoque, Z., & Jacobs, K. (2019). Public sector reform implications for performance measurement and risk management practice: insights from Australia. Public Money & Management, 39(1), 37–45. https://doi.org/10.1080/09540962.2017.1407128
  • Reda, N. W. (2017). Balanced scorecard in higher education institutions: Congruence and roles to quality assurance practices. Quality Assurance in Education, 25(4), 489–499. https://doi.org/10.1108/QAE-09-2015-0038
  • Robert, M., Giuliani, P., & Gurau, C. (2020). Implementing industry 4. 0 real-time performance management systems: The case of Schneider Electric. Production Planning & Control, 33(2–3), 244–260. https://doi.org/10.1080/09537287.2020.1810761
  • Rosenberg, M. (1968). Introduction: ‘The meaning of relationships’, from the logic of survey analysis (4th ed., Vol. 6). Basic Books Inc., Publishers.
  • Sardi, A., Sorano, E., Giovando, G., & Tradori, V. (2022). Performance measurement and management system 4.0: An action research study in investee NPOs by local government. International Journal of Productivity and Performance Management, 72(4), 849–872. https://doi.org/10.1108/IJPPM-10-2021-0607
  • Sarr, M. S., Diallo, A. M., & King-Okumu, C. (2022). A review of public versus private reforestation programs in the Senegalese Sahel: Taking stock of realities and challenges. Restoration Ecology, 30(5), e13582. https://doi.org/10.1111/rec.13582
  • Sayed, N., Lento, C., & Henderson, M. (2022). Application of the Balanced Scorecard for strategy reformulation: Perspectives from a Canadian municipality. Canadian Journal of Administrative Sciences / Revue Canadienne Des Sciences de L’Administration, 39(3), 328–346. https://doi.org/10.1002/cjas.1644
  • Simonet, D. (2020). The quest for a better performing health system: Public expertise and corporate management recipes in France. Journal of Public Affairs, 20(1), e1985. https://doi.org/10.1002/pa.1985
  • Singh, S. K., Gupta, S., Busso, D., & Kamboj, S. (2023). Top management knowledge value, knowledge sharing practices, open innovation and organizational performance. Journal of Business Research, 128(August), 788–798. https://doi.org/10.1016/j.jbusres.2019.04.040
  • Sitopu, Y. B., Sitinjak, K. A., & Marpaung, F. K. (2021). The influence of motivation, work discipline, and compensation on employee performance. Golden Ratio of Human Resource Management, 1(2), 72–83. https://doi.org/10.52970/grhrm.v1i2.79
  • Siverbo, S., Cäker, M., & Åkesson, J. (2019). Conceptualizing dysfunctional consequences of performance measurement in the public sector. Public Management Review, 21(12), 1801–1823. https://doi.org/10.1080/14719037.2019.1577906
  • Smith, P. (1990). The use of performance indicators in the public sector. Journal of the Royal Statistical Society. Series A (Statistics in Society), 153(1), 53. https://doi.org/10.2307/2983096
  • Smith, P. (1995). On the unintended consequences of publishing performance data in the public sector. International Journal of Public Administration, 18(2–3), 277–310. https://doi.org/10.1080/01900699508525011
  • Sofyani, H., Akbar, R., & Ferrer, R. C. (2018). 20 Years of performance measurement system (PMS) implementation in Indonesian local governments: Why is their performance still poor? Asian Journal of Business and Accounting, 11(1), 151–184. https://doi.org/10.22452/ajba.vol11no1.6
  • Speklé, R. F., & Verbeeten, F. H. M. (2014). The use of performance measurement systems in the public sector: Effects on performance. Management Accounting Research, 25(2), 131–146. https://doi.org/10.1016/j.mar.2013.07.004
  • Srimai, S. (2015). Performance agreement in Thai public sectors a call for reconsideration at the provincial level. International Journal of Productivity and Performance Management, 64(5), 625–639. https://doi.org/10.1108/IJPPM-06-2013-0112
  • Steccolini, I. (2019). Accounting and the post-new public management: Re-considering publicness in accounting research. Accounting, Auditing & Accountability Journal, 32(1), 255–279. https://doi.org/10.1108/AAAJ-03-2018-3423
  • Stříteská, M. K., & Sein, Y. Y. (2021). Performance driven culture in the public sector: The case of nordic countries. Administrative Sciences, 11(1), 4. https://doi.org/10.3390/admsci11010004
  • Syachbrani, W., & Akbar, R. (2020). The influence factors of the development of performance measurement systems in Indonesia central government [Paper presentation]. Proceedings of the International Conference on Industrial Engineering and Operations Management, August.
  • ter Bogt, H. J., Jan Van Helden, G., & van der Kolk, B. (2015). Challenging the NPM ideas about performance management: Selectivity and differentiation in outcome-oriented performance budgeting. Financial Accountability & Management, 31(3), 287–315. https://doi.org/10.1111/faam.12058
  • Valentinov, V. (2011). The meaning of nonprofit organization: Insights from classical institutionalism. Journal of Economic Issues, 45(4), 901–916. https://doi.org/10.2753/JEI0021-3624450408
  • Van der Kolk, B. (2022). Performance measurement in the public sector: Mapping 20 years of survey research. Financial Accountability & Management, 38(4), 703–729. https://doi.org/10.1111/faam.12345
  • Waggoner, D. B., Neely, A. D., & Kennerley, M. P. (1999). Forces that shape organisational performance measurement systems: An interdisciplinary review. International Journal of Production Economics, 60-61, 53–60. https://doi.org/10.1016/S0925-5273(98)00201-1
  • Walczak, S., & Kellogg, D. L. (2015). A heuristic text analytic approach for classifying research articles. Intelligent Information Management, 07(01), 7–21. https://doi.org/10.4236/iim.2015.71002
  • Widianingsih, I., Paskarina, C., Riswanda, R., & Putera, P. B. (2021). Evolutionary study of watershed governance research: A bibliometric analysis. Science & Technology Libraries, 40(4), 416–434. https://doi.org/10.1080/0194262X.2021.1926401
  • Yurdusev, N. (1993). Level of analysis’ and “unit of analysis” a case for distinction. Millennium: Journal of International Studies, 22(1), 77–88. https://doi.org/10.1177/03058298930220010601
  • Zheng, Y., Wang, W., Liu, W., & Mingers, J. (2019). A performance management framework for the public sector: The balanced stakeholder model. Journal of the Operational Research Society, 70(4), 568–580. https://doi.org/10.1080/01605682.2018.1448247