1,485
Views
0
CrossRef citations to date
0
Altmetric
Research Articles

Empowering local citizens: assessing the inclusiveness of a digital democratic innovation for co-creating a Voting Advice Application

ORCID Icon, , ORCID Icon &
Pages 174-203 | Received 14 Feb 2022, Accepted 19 Feb 2023, Published online: 05 Mar 2023

ABSTRACT

Increasing citizen dissatisfaction with democracy leads governments and municipalities across the globe to seek new ways of including and empowering citizens. Little is known about whether ‘Digital Democratic Innovations’ (DDIs) could contribute to this goal. We developed a new DDI in a Swiss municipality, dubbed Demokratiefabrik, where 1,079 citizens co-created a questionnaire that served as an official Voting Advice Application for candidates and voters in communal elections. We find that while sophisticated and allegiant citizens and left-green voters participated more in the DDI, they did not dominate the process of creating the questionnaire. Intriguingly, citizens with lower political trust were particularly active on the platform, suggesting that DDIs might give disenchanted citizens a new voice in the political process. Overall, carefully designed DDIs can be a venue for inclusive citizen participation, involving and empowering local citizens in decision-making.

Introduction

The perceived crisis of democracy with increasing citizen dissatisfaction and declining political trust has triggered a boom of participatory and deliberative innovations. A big issue is whether such democratic innovations are similarly promising to democracy as soon as they take place online. Can Digital Democratic Innovations (DDIs) supplement (or even replace) traditional democratic innovations (such as face-to-face mini-publics)?

Unlike conventional face-to-face venues, DDIs offer the possibility of linking many more people from diverse backgrounds and geographical contexts to political processes in a bottom-up, co-creative and easy way. The latter is especially true when DDIs are organised asynchronously, enabling people to participate at their own pace and independently of space and time (Iandoli et al. Citation2018). If designed to ensure the anonymity of participants, DDIs can further help suppress cues regarding gender or age, and promote inclusivity in online interactions. Moreover, locally organised DDIs hold the potential to appeal to the broader population since they offer the possibility of expressing citizens’ everyday concerns and needs.

On the other hand, DDIs also have several drawbacks. For instance, we know that unstructured online environments with self-selected participation (such as commentaries on news websites or Facebook) can entail low argumentative complexity and incivility (Esau, Friess, and Eilders Citation2017; Quinlan, Shephard, and Paterson Citation2015). Moreover, they may exclude specific social strata from participation, such as older persons who lack the necessary technical skills (see Karen, Tolbert, and Stansbury Citation2003; Kersting et al. Citation2019). Due to these inconsistent results regarding the inclusionary and exclusionary potential of digital platforms, it is still unclear whether DDIs can meaningfully enrich the existing forms of participation (Kersting et al. Citation2019, 119).

Departing from this puzzle, this article explores whether well-structured DDIs represent a promising opportunity for (local) authorities to (re-)engage and (re-)include citizens in the political process. It ‘zooms in’ on a real-life DDI to test what the inclusionary potential of DDIs might be, and what democratic downsides DDIs might have. We evaluate whether and how an asynchronous DDI – dubbed ‘Demokratiefabrik’ – with anonymous participants, fosters democratically desirable forms of participation and inclusion of citizens in the context of creating a citizen-driven Voting Advice Application (VAA) in a Swiss municipality, Köniz, in June and July . Based on a series of questions on political issues, VAAs allow citizens to find parties and candidates whose policies most closely match their own (Munzert et al. Citation2020). Traditionally, VAA questionnaires are composed by the VAA operator in cooperation with major media organisations. The Demokratiefabrik allows citizens to compose the questionnaire of political issues themselves in innovative ways.

We conduct an analysis of the inclusion potential of this DDI with a focus on traditionally under-represented citizen groups (such as citizens who are female, less educated, and less sophisticated politically) as well as citizen groups who are disenchanted with the current workings of democracy (including populist voters). Analytically, we distinguish between the ‘external’ and ‘internal’ dimension of inclusion (Young Citation2002). On the one hand, we assess whether all citizen groups followed our invitation and showed up on the online platform (external dimension of inclusion); on the other hand, we assess whether all citizen groups take part at comparable intensity and quality levels (internal dimension of inclusion). Furthermore, to assess the inclusionary potential of DDIs, we also assess how satisfied participants are with the DDI. Process satisfaction is a critical evaluation yardstick, indicating whether such tools can incite a willingness for further participation.

The paper is structured as follows: we first introduce in more detail the relevant theoretical concepts on DDIs and inclusion. We also provide a literature review on this topic. Next, we present the case of the Demokratiefabrik, followed by an outline of our measurement of outcome and predictor variables and the statistical methods we employed. Then, we present the empirical results, followed by a discussion of our findings and a conclusion.

Digital democratic innovations and inclusion

Democratic innovations refer to ‘institutions that have been specifically designed to increase and deepen citizen participation in the political decision-making process’ (Smith Citation2009, 1). These democratic innovations were supposed, among other things, to help solve the ‘democratic malaise’ (Geissel and Newton Citation2012) and are typically organised as face-to-face deliberations comprising only a few dozen participants (Smith Citation2009).

Digital democratic innovations, by contrast, offer a new possibility to involve a larger number of citizens in the democratic process. They can remove organisational barriers and diminish the costs of bringing many people together.

Arguably, more important than the sheer number of people involved in a democratic process is the degree of democratic inclusion. Inclusion means ‘that all members of the given polity should ideally have effectively equal influence over debate and decision-making within that polity’ (Young Citation2002, 8). Young (Citation2002, 52) famously distinguished two sets of mechanisms of inclusion/exclusion. She argues that ‘external exclusions’ are practices ‘that keep some individuals or groups out of the fora of debate or processes of decision-making’. In contrast, ‘internal exclusions’ are forms of exclusions present even when individuals are nominally included in the process. Examples are specific styles of expression or interaction privileges (Young Citation2002, 52). An assessment of the inclusionary aspect of DDIs shall, therefore, include not only an assessment of who takes part but also an assessment of whether the participants within the digital processes are equally active, discursive, and satisfied with the process.

In evaluating mechanisms for inclusion/exclusion, we focus on citizen groups who are often underrepresented in political participation. Hence, we closely observe participation patterns of gender and age groups as well as citizens with lower political sophistication (i.e., citizens with lower internal efficacy and lower formal education). Additionally, we include in our analyses two expressions of political (dis)satisfaction, namely citizens with low level of external efficacy and citizens with populist attitudes (who think that the democratic system tends to bypass the will of ordinary people).Footnote1 Focusing on these forms of political (dis)satisfaction, we particularly address a prominent claim that democratic innovations are able to reinclude dissatisfied citizens who turned away from traditional participation instruments (Goldberg, Wyss, and Bächtiger Citation2020).

So, what can we expect for DDIs when it comes to external and internal forms of inclusion? We introduce four theoretical scenarios. (1) Democratically speaking, an optimistic or ideal scenario would arise when under-represented, less sophisticated and dissatisfied citizens ‘flocked’ to DDIs at an equal rate as more privileged, sophisticated and allegiant citizens, and were equally active, discursive and satisfied within the digital forum. (2) Conversely, a pessimistic scenario would occur when only few under-represented, less sophisticated and dissatisfied citizens were willing to participate and those participating were largely inactive, non-discursive and dissatisfied with the experience. This would indicate that DDIs are the ‘playground’ of already advantaged citizens and undermines their role as democracy promoting tools. (3) A ‘mixed’ scenario arises when, for instance, a substantial share of under-represented, less sophisticated and dissatisfied citizens show up at the event but then remain passive and non-discursive and/or are dissatisfied with the experience. As presence does not guarantee voice and influence, this mixed scenario would imply that DDIs can hardly close the ‘representation’ gap that currently suffuses the workings of democracies. (4) Another ‘mixed’ scenario occurs when under-represented, less sophisticated and dissatisfied citizens were less willing to participate than more privileged, sophisticated and allegiant citizens but they were equally active, discursive and satisfied within the digital forum as the latter.

Few studies have investigated the link between DDIs and inclusion, especially when it comes to ‘external’ inclusion. Results are very mixed and hover between a pessimistic and a mixed scenario. In a pioneering study on online discussions held before the 2000 US presidential campaign, Price and Cappella (Citation2002) found that people with higher political knowledge were more likely to participate in the online event, while older participants and those in full-time employment were less likely to participate. Other factors such as political efficacy, political interest and formal political participation did not turn out as significant predictors for online participation (Price and Cappella Citation2002). Subsequent studies paint an even more pessimistic picture. Comparing face-to-face and online environments, Baek, Wojcieszak, and Delli Carpini (Citation2012) found that young, male, and white users, as well as ideological moderates, are overrepresented in online forums. Focusing on online consultations in different German municipalities, Rottinghaus and Escher (Citation2020) reveal some biases regarding external inclusion, with men and middle-aged citizens being overrepresented. However, not all studies yield pessimistic conclusions. Neblo et al. (Citation2010) have conducted an online deliberative experiment to explore the willingness of citizens to participate (and their actual participation) in sessions involving US citizens and members of Congress. The experiment shows that the willingness to participate in such sessions was much higher than evidence from face-to-face participation research suggests. As Neblo et al. (Citation2010, 582) put it: ‘those most willing to deliberate are precisely those turned off by standard partisan and interest group politics’. These findings for external inclusion almost align with an ideal scenario and suggest that DDIs might give a voice to citizens absent in conventional participation processes.

Regarding ‘internal’ inclusion, a pattern regularly detected in large-scale online participation is the pronounced divide between users who participate actively and enthusiastically and users who prefer to observe. The latter group is often referred to as ‘lurkers’ and tends to represent the vast majority of participants (Rafaeli, Ravid, and Soroka Citation2004; Janssen and Kies Citation2005). Empirical studies suggest that the active users (i.e., citizens who contribute on the DDI, the so-called ‘contributors’) are only a fraction of the total users and clearly differ from passive users regarding their political characteristics. Analysing online discussions in two online projects and predicting individual word counts, Price (Citation2009) found that older participants contributed with fewer words. Other variables such as education, political participation, and political knowledge had a positive effect on contributing (Price Citation2009). Smith, John, and Sturgis (Citation2012) found that people who use the internet frequently were no more active in the online forum than people who use the internet less frequently. Moreover, women were more likely to post comments. Another study focusing on online political participation in Germany found that men, as well as persons with higher internal political efficacy and higher education, were more likely to participate actively on the platform (Rottinghaus and Escher Citation2020). Finally, Kennedy et al. (Citation2021) obtained more optimistic findings in the context of an online synchronous platform in the US. They found that participants who were female, non-white, or aged 65 and over posted fewer comments than men, white and younger users.

By focusing on a real-life DDI where citizens could directly influence institutional politics, and by considering a broad array of ‘external’ and ‘internal’ forms of inclusion, our study tries to advance the debate of how ‘inclusive’ (and democratic) DDIs are and whether they represent a robust tool for citizen engagement and empowerment.

Demokratiefabrik: increasing citizens’ empowerment within the democratic practices of a municipality

Case and procedure

The Demokratiefabrik represents a new tool for citizen involvement and empowerment. In our case, a large group of citizens used the DDI to create a questionnaire for the Swiss Voting Advice Application (dubbed ‘smartvote’). smartvote is well established in Switzerland and helps voters match their attitudes and preferences on various political issues with candidates running for local, regional, or national elections (Fivaz and Nadig Citation2010; Ladner and Pianzola Citation2015).Footnote2 To date, the questionnaires used for smartvote were created by the owner association Politools in cooperation with parties and media professionals. In contrast, in the Demokratiefabrik, randomly selected citizens were in charge of designing the questionnaire without the involvement of experts (i.e., representatives, administration members or scientists).

The fact that citizens were given the opportunity to directly influence institutionalised politics can be considered a powerful stimulus to participate in DDIs.

By inviting citizens to design the VAA-questionnaire, we wanted to obtain a questionnaire that reflects the real citizens’ concerns and wishes. Yet, Lefevere and Walgrave (Citation2014) have demonstrated that designing a VAA-questionnaire is a delicate task, since minor variations in the questionnaire can affect the final voting advice. To increase the VAA’s accuracy, we produced a questionnaire that is longer than usual. We also avoided double-barrelled or redundant questions and we have taken into account the salience judgements of the citizens when we decided on the number of questions that represent the political themes.

The Demokratiefabrik came into action in advance of a local election held in September 2021 in the Swiss-German municipality of Köniz. This municipality has a population of 43,000 and is Switzerland’s 12th largest city. Moreover, Köniz is a heterogeneous, geographically dispersed municipality comprising urban and rural areas. As such, Köniz is a very useful case: first, it offers a potentially high number of platform collaborators. Second, its diversity enables us to focus on a wide range of opinions and preferences. The Demokratiefabrik thus opened up a new possibility of exchange among citizens who rarely interact in daily life due to geographical and/or political-ideological distance.

The Demokratiefabrik started three months before the local elections and was accessible for three weeks from 14 June to 4 July 2021. This allowed citizens to develop the final VAA-questionnaire so that it could be uploaded on the Swiss VAA’s website in time to permit all citizens to have their personal voting advice. Before the platform was opened to citizens, all local political parties were asked to propose a few VAA-questions as a starting point. These were reviewed by both the research and smartvote teams and then uploaded on the Demokratiefabrik (two to three questions per topic). This prevented that the users who logged in at the very beginning not became discouraged by an empty list.

To recruit participants, we sent an invitation letter to 9,000 randomly selected citizens entitled to vote from the local voting register (N = 9,000). These represent about one-third of all voters living in Köniz. In the letter, citizens received the login credentials for the online platform and were informed about the financial incentive to participate (a prize draw for 10 × 400 CHF vouchers for a local travel agency). We expected that the prize draw would increase the participation rate, particularly among individuals with lower political resources.

When logged in for the first time on the online platform, participants could read the information material (code of conduct, VAA background) and had to complete a preliminary online survey (T1), a prerequisite to actively participate in the Demokratiefabrik. In the T1 survey, data on socio-demographic variables, political attitudes, political participation, and digital aspects were collected. At the end of the three week participation period on the platform, citizens who actively participated (i.e., citizens who indicated the perceived salience of at least one VAA-theme) were invited to complete a second online survey (T2). In this second survey, participants evaluated their experience regarding the Demokratiefabrik. After the closing of the Demokratiefabrik, the research team – together with smartvote – finalised the VAA-questionnaire.Footnote3 The final VAA-questionnaire can be seen in in the Appendix.

Throughout the citizen engagement phase on the DDI, the research team of moderators offered support for participants’ questions. Moreover, the team was responsible for keeping the online discussions concise by structuring discussion threads. As no hate-speeches or other notable violations of the code of conduct were observed, the team was neither prompted to delete comments nor exclude users.

Features of the Demokratiefabrik

We designed the DDI to motivate users to actively participate and to minimise biases between those who actively participate and ‘lurkers’ (see above). In large-scale environments, however, we must accept the fact that some participants will be silent. An attempt to ‘de-lurk’ participation by urging users to post their reflections would most likely lead to information overload, accompanied by redundancy problems and a low signal-to-noise ratio (Rafaeli, Ravid, and Soroka Citation2004; Gürkan et al. Citation2010). The Demokratiefabrik uses the following design features to promote online activity:

  • Anonymity: research shows that anonymity can increase the motivation to participate, particularly among more conflict-averse citizens or citizens who fear social pressure or lack the necessary self-confidence to express their opinion in public (Wyss and Beste Citation2017). Anonymity may also help to reduce societal inequalities and social pressure (Baek, Wojcieszak, and Delli Carpini Citation2012; Price Citation2009). Following Moore et al. (Citation2019), we decided to implement durable pseudonyms guaranteeing anonymity towards other users (and third-party actors). According to Moore et al. (Citation2019, 61), the durability of these pseudonyms might open up the possibility of a more significant commitment to the discussion space and enhance the potential for learning effects. When entering our DDI for the first time, participants received a randomly selected pseudonym in the form of a Swiss mountain (e.g., ‘H. Matterhorn’).

  • Artificial facilitation: participants on the platform were assisted by two artificial facilitators (i.e., avatars). The artificial facilitators were programmed to help participants orient themselves on the platform and thus guided digitally less experienced participants through the Demokratiefabrik.

  • Asynchrony: to enable thousands of citizens to collaborate, the Demokratiefabrik was designed as an asynchronous platform (e.g., Klein Citation2012). During the three weeks, the invited citizens could log in on the digital platform and complete the tasks at their own pace and independently of space and time.

  • Review mechanism: to let participants influence the output of the platform without having to formulate their own content, the online platform was provided with a review mechanism. Randomly selected participants reviewed randomly assigned proposals for a new question or refinements to an existing question proposed by other participants. This mechanism encouraged the active participation of all invited citizens, as randomly selected citizens – regardless of their characteristics and political orientations – had to express their preference for a new question and/or refinement of an existing question. The mandatory peer review processes thus represented a low-threshold channel to engage otherwise passive users in the platform’s governance and allow them to shape the output.

Participants were asked to complete four assignments. First, as a mandatory task, they were asked to indicate the perceived salience of different VAA-themes and VAA-questions. Second, they could propose new questions for the VAA-questionnaire or propose a refinement of an existing question. Third, they could write comments and/or queries under each theme and question and, thus, contribute to discussions and deliberation on political issues or specific questions. Fourth, they were occasionally asked to review assigned proposals of other participants. Only proposals approved by a majority of ten (randomly assigned) participants remained on the platform.Footnote4

Operationalisation and methods

We start by elaborating on the external and internal dimensions of inclusion: regarding the external dimension, we consider who actually took part in the Demokratiefabrik. Here, we focus on the group of participants who rated at least one theme or question (N = 1,079) and compare this information with the randomly drawn sample of citizens invited to participate in the study (N = 9,000) and with evidence from other studies (gfs.bern Citation2021; Räss, Differding, and Odermatt Citation2021).Footnote5 Concretely, we look at the age of the participating citizens, their gender, whether they live in a rural or urban municipality, their placement on the political spectrum, their preferred party, their interest in politics, their (local) political trust, their satisfaction with democracy, populism and digital affinity.

Regarding the internal dimension of inclusion, we investigate whether there are certain types of citizens who dominated the process on the platform. One way to do so is to assess who extensively added own content in the form of VAA-questions or comments. However, citizens could also dominate by extensively participating at the peer review-mechanism. When citizens just read and rate themes and questions of other participants (without contributing any content and without participating in the review mechanism), we would not count this as ‘dominance’. To account for different forms of domination, we construct a categorical variable with three values, namely activity of ‘contributors’, ‘review-only users’ and passive citizens (so called ‘lurkers’).

Due to the categorical character of the dependent variable, we estimate multinomial logit models. As we also assess levels of participation quality, we check whether there are differences in ‘discursiveness’ (measured via the psychological construct of integrative complexity). Discursiveness – while rarely assessed in the context of DDIs (see, e.g., Esau, Friess, and Eilders Citation2017; Kersting Citation2005) – is a critical indicator of whether participants in interactive tools can participate in competent ways; moreover, we know from research on mini-publics that levels of discursiveness can affect opinion formation . Integrative complexity captures the ‘differentiation’ of viewpoints (i.e., the extent to which participants take a multitude of perspectives into account) and ‘integration’ of viewpoints (i.e., the degree to which participants account for complexities in their reasoning). It is measured based on an automated LIWC (Linguistic Inquiry & Word Count) dictionary-based approach (Brundidge et al. Citation2014; Wyss, Beste, and Bächtiger Citation2015). Integrative complexity may also be a partial ‘proxy’ for deliberative quality as measured by the Discourse Quality Index (DQI; Steenbergen et al. Citation2003; Kersting Citation2005). Comparing hand-coded transcripts of a transnational deliberative poll (Europolis) with integrative complexity, Beste and Wyss (Citation2014) find a solid correlation of IC with a component index of DQI (r = 0.57). We analyse 867 comments written by 201 platform users and then identify discrepancies between participants with high and low integrative complexity by estimating a linear regression model. The last aspect of inclusion considered is how satisfied participants were with the Demokratiefabrik. To shed light on this question, we focus on four questions collected at T2. First, we consider if the participants found the instructions on the Demokratiefabrik ‘clear’. Second, we check whether participants considered the review process of the proposed questions ‘fair’. Third, we explore whether participants considered the process in the Demokratiefabrik ‘meaningful’. Finally, participants were asked if they would consider participating in a future Demokratiefabrik. To predict satisfaction with the online platform, we estimate logistic regression models.

As stated above, regarding under-represented citizen groups, we focus on traditional criteria of under-representation, namely gender, age, lower political sophistication and (dis)satisfaction. To measure political sophistication, we rely on education and internal efficacy. For the latter, we apply two survey items used by Rottinghaus and Escher (Citation2020) in their study. To measure (dis)satisfaction with democracy, we embed items to measure external efficacy (Beierlein et al. Citation2012) and populism in our survey. Our items for measuring populist attitudes are based on Schulz et al. (Citation2018) and Wuttke, Schimpf, and Schoen (Citation2020). Finally, we also put emphasis on the concepts of general satisfaction with democracy, local political trust and sympathy for the right-wing ‘Swiss People’s Party’.

As control variables, we focus on left-right placement, party affiliation, frequency of political discussions with family and friends, membership in a political association, digital affinity, and activity in the job market (see in the Appendix for an overview of all variables, the question’s wording and their summary statistics).

Empirical results

The Demokratiefabrik achieved relatively high general participation rates compared to similar digital events in other countries (see, e.g., Strandberg and Grönlund Citation2013; Kersting Citation2014), despite there being extensive participation possibilities in Switzerland. Of the 9,000 citizens invited, 1,437 logged in at least once on the platform (16% of the total invitees). Most of them completed the initial survey T1 (1,180; 13.1% of the total invitees). 416 visited the Demokratiefabrik more than once (38.6%). 1,079 (12%) rated themes or VAA-questions. Of course, the degree to which participants engaged actively on our platform varied. 579 reviewed at least one randomly assigned question submitted by other participants (53.7%). 201 wrote at least one comment (18.6%) and 260 rated at least one comment (24.1%).Footnote6 Finally, 108 submitted at least one proposal for a new question or the refinement of an existing question (10%), while only 39.6% neither engaged in the review process nor wrote their own contribution (lurkers). For an asynchronous online environment, these are good scores. Janssen and Kies (Citation2005) find that in many online environments the group of lurkers amounts to two-thirds of participants (see also Iandoli et al. Citation2018). At the end of the Demokratiefabrik, participants had submitted a total of 219 proposals − 54 proposals for refinements of already deposited questions and 165 proposals for new questions.

External inclusion: who wanted to participate?

Let us first focus on the ‘representativity’ of participating citizens in the Demokratiefabrik, compared to the randomly drawn sample of 9,000 eligible citizens of Köniz. Results are shown in in the Appendix. Regarding age and gender, only small biases can be detected for external inclusion. The average age of participants was 48 years old and thus slightly younger than the participants in our sample (mean: 52); under-represented were only participants aged 76 or older. Regarding gender, we have slightly more male than female participants (51.3% men compared to 47.2% men in the sample). In their study on the digital political participation of young people in Switzerland, Räss, Differding, and Odermatt (Citation2021) found even more pronounced biases, with only 40% of participants being female. Compared to online debates elsewhere and to the user profile of smartvote users, the gender bias is rather small (Albrecht Citation2006; Fivaz and Nadig Citation2010). Only women over 65 years old have a lower probability of participating in the DDI. We only observe this for men in the oldest (and least computer literate) age category. Finding a gender gap for the older generation is in line with other research on direct democratic participation in Switzerland (Kriesi Citation2005: 124f; Dermont Citation2016; Gerber, Schaub, and Müller Citation2018). Furthermore, participants from the rural parts of the municipality were also under-represented.

Next, we observe a relatively strong left-green dominance among participants. 45.1% placed themselves on the left spectrum, while 44.1% placed themselves in the centre and 10.7% placed themselves on the right. This pattern is mirrored in party affiliations: 25.3% indicate the Socialist Party as the preferred party, 21.6% the Green Liberal Party (GLP), 19% the Greens, 9.4% the Liberal Party (FDP) and 6.5% the Swiss People’s Party (SVP). When comparing these numbers with the election results of the last municipal election in 2021 (Köniz Citation2021), it becomes clear that the Socialist Party (SP) and the Green Liberal Party (GLP) were (slightly) overrepresented in our sample of participants (23.7% voted SP, 13% voted GLP). The party least represented in the Demokratiefabrik was the right-wing populist Swiss People’s Party (2021: 15.3% SVP). Available data on the use of the smartvote VAA also show a certain under-representation of right-wing voters (Ammann Citation2018), indicating that citizens of particular groups who use the smartvote VAA less often were also more reluctant to participate in the development of the VAA questionnaire.

Furthermore, the Demokratiefabrik also attracted ‘sophisticated’ and ‘allegiant’ citizens. Participants in the Demokratiefabrik displayed a high or very high interest in politics (94.8% were either very interested or interested in politics at the national level and 81.3% indicated having a high or very high interest in local politics.). In this respect, the Demokratiefabrik differed considerably from data from a Swiss voter survey gathered in the same month we launched the Demokratiefabrik (gfs.bern Citation2021). In that survey, only 70.4% of participants indicated having a high or very high interest in politics. This is also true for education: compared to the gfs-survey, participants with a higher education were overrepresented (37% in the Demokratiefabrik versus 27% in the gfs-survey). Furthermore, participants of the Demokratiefabrik showed fairly high levels of political trust at the national level.Footnote7 For instance, only 11% indicated that they do not trust the executive body at the national level and 17.9% of them do not trust the national legislative body. The same number is indicated by the gfs-survey. Moreover, 85.2% of participating citizens were (very) satisfied with how democracy works in Switzerland (85.2% selected a value of at least 5 on a scale from 1 ‘Not at all satisfied’ to 7 ‘Very satisfied’) and 79.6% were satisfied with how democracy works in Köniz (participating citizens also selected a value of at least 5 on this scale). Regarding populism, only 1.9% of participating citizens show values of 6 or above, meaning that citizens with populist attitudes were under-represented.Footnote8 Finally, 61.7% of participants indicated they avoid posting political comments on the Internet (e.g., on blogs, by email or on social networks such as Twitter, Instagram and Facebook), suggesting that there were also less computer literate participants in the Demokratiefabrik.

Internal inclusion: who dominated?

Let us now explore patterns of activity within the Demokratiefabrik. A multinomial logit model is estimated to link the three types of participants – contributors, review-only users, and lurkers with attitudinal and socio-demographic variables.Footnote9

As shown in , we find some differences across the three types of participants regarding activity, but these are far less marked than a pessimistic scenario would predict. First, comparing contributors to lurkers (with lurkers forming the reference category), we find that contributors have higher levels of internal efficacy, are more often involved in associations (as a proxy for experience with political affairs) but less often have a full-time job (indicating that time resources do matter). We also calculated predicted probabilities for assessing the effect sizes. Regarding internal efficacy, the respective figures are slightly more marked. Participants in the third quartile have an 11% age points higher probability of being a contributor than the participants in the first quartile. Contrary to previous studies, no effects could be found for a traditional marker of under-representation in DDIs, namely gender and age (Rottinghaus and Escher Citation2020). However, contributors have lower political trust than lurkers, indicating that disenchantment can trigger online activity see Einstein, Palmer, and Glick (Citation2019) for similar findings). The effects of the trust level are sizeable, with predicted probabilities going from 22% (first quartile) to 40% (third quartile). Secondly, a similar pattern occurs for the comparison between contributors and review-only users here: we additionally find that contributors are slightly more educated than review-only users. Third, while comparing review-only users to lurkers, we encounter no major attitudinal or socio-demographic differences, except for age (with older participants being more frequently lurkers) and job (with review-only users less often having a full-time job than lurkers).

Table 1. Predicting internal inclusion.

Next, we focus on the ‘discursiveness’ of contributors (measured via ‘integrative complexity’ based on participants’ posts). shows the results from the linear regression model, correlating attitudinal and socio-demographic variables with integrative complexity.Footnote10 The surprising result is that there are few differences across our variables of interest: political dissatisfaction (including populist attitudes), political sophistication, gender, and age. Statistically significant effects only occur for education and party affiliation: in line with previous research (e.g., Jennstal Citation2019), higher education levels are positively correlated with higher levels of integrative complexity, whereas ‘partisans’ produce fewer complex posts than non-partisans. The effect of education on integrative complexity scores, however, is relatively small (0.26 on a scale ranging from −7.03 to 16.2). Overall, our findings indicate that a wide variety of contributors – including populist-minded citizens and populist voters – could communicate their thoughts at surprisingly similar quality levels.

Table 2. Predicting integrative complexity.

Finally, we turn to the satisfaction of participants with the Demokratiefabrik. We rely on the second survey (T2) completed by 425 respondents (39.4% of 1,079 invitees).Footnote11 A clear majority of respondents found the instructions on the DDI clear (72.6%), considered the review process fair (85.9%) and meaningful (95.9%), and stated they would participate again in the future (77.8%). Moreover, 67.9% of participants said they spoke at least once about the DDI with other people. These positive results show that DDIs have the potential to generate discussion and raise awareness of burning local topics. The logistic model () distinguishing different satisfaction categories (from clear instructions to intention to participate in the future) indicates that some participants were more satisfied than others.

Table 3. Satisfaction with the Demokratiefabrik.

We find that more computer literate participants displayed a higher willingness to participate again. Elderly participants, on the contrary, less often stated that the DDI was meaningful and that they would participate again. More highly educated participants also viewed the DDI as less meaningful. However, these differences were all substantively minor. No effects could be found for populist citizens and SVP voters, who were under-represented in terms of external inclusion.Footnote12

Discussion

We have assessed a new asynchronous online tool, the Demokratiefabrik, for a bottom-up creation of a Voting Advice Application (VAA) in a Swiss municipality (Köniz). Conventional participation research claims that DDIs are conducive to seriously biased participation patterns, with already advantaged citizens participating more and dominating the internal process. The results presented in this study stand somewhat at odds to this pessimistic view. We identified an intriguing pattern of inclusion/exclusion that conforms to the fourth introduced – ‘mixed’ – scenario with manifested external and relatively moderate internal exclusion patterns.

Regarding external inclusion, the Demokratiefabrik shows biases, with ideologically left-green and politically more sophisticated and allegiant participants being clearly more willing to participate. Regarding internal inclusion, however, we find that the Demokratiefabrik may present an alternative to politics as usual since it succeeded in activating citizens with lower political trust far more than citizens with high political trust. Discursiveness (measured by the psychological construct of integrative complexity) is fairly broadly distributed among contributors (with the partial exception of better-educated citizens who scored higher on integrative complexity). Remember that discursiveness is a key marker for judging whether participants in interactive tools can participate in competent ways. If we consider that traditionally under-represented groups – women, and less educated and younger people – were almost as active as traditionally well-represented groups (men, and more educated and elderly people), the pattern of biases clearly contradicts pessimistic predictions. Our results on the internal dimension of inclusion corroborate the study by Kennedy et al. (Citation2021), finding ‘patchy’ biases of under-represented citizens. The Demokratiefabrik shows that similar patterns also arise under more demanding conditions, namely asynchronous deliberation with citizen co-creation.

Overall, a major problem of DDIs such as the Demokratiefabrik seems to consist of overcoming biases in external inclusion – as well as mending some smaller deficits with internal inclusion. While our tool already boasts a variety of design features to overcome potential biases of internal inclusion – including anonymity and review mechanisms – we could imagine further improvements to make it an even more democratic space for anyone. This could include programmed interventions by artificial facilitators to motivate less active participants to also become contributors in the Demokratiefabrik and make all voices fully ‘heard’.

Conclusion

Digital Democratic Innovations (DDIs) hold the promise of enabling mass participation at a much lower cost than traditional face-to-face venues. At the same time, they may deepen existing divides, privileging already advantaged citizens. Our asynchronous online tool – Demokratiefabrik – set out to create a Voting Advice Application (VAA) in a Swiss municipality (Köniz), based on citizen input and citizen co-creation. Our result document that the interest in our DDI was surprisingly high (compared to similar events in other countries).

While we found some serious biases in external inclusion, with left-green voters, sophisticated, and allegiant citizens being clearly over-represented, it is intriguing to see that these citizens did not dominate the internal process. Intriguingly, citizens with low political trust were among the most active participants, indicating that DDIs might have the potential to give (at least some) disenchanted citizens a new voice in the political process. While we acknowledge that Switzerland is a unique case with established participatory practices, we think that a replication of our results in places with less participatory possibilities might even show a higher interest of citizens for participating in a co-creative VAA.

Acknowledgement

We would like to express our sincere gratitude to the anonymous reviewers and the editor, whose insightful comments and suggestions greatly improved the quality of this article. We also extend our thanks to our two extremely helpful assistants Viktoria Kipfer and Catalina Schmid, whose diligent efforts and support were indispensable in completing this research.

Disclosure statement

No potential conflict of interest was reported by the authors.

Additional information

Funding

The work was supported by the Schweizerischer Nationalfonds zur Förderung der Wissenschaftlichen Forschung [187496].

Notes on contributors

Giada Gianola

Giada Gianola is a PhD student at the Institute of Political Science at the University of Bern. She is accomplishing her PhD as part of the SNSF project «Digital Democratic Innovations to Empower Citizens in the Digital Age» (NRP 77). Her research focuses on online deliberation and Digital Democratic Innovations (DDIs).

Dominik Wyss

Dominik Wyss is a political scientist (PhD) at the University of Bern. In his interdisciplinary research, he combines the disciplines of Political Science, Quantitative Methods, and Computer Science. Much of his work is in the field of political communication and deliberation, with a particular emphasis on designing and assessing digital participation formats.

André Bächtiger

André Bächtiger is Professor of Political Theory and Empirical Democracy Research at the University of Stuttgart. His research focuses on democratic preferences and the challenges of mapping and measuring deliberation and political communication. His has recently published in Science, the British Journal of Political Science and with Oxford University Press.

Marlène Gerber

Marlène Gerber is Deputy Director of Année Politique Suisse and lecturer and at the Institute of Political Science at the University of Bern. In 2013, she finished her PhD on the potential for deliberation among EU citizens. Her main actual research focuses on traditional citizen assemblies and digital democratic innovations.

Notes

1. Internal political efficacy refers to competency feelings regarding politics participate in it, whereas external political efficacy refers to perceived influence on politics (Craig Citation1979).

2. VAAs work as follows: political candidates (or parties) standing for election answer various questions on political issues. Voters can then answer the same questions. By calculating the correspondence between voters’ and candidates’ responses, the former can learn which candidates are ideologically closest to them (Ladner and Pianzola Citation2015).

3. As soon as the Demokratiefabrik ended, the research and smartvote teams looked at the most rated and selected questions, and corrected, if necessary, the language and formulated the question in a clearer way. They then corrected any content errors. It is important to note that both teams tried not to intervene too much or change the questions in a radical manner, in order to stick as closely as possible to the questions formulated by the participants.

4. The party proposals (see above) were not subjected to the review process, since they had already been checked by the research team and smartvote employees. However, participants were free to propose refinements to the party proposals (which then had to go through the review process).

5. Since we do not have information on the political attitudes of the entire population of Köniz, we cannot compare our data with the respective population. For this reason, we compare our results with evidence from other studies.

6. By clicking on three different emojis, participants could indicate whether or not they liked another participant’s comment.

7. At the local level, only 16.3% of participants indicated they do not trust the local executive body and only 14.4% indicated they do not trust the local legislative body.

8. In comparison with the study of Schulz et al. (Citation2018), we find lower values for populism. This could be ascribed to our subject being a suburban municipality, whereas the study of Schulz et al. (Citation2018) was carried out across Switzerland as a whole.

9. We tested for multicollinearity but did not find any gross violations.

10. We also tested the relationship between attitudinal and socio-demographic variables and integrative complexity using a dichotomous variable for integrative complexity (measured as 1=values above the median and 0=values above the median) and found the same results.

11. We invited only the 1,079 participants to the second survey (those participants that appraised at least one theme). The sample of participants who completed the second survey at T2 is largely comparable to the sample of all participants, with the exception that participants at T2 were slightly younger and slightly more interested in politics (Gianola, Gerber, and Wyss Citation2021).

12. Notice, however, that depending on model specification, results slightly differ. If we omit the variable ‘left-right placement’ in the statistical analysis of the meaningfulness of the DDI evaluation (), the variable ‘Sympathy for SVP’ produces a negative and statistically significant effect. However, focusing on the raw figures, SVP sympathisers still consider the DDI meaningful, just less so than other participants.

References

  • Albrecht, S. 2006. “Whose Voice is Heard in Online Deliberation?: A Study of Participation and Representation in Political Debates on the Internet.” Information, Communication & Society 9 (1): 62–82. doi:10.1080/13691180500519548.
  • Ammann, C. 2018. Wer klickt sich zum passenden Politiker? Blogbeitrag, https://blog.smartvote.ch/wer-klickt-sich-zum-passenden-politiker/06.10.201
  • Baek, Y. M., M. Wojcieszak, and M. Delli Carpini. 2012. “Online versus Face-To-Face Deliberation: Who? Why? What? With What Effects?” New Media & Society 14 (3): 363–383. doi:10.1177/1461444811413191.
  • Beierlein, C., C. J. Kemper, A. Kovaleva, and B. Rammstedt. 2012. Ein Messinstrument zur Erfassung politischer Kompetenz- und Einflussüberzeugungen: Political Efficacy Kurzskala (PEKS). (GESIS-Working Papers, 2012/18). Mannheim: GESIS - Leibniz-Institut für Sozialwissenschaften.
  • Beste, S., and D. Wyss. Cognitive Complexity as a Proxy for High Quality Deliberation? A Theoretical and Empirical Exploration of Cognitive Complexity and Deliberative Quality in the EuroPolis Discussions. In ECPR General Conference, Glasgow, pp. 3–6. 2014.
  • Brundidge, J., S. A. Reid, S. Choi, and A. Muddiman. 2014. “The “Deliberative Digital divide: ” Opinion Leadership and Integrative Complexity in the US Political Blogosphere.” Political Psychology 35 (6): 741–755. doi:10.1111/pops.12201.
  • Craig, S. C. 1979. “Efficacy, Trust, and Political Behavior: An Attempt to Resolve a Lingering Conceptual Dilemma.” American Politics Quarterly 7 (2): 225–239. doi:10.1177/1532673X7900700207.
  • Dermont, C. 2016. “Taking Turns at the Ballot Box: Selective Participation as a New Perspective on Low Turnout.” Swiss Political Science Review 22 (2): 213–231. doi:10.1111/spsr.12194.
  • Einstein, K. L., M. Palmer, and D. M. Glick. 2019. “Who Participates in Local Government? Evidence from Meeting Minutes.” Perspectives on Politics 17 (1): 28–46. doi:10.1017/S153759271800213X.
  • Esau, K., D. Friess, and C. Eilders. 2017. “Design Matters! An Empirical Analysis of Online Deliberation on Different News Platforms.” Policy & Internet 9 (3): 321–342. doi:10.1002/poi3.154.
  • Fivaz, J., and G. Nadig. 2010. “Impact of Voting Advice Applications (VAAs) on Voter Turnout and Their Potential Use for Civic Education.” Policy & Internet 2 (4): 167–200. doi:10.2202/1944-2866.1025.
  • Geissel, B., and K. Newton. 2012. Evaluating Democratic Innovations. Curing the Democratic Malaise?. New York: Routledge.
  • Gerber, M., H.P. Schaub, and S. Müller. 2018. “O Sister, Where Art Thou? Theory and Evidence on Female Participation at Citizen Assemblies.” European Journal of Politics and Gender 2 (2): 173–195. doi:10.1332/251510819X15471289106095.
  • gfs.bern. 2021. VOX-Analyse Juni 2021. Nachbefragung und Analyse zur eidgenössischen Volksabstimmung vom 13. Juni 2021. Bern: gfs.bern.
  • Gianola, G., M. Gerber, and D. Wyss. 2021. Ergebnisbericht zur Könizer Demokratiefabrik 2021. Bern: Institut für Politikwissenschaft der Universität Bern.
  • Goldberg, S., D. Wyss, and A. Bächtiger. 2020. “Deliberating or Thinking (Twice) About Democratic Preferences: What German Citizens Want from Democracy.” Political Studies 68 (2): 311–331. doi:10.1177/0032321719843967.
  • Gürkan, A., L. Iandoli, M. Klein, and G. Zollo. 2010. “Mediating Debate Through On-Line Large-Scale Argumentation: Evidence from the Field.” Information Sciences 180 (19): 3686–3702. doi:10.1016/j.ins.2010.06.011.
  • Iandoli, L., I. Quinto, P. Spada, M. Klein, and R. Calabretta. 2018. “Supporting Argumentation in Online Political Debate: Evidence from an Experiment of Collective Deliberation.” New Media & Society 20 (4): 1320–1341. doi:10.1177/1461444817691509.
  • Janssen, D., and R. Kies. 2005. “Online Forums and Deliberative Democracy.” Acta Politica 40 (3): 317–335. doi:10.1057/palgrave.ap.5500115.
  • Jennstal, J. 2019. “Deliberation and Complexity of Thinking. Using the Integrative Complexity Scale to Assess the Deliberative Quality of Minipublics.” Swiss Political Science Review 25 (1): 64–83. doi:10.1111/spsr.12343.
  • Karen, M., C. J. Tolbert, and M. Stansbury. 2003. Virtual Inequality: Beyond the Digital Divide. Washington: Georgetown University Press.
  • Kennedy, R., A. E. Sokhey, C. Abernathy, K. M. Esterling, D. M. J. Lazer, A. Lee, W. Minozzi, and M. A. Neblo. 2021. “Demographics and (Equal?) Voice: Assessing Participation in Online Deliberative Sessions.” Political Studies 69 (1): 66–88. doi:10.1177/0032321719890805.
  • Kersting, N. 2005. The Quality of Political Discourse: Can E-Discussion Be Deliberative? Paper presented at the Annual Conference of the British Political Studies Association, Leeds.
  • Kersting, N. 2014. “Online Beteiligung – Elektronische Partizipation – Qualitätskriterien aus Sicht der Politik”.” In Internet und Partizipation: Bottom-up oder Top-down? Politische Beteiligungsmöglichkeiten im Internet, edited by K. Voss, 53–90. Wiesbaden: Springer VS.
  • Kersting, N. 2019. “Online Partizipation. Evaluation und Entwicklung- Status Quo und Zukunft.” In Politik in der digitalen Gesellschaft: Zentrale Problemfelder und Forschungsperspektiven, edited by J. Hofmann, et al., 105–122. Bielefeld: Transcript.
  • Klein, M. 2012. Enabling Large-Scale Deliberation Using Attention-Mediation Metrics. Computer Supported Cooperative Work (CSCW).
  • Köniz, M. 2021. “Fakten & Zahlen.” https://www.koeniz.ch/wohnen/gemeindeportraet/zahlen–fakten.page/145. last access: 25.8.2021.
  • Kriesi, H. P. 2005. Direct Democratic Choice: The Swiss Experience. Lanham: MD: Lexington Books.
  • Ladner, A., and J. Pianzola. 2015. “Voting Advice Applications.” In Encyclopedia of Information Science and Technology, edited by Khosrow-Pour, D.B.A. and Mehdi, 6427–6436. Hershey, PA: IGI Global.
  • Lefevere, J., and S. Walgrave. 2014. “A Perfect Match? The Impact of Statement Selection on Voting Advice applications’ Ability to Match Voters and Parties.” Electoral Studies 36: 252–262. doi:10.1016/j.electstud.2014.04.002.
  • Moore, A., R. E. Fredheim, D. Wyss, and S. Beste. 2019. “Deliberation and Identity Rules: The Effect of Anonymity, Pseudonyms, and Real-Name Requirements on the Cognitive Complexity of Online News Comments.” Political Studies 69 (1): 45–65. Version ac. doi:10.1177/0032321719891385.
  • Munzert, S., P. Barber, A. Guess, and J. Yang. 2020. “Do Online Voter Guides Empower Citizens? Evidence from a Field Experiment with Digital Trace Data.” Public Opinion Quarterly 84 (3): 675–698. doi:10.1093/poq/nfaa037.
  • Neblo, M. A., K. M. Esterling, R. P. Kennedy, D. M. J. Lazer, and A. E. Sokhey. 2010. “Who Wants to Deliberate-And Why?” The American Political Science Review 104 (3): 566–583. doi:10.1017/S0003055410000298.
  • Price, V. 2009. “Citizens Deliberating Online.” In Online Deliberation: Design, Research, and Practice, edited by Davies, T. and Gangadharan, S., 37–58. Stanford: CSLI Publications.
  • Price, V., and J. N. Cappella. 2002. “Online Deliberation and Its Influence: The Electronic Dialogue Project in Campaign 2000.” IT & Society 1 (1): 303–329.
  • Quinlan, S., M. Shephard, and L. Paterson. 2015. “Online Discussion and the 2014 Scottish Independence Referendum: Flaming Keyboards or Forums for Deliberation?” Electoral Studies 38: 192–205. doi:10.1016/j.electstud.2015.02.009.
  • Rafaeli, S., G. Ravid, and V. Soroka. 2004. “De-Lurking in Virtual Communities: A Social Communication Network Approach to Measuring the Effects of Social and Cultural Capital.” 37th Hawaii International Conference on System Sciences - 2004, no. C: 1–10.
  • Räss, N., I. Differding, and J. Odermatt. 2021. Jugend, politische Partizipation und Digitalisierung. Eine Analyse der digitalen politischen Partizipation junger Menschen in der Schweiz. TA-SWISS Publikationsreihe (TA 76/2021). Zürich: vdf Hochschulverlag AG.
  • Rottinghaus, B., and T. Escher. 2020. “Mechanisms for Inclusion and Exclusion Through Digital Political Participation: Evidence from a Comparative Study of Online Consultations in Three German Cities.” Zeitschrift für Politikwissenschaft 30: 261–298.
  • Schulz, A., P. Müller, C. Schemer, D. Stefanie Wirz, M. Wettstein, and W. Wirth. 2018. “Measuring Populist Attitudes on Three Dimensions.” International Journal of Public Opinion Research 30 (2): 316–326. doi:10.1093/ijpor/edw037.
  • Smith, G. 2009. Democratic Innovations: Designing Institutions for Citizen. New York: Cambridge University Press.
  • Smith, G., P. John, and P. Sturgis. 2012. “Taking Political Engagement Online: An Experimental Analysis of Asynchronous Discussion.” Political Studies 61 (4): 709–730. doi:10.1111/j.1467-9248.2012.00989.x.
  • Steenbergen, M. R., A. Bächtiger, M. Spörndli, and J. Steiner. 2003. “Measuring Political Deliberation: A Discourse Quality Index.” Comparative European Politics 1 (1): 21–48. doi:10.1057/palgrave.cep.6110002.
  • Strandberg, K., and K. Grönlund. 2013. “Online Deliberation and Its Outcome – Evidence from the Virtual Polity Experiment.” Journal of Information Technology & Politics 9 (2): 167–184. doi:10.1080/19331681.2011.637709.
  • Wuttke, A., C. Schimpf, and H. Schoen. 2020. “When the Whole is Greater Than the Sum of Its Part: On the Conceptualization and Measurement of Populist Attitudes and Other Multidimensional Constructs.” The American Political Science Review 114 (2): 356–374. doi:10.1017/S0003055419000807.
  • Wyss, D., and S. Beste. 2017. “Artificial Facilitation: Promoting Collective Reasoning Within Asynchronous Discussion.” Journal of Information Technology & Politics 14 (3): 214–231. doi:10.1080/19331681.2017.1338175.
  • Wyss, D., S. Beste, and A. Bächtiger. 2015. “A Decline in the Quality of Debate? The Evolution of Cognitive Complexity in Swiss Parliamentary Debates on Immigration (1968–2014).” Swiss Political Science Review 21 (4): 636–653. doi:10.1111/spsr.12179.
  • Young, I. M. 2002. Inclusion and Democracy. Oxford: Oxford University Press.

Appendix

Table A1. External Inclusion regarding socio-demographics.

Table A2. Operationalisation, question wording and summary statistics of the used variables.

Table A3. Final VAA-questionnaire.