6,218
Views
0
CrossRef citations to date
0
Altmetric
ORIGINAL RESEARCH ARTICLES

Beneficial or Harmful? How (Mis)Fit of Targeted Political Advertising on Social Media Shapes Voter Perceptions

Pages 19-35 | Received 28 Jan 2022, Accepted 11 Jan 2023, Published online: 23 Mar 2023

Abstract

Targeted political advertising (TPA) on social media builds on tailoring messages to (groups of) individuals’ characteristics based on user data. Questions have been raised about the impact of TPA on recipients and society. In this study, we focus on the fit of TPA, that is, the congruence between TPA and recipients’ preferences, and draw on congruity theories, social identity theory (SIT), and persuasion knowledge. In a two-wave panel study (N = 428) during a Viennese state election, we investigated the relationships between individuals’ perceived fit and misfit of TPA on perceptions about the manipulative intent as well as the benefits and harms for democracy. The findings showed that perceived fit of TPA at Time 1 decreased perceived manipulative intent and increased perceived benefits of TPA at Time 2. The perceived misfit of TPA at Time 1 did not influence individuals’ perceptions at Time 2, and perceptions about the harms of TPA to democracy stayed stable. Findings imply that political campaigners might benefit from targeting but raise questions about individuals’ defense mechanisms against the persuasive technique.

Every day an adult makes approximately 35,000 decisions (Hoomans Citation2015). While for certain decisions we are left on our own, settings exist in which technology fills in to select the content that might be relevant for us, for example, through algorithm-based recommender systems (e.g., Beam Citation2014) or targeted advertising on social media (e.g., Van den Broeck, Poels, and Walrave Citation2020). In the commercial sector, online behavioral advertising (OBA) takes advantage of today’s digital world. OBA involves two features: “(1) the monitoring or tracking of consumers’ online behavior and (2) use of the collected data to individually target ads” (Boerman, Kruikemeier, and Zuiderveen Borgesius Citation2017, p. 364). Hence, individual behavior on social media influences the algorithmic function of assigning individuals into categories (Thorson et al. Citation2019) to deliver content to chosen segments of social media users (Dommett Citation2019).

In recent years, OBA practices have also manifested in political campaigning. In online political advertising, “collecting information about people, and using that information to show them targeted political advertisements” is referred to as political microtargeting (Zuiderveen Borgesius et al. Citation2018, p. 82). To maximize the effectiveness of their digital campaigns, parties try to create a fit between the message receiver and the message itself, using targeted political advertising (TPA). TPA is “the direct transmission of stimuli, which are formed based on the preferences and characteristics of an individual” (Papakyriakopoulos et al. Citation2018, p. 2). Thus, TPA aims to send fitting—in other words, congruent—advertising to recipients (see Bleier and Eisenbeiss Citation2015; Papakyriakopoulos et al. Citation2018).

Political marketing differs from commercial marketing because, on one hand, voting decisions have large-scale and long-standing implications. On the other hand, “the political party or candidate is a complex intangible product,” which is difficult for voters to unpack (Lock and Harris Citation1996, p. 15). Even more than in commercial advertising, people may be interested in keeping their opinions private to avoid derivations that do not reflect their actual political views (Zuiderveen Borgesius Citation2015). When campaigners’ decisions are based on data derived from personal search behaviors or interests, voters can become vulnerable to discrimination, manipulation, polarization, or misinformation, as well as privacy infringements (Roemmele and Gibson Citation2020; Zuiderveen Borgesius Citation2015). In contrast, scholars also highlight the potential benefits of microtargeting practices connected to directly speaking to the needs of different voter groups and reengaging less interested parts of the electorate (Haenschen and Jennings Citation2019; Zuiderveen Borgesius et al. Citation2018). At the same time, we still know little about how voters perceive this form of advertising, how it affects them, and if they accept targeting as a campaigning tool.

To shed light on this issue, this study focuses on how perceptions of the fit and misfit of TPA shape individuals’ acceptance of the practice. Specifically building on the self-congruity theory (Sirgy Citation2018), schema incongruity processing theory (Mandler Citation1982), and social identity theory (SIT; Tajfel and Turner Citation1986), we investigate how exposure to TPA that aligns or misaligns with preferences affects citizens’ perceptions of manipulative intent, as well as the benefits and harms to democracy regarding TPA. Focusing on individuals’ perceptions of manipulative intent, we investigate an important dimension of the persuasion knowledge model by Friestad and Wright (Citation1994). The development of persuasion knowledge is decisive because it helps recipients to “identify how, when, and why marketers try to influence them,” as well as how to react to this influence in an appropriate manner (Friestad and Wright Citation1994, p. 1). By investigating perceived benefits and harms to democracy, we contribute to understanding how voters perceive the implications of TPA (i.e., in terms of potential promises and threats).

The current study advances the field in two ways: First, to the best of our knowledge, no research exists that simultaneously investigates the perceived implications of TPA on both the individual level (i.e., the perceived manipulative intent) and a societal level (i.e., benefits and harms to democracy). Second, longitudinal research in this area is still scarce, especially with a focus on European campaigns. Therefore, our study gives insights into an unfolding digital campaign under conditions of the E.U. General Data Protection Regulation (GDPR), complementing current studies that come predominantly from a less regulated U.S. context. Article 8 of the Charter of Fundamental Rights of the European Union (Citation2012) describes the right to protection of personal data that is granted to every E.U. citizen. This regulation and the GDPR (see E. U. General Data Protection Regulation Citation2016) state the duty of each company to inform and ask citizens for their consent before any personal data can be stored or used—for advertising purposes, for example. Users of websites or social media experience this regulation through messages that ask for permission to collect specific data or to use cookies. Because these regulations differ from regulations in the United States, it is essential to investigate the perception of TPA in Europe. To fill these gaps, we conducted a two-wave panel survey between August 2020 (Wave 1) and October 2020 (Wave 2) during the Viennese state election in Austria. In this panel survey, we relied on self-reported measures to investigate the relationships between individuals’ perceptions of the (mis)fit of TPA and their perceptions of individual- and societal-level implications.

Political Campaigning in the Digital Age

TPA stems from classical political campaigning with the significant difference that it takes large numbers of data points of potential voters into the equation to tailor political messages or advertising (e.g., Kreiss Citation2017; Zuiderveen Borgesius et al. Citation2018). Even though the separation of the electorate into groups has always been a component of campaigning to address voters most efficiently (König Citation2020), new technologies relying on algorithms and targeting are considered promising practices to grasp better the increasing heterogeneity of voters and their political stances (Pilditch and Madsen Citation2021). These significant changes might even have set the path for a new era of election campaigning, which scholars define as the data-driven or fourth era of campaigning (Roemmele and Gibson Citation2020). Roemmele and Gibson (Citation2020) further describe four key shifts in the era of data-driven campaigning, namely, (1) reliance on digital technology and large amounts of data; (2) a “more developed and networked approach to voter communication”; (3) the production of “much more fine-grained and personality-based understanding of the persuadable electorate,” hence microtargeted messages in campaigns; and (4) “more internationalized” campaigns (p. 597). While microtargeting practices profit from a less restrictive legal framework and have been successful in the United States, they face stricter legal constraints in the European context due to privacy and data collection regulations (e.g., E. U. General Data Protection Regulation Citation2016; Papakyriakopoulos et al. Citation2018). Nevertheless, microtargeting practices are also gaining momentum in European campaigns (Bennett Citation2016; Dobber et al. Citation2017) because social media users’ data can be employed for targeting practices due to opt-in consent and users’ willingness to share a large amount of data on their preferences and interests (Papakyriakopoulos et al. Citation2018).

In this regard, TPA has increasingly attracted scholarly attention to its effects as well as its democratic and societal implications. Effect studies have investigated recipients’ responses from various angles. One strain of research focused on how individuals respond to disclosures of sponsored/targeted advertising and how it influences recall or the persuasive impact (e.g., Boerman and Kruikemeier Citation2016; Kruikemeier, Sezgin, and Boerman Citation2016). Research by Boerman and Kruikemeier (Citation2016) found that the recognition of advertising, that is, persuasion knowledge, reduced intentions to engage in online behavior, such as sharing a tweet; decreased source trustworthiness; led to lower source attitudes; and caused higher skepticism toward the tweet when the message was sent by a political party rather than a brand (Boerman and Kruikemeier Citation2016). Contrarily, research found that the critical processing and effect of TPA is also highly determined by whether the portrayed party matches an individual’s party preferences (Binder et al. Citation2022).

Another research strain focuses on the importance of perceptions of TPA. Experimental research revealed that the effectiveness of a message in terms of attitudes and behavioral intentions depends on perceived personalization rather than actual personalization (Li Citation2016). A panel study by Matthes et al. (Citation2022) investigated the longitudinal relationships between perceived online political microtargeting and perceptions about trust in democracy and political interest. Their findings highlighted that perceived exposure to TPA can be simultaneously detrimental and useful, reducing individuals’ trust in democracy and increasing their political interest. These findings resonate with the overall debate about the potential benefits and threats of political targeting practices for individuals, society, and democracy (Barocas Citation2012; Zuiderveen Borgesius et al. Citation2018). Despite these initial insights, recipients’ perceptions of the impact of TPA on democracy remain understudied.

In a series of experimental studies, Li (Citation2016) found evidence that a message must be perceived as personalized to yield positive effects, which might depend on the match between the message and the message receiver. Li (Citation2016) further outlines that inaccurate information in a message, causing a mismatch, will enhance recipients’ feelings that they were not the intended target of the message. Conversely, messages containing accurate information, creating a match, are more easily perceived as personalized. This rationale points to another strain of research investigating the effects of (mis)matching TPA. Scholars have investigated the influence of varying forms or levels of targeting procedures (e.g., Binder et al. Citation2022; Zarouali et al. Citation2019) and the role of different congruency components, for example, personality traits (Krotzek Citation2019; Zarouali et al. Citation2020), identity (Holman, Schneider, and Pondel Citation2015), party preferences (Binder et al. Citation2022; Lavigne Citation2021), or issues (Endres Citation2020).

The Role of Fit and Misfit in Targeted Political Advertising

Targeted advertising positions itself within the key shifts of data-driven campaigning, profiting from the “fine-grained and personality-based understanding of the persuadable electorate” (Roemmele and Gibson Citation2020, p. 597). Hence, one aim of TPA is to create a match (i.e., a fit) between the advertised message and the characteristics of the message recipients (Bleier and Eisenbeiss Citation2015; Papakyriakopoulos et al. Citation2018). As a result, the fit constitutes a central feature and contributes to the effectiveness of an advertising appeal. A recent study has investigated the influence of psychometric profiling—such as the matching of messages with psychological traits—and found that individuals are more persuaded by TPA that was in line with their personality in terms of more positive political attitudes and voting intentions (Zarouali et al. Citation2020). This study also showed that when the personality trait matched the message frame—that is, introverted individuals matched with a fear-based ad and extroverted individuals matched with an enthusiasm-based ad—it increased individuals’ message elaboration, which then increased their voting intentions. While Krotzek (Citation2019) similarly found that messages congruent with individuals’ personality traits led to more positive feelings toward a candidate, no evidence was found for an increase in the likelihood of voting. Moving beyond psychometric targeting, Holman, Schneider, and Pondel (Citation2015) found in their experiment that targeting women with messages aimed at women (identity-based targeting) increased their propensity to vote for a candidate.

However, while the fit of targeted messages can be effective, people might still be confronted with misfitting TPA. In a U.S. survey, around 4 in 10 citizens indicated that their interests were not well reflected in the ads that target them (Auxier et al. Citation2019), which indicates that mistargeting might be a common experience in individuals’ media consumption. While algorithms are often perceived as highly sophisticated, algorithmic profiling can also result in various inaccurate categorizations based on changes in individuals’ preferences or wrong inferences (Büchi et al. Citation2021). In-depth interviews by Van den Broeck, Poels, and Walrave (Citation2020) revealed that when targeted advertising did not fit, people reflected on the usage of their data and reported feelings of disappointment or frustration. These feelings stemmed from a perceived violation of the expected social contract that users enter with Facebook, which includes relevant—i.e., fitting—targeted advertising (Van den Broeck, Poels, and Walrave Citation2020). As a result, mistargeting might foster mechanisms of algorithmic disillusionment, referring to individuals’ realization that algorithms are “less powerful and useful but more fallible and inaccurate than previously thought” (Felzmann et al. Citation2019, p. 7; see also Büchi et al. Citation2021). Mistargeting recipients by addressing misfitting TPA might also come with considerable risks for political parties, because this tactic might backfire. Hersh and Schaffner (Citation2013) found in their experimental study that citizens penalize politicians who target them based on false categorizations. Based on these findings, misfitting TPA might foster negative effects.

In the present study, we investigate how perceptions of fit and misfit might shape individuals’ subsequent evaluations of TPA on an individual and societal level. As such, we operationalize fit and misfit as separate concepts. Throughout a digital political campaign, different constellations of fit and misfit might occur. First, fit and misfit of TPA might happen simultaneously, with individuals receiving messages that are in line with their preferences as well as messages that come from parties or cover topics that misalign with their preferences. Second, it is possible that neither fit nor misfit of TPA might occur. In this situation, individuals might be confronted with predominantly random content in which they have little interest but which also does not contradict their preferences. Third, individuals might be exposed to TPA with high fit but not with misfit, or vice versa. Hence fit and misfit cannot be considered opposites but must be understood as separate constructs when considering the course of a campaign.

These processes become especially relevant in a multiparty system, such as the one in Austria. First, the numbers of possible fit and misfit options are likely to increase with a bigger number of political parties in the run for electoral positions. Second, it is likely that while some parties might evoke strong feelings of fit or misfit, others might be considered irrelevant or random content. Considering fit and misfit as conceptually the same would therefore not comprehensively represent the real-life phenomenon of TPA in a multiparty system.

To account for these processes, we opted to assess (mis)fit perceptions in a summary manner and specifically focus on two fit components, namely the match between TPA and recipients’ party preferences and their issue interests. Political preferences or partisanship and issues constitute important aspects of electoral campaigns (Hillygus and Shields Citation2009). Individuals’ partisan preferences inform parties’ decisions on whom to target as they primarily aim to reach voters likely to support their candidates (Barocas Citation2012). Targeting potential supporters was found to render partisan identification stronger and to lead to electoral support (Lavigne Citation2021). Hence, the political party and individuals’ partisan attachments are an essential part of individuals’ self-concept (see Green, Palmquist, and Schickler Citation2004). The congruence between the party and the recipient is, therefore, integral to our concept. In our study, we built on Binder et al.’s (Citation2022) conceptual definition of political fit, that is, the congruence between participants’ party preference and the party as a message sender of TPA. We then translated it to a different methodological context, namely, an unforced longitudinal setting, and extended the concept of political fit by incorporating the issue component and additionally measuring the misfit of TPA. Overall, issues matter in campaigning because parties might be evaluated based on their issue engagement (Meyer and Wagner Citation2016) or their issue ownership (Budge and Farlie Citation1983; Petrocik Citation1996). Issue ownership theory describes how political parties are expected to focus on issues they own (Walgrave et al. Citation2015) and can influence voters in terms of preferring parties owning issues that the voter perceives as important (Lefevere, Tresch, and Walgrave Citation2015). This highlights the interconnectedness between political parties, issue stances, and voters’ preferences. Also, in the targeting context issues matter in terms of issue-based targeting, Endres (Citation2020) found that targeting voters with messages from the opposing party, that is, Democrats being targeted by the Republican Party, was associated with less support for Barack Obama when the issue was congruent between the targeted voter and Mitt Romney.

The Influence of Fit and Misfit on Perceived Manipulative Intent

The fit or misfit of TPA can influence how recipients react to an advertising appeal and how it shapes their evaluations and reactions (Binder et al. Citation2022; Krotzek Citation2019; Zarouali et al. Citation2020). To evaluate and deal with advertising appropriately, individuals need to activate knowledge structures (Friestad and Wright Citation1994). The persuasion knowledge model (PKM) describes these processes and focuses on various dimensions (Boerman et al. Citation2018). One dimension of particular importance in the targeting context is manipulative intent (e.g., Binder et al. Citation2022). Perceived manipulative intent can be defined as “consumer inferences that the advertiser is attempting to persuade by inappropriate, unfair, or manipulative means” (Campbell Citation1995, p. 228). According to PKM, individuals incorporate such normative ideas about the appropriateness of persuasive tactics into their evaluation of ads and advertisers (Friestad and Wright Citation1994).

To theoretically understand the psychological mechanisms behind the influence of (mis)fitting TPA on the perceived manipulative intent, we draw on self-congruity theory. This theory establishes the basis for understanding how fit can impact individuals’ attitudes and behavioral intentions (Sirgy Citation2018). It is suggested that people generally prefer consistency with self-concept (Aaker Citation1999). Self-concept can consist of “more than one type of self-perspective,” or self-images (Sirgy Citation1985, p. 195), and can be extrapolated to different contexts, such as commercial advertising (e.g., brand-user image, Sirgy Citation2018) or politics (i.e., political self-concept). Political self-concept can be defined based on an individual’s self-perception of being a “political person” (Lane et al. Citation2019, p. 51), based, for example, on party partisanship (Knobloch-Westerwick and Meng Citation2011) or political interest (Lane et al. Citation2019). Accordingly, we examine the political self-concept regarding partisanship and issue interests in the present study. Based on self-congruity theory, research found that advertising in line with one’s self-concept has positive effects on an individual’s attitudes toward a product or buying intentions (Hong and Zinkhan Citation1995; Sirgy Citation2018). Likewise, when emotional targeting based on individuals’ moods matched the product category, consumers reacted more positively (Garaus, Wagner, and Rainer Citation2021).

Similarly, schema incongruity processing theory, proposed by Mandler (Citation1982), offers another framework to understand the different effects related to congruity (i.e., fit) and incongruity (i.e., misfit). Schemas are “representations of experience that guide action, perception, and thought” (Mandler Citation1982, p. 3). According to Mandler (Citation1982), individuals evaluate newly encountered information against existing schemas. When information is congruent with existing schemas, it is perceived as more familiar and acceptable (Halkias and Kokkinaki Citation2013). As a result, it is processed more easily, does not require further cognitive arousal, and can lead to positive evaluations (Halkias and Kokkinaki Citation2011; Mandler Citation1982). To be able to engage in perceived manipulative intent evaluations, we argue that individuals need to pay attention to the information and need cognitive arousal, which again is stimulated more by misfitting TPA than by fitting TPA. Thus, we hypothesize:

H1: The perceived fit of TPA at Time 1 reduces the perceived manipulative intent at Time 2.

Contrarily, we assume different mechanisms for perceived misfitting TPA, also based on schema incongruity processing theory (Mandler Citation1982). When individuals encounter incongruent information, it functions as an “interruption of expectations and predictions” (Mandler Citation1982, p. 21). Hence, people pay more attention to solving the incongruency, which then leads to increased cognitive arousal and can influence evaluations (Halkias and Kokkinaki Citation2011, Citation2013; Mandler Citation1982). Research has found that misfitting content could encourage recipients to critically evaluate advertising, which can further initiate evaluations about how appropriate an ad is (Germelmann et al. Citation2020; Maheswaran and Chaiken Citation1991). When advertising strategies increase individuals’ processing, it might activate their persuasion knowledge along with their “inappropriateness judgments,” which may induce “negative processing consequences, such as inferences of manipulative intent” (Campbell Citation1995, p. 228). In this vein, Campbell (Citation1995) found that when the fit of a borrowed interest appeal in advertising was low, it led to lower personal benefits and increased perceptions of manipulative intent. Likewise, political advertising not in line with individuals’ opinions—cross-cutting advertising—can be argued to relate to perceptions of manipulative intent (Matthes and Marquart Citation2015). Based on the outlined theoretical and empirical insights, we hypothesize as follows:

H2: The perceived misfit of TPA at Time 1 increases the perceived manipulative intent at Time 2.

The Influence of Fit and Misfit on Perceived Benefits and Harms for Democracy

Going beyond individuals’ perceptions about the appropriateness of TPA, it is also relevant to address how this advertising practice is evaluated regarding societal implications. In this context, positive and negative effects on democracy are widely discussed. Regarding potential benefits, it is argued that targeting practices could lead to higher degrees of mobilization of voters, especially of those more active on social media (Zuiderveen Borgesius et al. Citation2018) and younger voters (Haenschen and Jennings Citation2019). In addition, targeting practices might also increase voters’ interests or be perceived as beneficial because of receiving more relevant content (Van den Broeck, Poels, and Walrave Citation2020; Zuiderveen Borgesius et al. Citation2018).

At the same time, concerns are raised about TPA’s potential drawbacks. For example, such advertising techniques can potentially exclude certain voter groups (Barocas Citation2012) and enhance polarization (Roemmele and Gibson Citation2020). Furthermore, TPA can influence the public debate (see Jamieson Citation2013) by changing individuals’ information-seeking habits, for example, in the form of chilling effects, which imply that people refrain from engaging in online activities or looking for information online (Dobber et al. Citation2019).

While these possible benefits and harms for democracy are discussed among scholars, little is known about how individuals perceive the impact of TPA on democracy overall. To fill this gap, we focus on individuals’ perceptions of the democratic implications of TPA. By doing so, we consider benefits and harms not as parallel but as separate concepts. We operationalized perceived benefits in terms of a more engaged and interested electorate, more diverse election campaigns, and an increase in electoral turnout (see Zuiderveen Borgesius et al. Citation2018). Perceptions of harms were operationalized on a more abstract and fundamental level, based on an overarching assessment of whether TPA is perceived as harmful to free democratic elections and democracy. Whether individuals perceive benefits or harms might be driven by the extent to which the fit or misfit is perceived. This relationship can be explained based on the assumptions of SIT.

According to SIT (Tajfel and Turner Citation1986), belonging to one group implies favoring and elevating the ingroup and harboring resentment and stricter feelings toward the outgroup (Huddy and Bankert Citation2017; West and Iyengar Citation2020). Research has shown that partisanship can be defined as a social identity (Huddy and Bankert Citation2017) and an important component of individuals’ self-concepts, especially during election campaigns (West and Iyengar Citation2020). Therefore, SIT provides a suitable framework to explain why recipients might react differently to messages stemming from their own party compared to those from an opposing party. Based on the assumptions of SIT, we argue that when individuals perceive the fit of TPA, it might lead to more positive evaluations of the targeting strategy for democracy at a later point in the campaign. This mechanism is based on ingroup dynamics, related to elevating one’s own ingroup while disdaining the outgroup (Huddy and Bankert Citation2017; West and Iyengar Citation2020). In other words, TPA from the preferred political party and covering topics that are personally interesting might be perceived as less harmful. This means, driven by party heuristics, fitting TPA increases perceived benefits and reduces perceived harms. Hence, we hypothesize:

H3: Perceived fit of TPA at Time 1 (a) increases perceived benefits and (b) decreases perceived harms for democracy at Time 2.

As suggested by SIT (Tajfel and Turner Citation1986), outgroups opposing one’s ingroup can be perceived negatively, possibly inducing feelings of opposition (West and Iyengar Citation2020). When individuals receive misfitting TPA, which implies that it came from an opposing party and is not in line with their interests, it might lead to negative evaluations of the parties’ actions. In our context, it would imply that misfitting TPA increases such negative evaluations, highlighting the perceived harms of TPA rather than the perceived benefits for democracy over the course of the election campaign. We therefore hypothesize:

H4: Perceived misfit of TPA at Time 1 (a) decreases perceived benefits and (b) increases perceived harms for democracy at Time 2.

Method

Because targeted political messages and ads are more likely to be received and noticed during an election campaign (Dobber et al. Citation2019), we conducted our two-wave panel study during the campaign period of the Viennese state election in 2020. Panel surveys allow accounting for the dynamic character of election campaigns because the change in the responses of the same individuals can be investigated (Bartels Citation2006). Accounting for preexisting attitudes or opinions is one of the advantages of panel surveys because prior attitudes can influence the “amount and direction of across-time change” (Taris Citation2000, p. 56). Omitting such variables can cause potential bias in estimates (Bartels Citation2006). Furthermore, panel surveys constitute a stricter test of relationships between different variables compared to cross-sectional survey data, as they allow researchers to model the correct temporal order of relationships (Bartels Citation2006; Burkholder and Harlow Citation2003), which allows a hint at directionality (e.g., Bartels Citation2006). While experimental research would be needed to evaluate causality, panel studies profit from high levels of external validity because they are embedded in real life and lie outside forced-exposure settings.

The data collection of our two-wave panel survey was administered by Dynata, a professional polling company, between August 2020 (Wave 1) and October 2020 (Wave 2), until Election Day on October 11, 2020. Similar to previous research (e.g., Dimitrova et al. Citation2014), we left approximately six weeks of time difference between the waves, which is deemed suitable to see campaign effects. This study was part of a more extensive panel survey on the topic of political communication during the Viennese state election. The data from the same sample were used in another article on TPA (Stubenvoll et al. Citation2022) and other unrelated political topics (e.g., Nanz and Matthes Citation2022). However, independent and dependent variables are original to this study. To participate in the study, participants had to give their consent and needed to be eligible to vote in the election, for which Austrian citizenship and having main residence in Vienna were required. Furthermore, participants had to use social media to some extent in both waves. In addition, we applied a cutoff point of less than 10 minutes for the 25-minute survey in Wave 1 to exclude participants who took too little time, which raises the risk that instructions and questions were not read carefully. This is a conservative approach relying on response exclusion based on response time to reduce potential biases (Leiner Citation2019).

Sample

Based on these criteria, our sample consisted of 428 participants in both waves (NW1 = 718 respondents, NW2 = 428 respondents). The calculated retention rate of the completed cases between both waves was 59.61%. We applied quotas based on age (18 to 65 years, M = 43.32, SD = 13.16) and gender (54% female, 46% male). The educational backgrounds were heterogeneous among participants (25.9% lower, 46.5% medium, 27.6% higher education). No significant differences were found for gender (χ2 (1) = .47, p = .495) or education (χ2 (6) = 3.45, p = .745) of participants who participated only in Wave 1 and participants who participated in both waves. However, we found significant differences regarding participants’ age. Respondents who participated in Waves 1 and 2 were significantly older (M = 43.32, SD = 13.16) than respondents participating in Wave 1 only (M = 39.14, SD = 13.44, t (716) = −4.13, p < .001). We received ethical approval from the Institutional Review Board (IRB) of the Department of Communication at the University of Vienna (approval ID 20200722_017).

Measures

All participants received a short explanation of what TPA on social media is, stating that TPA refers to ads on social media that are specifically tailored to certain groups of people, which can be based on different data, for example, demographic data, interests, or click behavior (similar definition to Facebook Citation2022). Thus, the provided definition highlights that TPA uses individuals’ data to deliver messages to specific segments of voters, which is a key feature of TPA practices (Dommett Citation2019). If not indicated differently, we applied seven-point Likert scales ranging from 1 (Do not agree at all) to 7 (Totally agree). For correlations among the main variables, see Supplemental Online Appendix C, Table S1. The data can be found at https://osf.io/msp58/.

Table 1. Results of the structural equation model controlling for autoregressive relationships.

Independent Variables

To measure the extent to which participants perceived TPA encountered on social media during the election campaign to be fitting or misfitting, we applied the measures of perceived fit (MW1 = 3.18, SDW1 = 1.53, Cronbach’s αW1 = .92) and perceived misfit (MW1 = 3.41, SDW1 = 1.41, Cronbach’s αW1 = .80) of TPA. The fit and misfit constructs were self-developed, and each comprised four items: two about political (mis)fit and two about issue (mis)fit. Participants had to evaluate perceived fit in the following way: When they saw TPA on social media, to what extent (1) it corresponded to their general party preference; (2) it came from a party that they tend to like; (3) it addressed issues that interest them; and (4) it addressed issues that reflect their interests. The perceived misfit was gauged by asking: When participants saw TPA on social media, to what extent (1) it contradicted their general party preference; (2) it came from a party that they tend to dislike; (3) it addressed issues that do not interest them; and (4) it addressed issues that are contrary to their interests.

Drawing on the issue ownership theory (e.g., Bélanger and Meguid Citation2008), we accounted for the political and topical level of fit and misfit perceptions. We gauged individuals’ perceptions in a summary manner to account for the (co)existence of the perceived fit and the perceived misfit of TPA throughout the campaigning phase and to acknowledge the dynamics of a multiparty system. Notably, the study was conducted in a multiparty context, and individuals had to remember which ads they had seen in the past. Thus, it would have taken considerable memory effort on the participants’ side to memorize ads they had seen by each party to then calculate the fit based on individual party and issue preferences. Our measurement of perceived (mis)fit accounts for this because participants could give a more intuitive overall assessment of perceived political and issue (mis)fit of TPA.

To confirm the theorized dimensional structure of our measures, we conducted a confirmatory factor analysis (CFA). The CFA confirmed the two-dimensional structure, indicating that fit and misfit constituted two separate factors, showing an acceptable model fit based on robust model fit indices, χ2 (19) = 44.02, p = .001, comparative fit index (CFI) = .98, Tucker–Lewis index (TLI) = .96, root mean square error of approximation (RMSEA) = .07, standardized root mean squared residual (SRMR) = .05. We tested the two-dimensional solution against a one-factorial model, which further indicated that the two-factorial structure is reasonable (Δ χ2 (1) = 105.41, p < .001).

Dependent Variables

We assessed perceived manipulative intent using three items based on Campbell (Citation1995) to match our study and the panel survey context (MW1 = 4.45, SDW1 = 1.81, MW2 = 4.55, SDW2 = 1.76, Cronbach’s αW1 = .90, αW2 = .91). Participants were asked to rate the extent to which TPA on social media (1) tries to manipulate them; (2) tries to push them in a certain direction; and (3) tries to manipulate them in a way that they do not like. Perceived benefits for democracy were assessed with four items (MW1 = 3.13, SDW1 = 1.42, MW2 = 3.17, SDW2 = 1.32, Cronbach’s αW1 = .90, αW2 = .87). Participants had to evaluate the extent to which they agreed that TPA on social media was good because (1) it makes voters more willing to vote; (2) it gets voters more engaged; (3) parties have to cater to the needs of very different target groups; and (4) it allows parties to address the concerns of different segments of the population. Perceived harms for democracy were measured using two items (MW1 = 3.84, SDW1 = 1.71, MW2 = 3.92, SDW2 = 1.67, Spearman–Brown coefficient ρW1 = .87, ρW2 = .85). Participants had to evaluate the degree to which they agreed that TPA on social media (1) harms free, democratic elections; and (2) endangers democracy. Our scales of perceived benefits and harms of TPA for democracy were self-constructed but inspired by arguments in the field (Zuiderveen Borgesius et al. Citation2018).

Control Variables

In Wave 1, we controlled for participants’ age, gender, and education. We measured participants’ political interest on a scale from 1 (Not interested at all) to 7 (Very interested) based on Reiter and Matthes (Citation2021; M = 5.28, SD = 1.47, Spearman–Brown coefficient ρ = .82) and their political distrust (Craig, Niemi, and Silver Citation1990; M = 4.20, SD = 1.54, Spearman–Brown coefficient ρ = .81). We controlled for participants’ privacy concerns based on Hsu and Lin (Citation2018) as well as Mani and Chouk (Citation2017) and adapted these to the social media context (M = 4.82, SD = 1.69, Cronbach’s α = .89). In Wave 2, we assessed participants’ political ideology, ranging from 0 (Left) to 10 (Right; M = 4.52, SD = 2.29) and measured individuals’ knowledge about OBA based on a scale by Smit, Van Noort, and Voorveld (Citation2014). Participants indicated which knowledge items were right or wrong but could also choose the answer option I do not know. Correct items were summed up to a scale ranging from 0 to 6 (M = 4.33, SD = 1.44).

We included the mentioned control variables because of their relevance to our model. Political dispositions like political distrust (Chan Citation1997; Hetherington and Globetti Citation2002) and political interest (Lovejoy, Cheng, and Riffe Citation2010; Nelson et al. Citation2021) can affect individuals’ attention and processing. Privacy concerns might influence individuals’ perceptions of the (mis)fit of TPA. For example, an increased alert state of possible privacy infringement might also increase the awareness that personal data were used (e.g., van Doorn and Hoekstra Citation2013). At the same time, privacy concerns could also affect the evaluative outcomes of TPA (e.g., Dobber et al. Citation2019). Furthermore, we theorized that OBA knowledge might affect individuals’ recognition of targeted advertising and their overall evaluation (Friestad and Wright Citation1994). We included these variables as control variables to account for potential spurious relationships and to minimize the risks of omitted variable bias (Kline Citation2011). An overview of the measures is shown in Supplemental Online Appendix A.

Data Analysis

We applied structural equation modeling (SEM) with the lavaan package in R (Rosseel Citation2012). We used SEM to account for the measurement error of latent variables (Kline Citation2011). First, we tested the accuracy of our measurement model with a cutoff value of λ > .40 for weak factor loadings. Second, we tested our hypotheses with the full structural model. We opted for the robust maximum likelihood estimation because a QQ-plot showed that the data violated the assumption of multivariate normality and reported robust model fit indices. As model fit indices, we applied the comparative fit index (CFI; ≥ .95), the Tucker–Lewis index (TLI; ≥ .95), the root mean square error of approximation (RMSEA; ≤ .05), and the standardized root mean square residual (SRMR; ≤ .05) indices (Byrne Citation2016). Error terms of identical items of Waves 1 and 2 were allowed to covary.

Results

Measurement Model

Prior to hypotheses testing, we conducted a CFA of our measurement model. The model fit indices indicated good model fit, χ2 (431) = 540.04, p < .001, CFI = .99, TLI = .98, RMSEA = .03, SRMR = .03. Factor loadings ranged from λ = .61 to .92 (see Supplemental Online Appendix B). All items were used for the final structural model based on these results.

In addition, we tested measurement invariance and compared the configural model (Model 1), a model with constrained factor loadings (Model 2), and constrained intercepts (Model 3). We did not find significant differences between Models 1 and 2 (Δ χ2 (6) = 5.26, p = .511) and Models 2 and 3 (Δ χ2 (6) = 3.42, p = .754). Hence, we established scalar and metric measurement invariance.

Hypotheses Testing

In the full structural model, we tested our hypotheses over two time points while controlling for autoregressive relationships between the dependent variables. Model fit indices of the full structural model indicated a good fit, χ2 (617) = 857.83, p < .001, CFI = .97, TLI = .96, RMSEA = .03, SRMR = .05. The model explained 34% of the variance in perceived manipulative intent, 36% of the variance in benefits, and 31% of the variance in harms in Wave 2.

First, we examined the relationships between perceived fit and misfit of TPA and individual-level implications, that is, perceived manipulative intent. Our findings revealed that the perceived fit at Time 1 significantly predicted the perceived manipulative intent at Time 2 (b = −0.15, SE = 0.06, β = −.14, p = .012), confirming hypothesis 1. Perceived misfit at Time 1 did not significantly impact perceived manipulative intent at Time 2 (b = 0.11, SE = 0.07, β = .09, p = .133). Therefore, hypothesis 2 was rejected.

Second, we tested the relationships between perceived fit and misfit of TPA and perceived benefits and harms for democracy. We found a significant positive relationship between the perceived fit at Time 1 and perceived benefits for democracy at Time 2 (b = 0.14, SE = 0.06, β = .16, p = .029), which confirms our hypothesis 3(a). However, against our assumptions in hypothesis 3(b), the perceived fit of TPA at Time 1 did not significantly decrease perceived harms for democracy at Time 2 (b = 0.01, SE = 0.06, β = .01, p = .842). Our results revealed no significant relationships between the perceived misfit at Time 1 and individuals’ perceptions about the benefits (b = −0.04, SE = 0.06, β = −.04, p = .449) or harms (b = 0.10, SE = 0.07, β = .09, p = .147) of TPA for democracy at Time 2. Hence, we rejected hypotheses 4(a) and 4(b).

In addition, we found that some control variables revealed significant relationships. Individuals who reported higher privacy concerns at Time 1 also indicated stronger perceived manipulative intent of TPA at Time 2 (b = 0.16, SE = 0.07, β = .13, p = .023).

Regarding perceived benefits for democracy, our results indicated that older participants perceived fewer benefits of TPA for democracy at Time 2 (b = −0.01, SE = 0.01, β = −.12, p = .014). Further, OBA knowledge negatively predicted perceived benefits (b = −0.14, SE = 0.04, β = −.16, p = .001). In terms of perceived harms for democracy, we found that individuals with higher political distrust at Time 1 perceived more harm of TPA for democracy at Time 2 (b = 0.26, SE = 0.07, β = .24, p < .001). The SEM model is presented in and findings are shown in .

Figure 1. Model showing the relationships between the perceived fit and misfit of targeted political advertising (TPA) on perceived manipulative intent and perceived benefits and harms for democracy. N = 428. The paths were estimated applying robust maximum likelihood estimation. Robust fit indices are reported: χ2 (617) = 857.83, p < .001, CFI = .97, TLI = .96, RMSEA = .03, SRMR = .05. Political interest, political distrust, political ideology, age, gender, education, online behavioral advertising (OBA) knowledge, and privacy concerns served as control variables. Dotted lines show autoregressive relationships. W1 = Wave 1; W2 = Wave 2. *p < .05; **p < .01; ***p < .001.

Figure 1. Model showing the relationships between the perceived fit and misfit of targeted political advertising (TPA) on perceived manipulative intent and perceived benefits and harms for democracy. N = 428. The paths were estimated applying robust maximum likelihood estimation. Robust fit indices are reported: χ2 (617) = 857.83, p < .001, CFI = .97, TLI = .96, RMSEA = .03, SRMR = .05. Political interest, political distrust, political ideology, age, gender, education, online behavioral advertising (OBA) knowledge, and privacy concerns served as control variables. Dotted lines show autoregressive relationships. W1 = Wave 1; W2 = Wave 2. *p < .05; **p < .01; ***p < .001.

In an additional analysis, we tested whether reciprocal relationships existed within our model. Our analysis revealed that perceived benefits at Time 1 significantly predicted perceived fit of TPA at Time 2 (b = 0.13, SE = 0.06, β = .12, p = .041). No other reciprocal relationships between our main independent and dependent variables were found. The full results of our additional analysis are shown in Supplemental Online Appendix C, Table S2.

Discussion

The present study investigated the relationship between individuals’ perceptions about the fit and misfit of TPA and their perceptions of the manipulative intent, benefits, and harms of TPA for democracy throughout an election campaign.

Our findings suggest that TPA can be a successful advertising strategy for political campaigners when individuals perceive an ad to be fitting, that is, when there is a match between the advertising message and party preferences and interests. While the bigger picture indicates no negative consequences for political parties, our findings on the individual level suggest more nuanced consequences. In line with our expectation, the perceived fit of TPA at Time 1 reduced individuals’ perceptions about the manipulative intent at Time 2. This result has two implications. On one hand, it shows that individuals might not perceive TPA as something negative when it fits. This resonates with insights from a qualitative study, highlighting that people expect targeting to happen on social media as part of the social contract with the platform (Van den Broeck, Poels, and Walrave Citation2020). Hence, one could argue that individuals who perceive that TPA fits might not question the manipulative intent behind an ad, because what they receive might satisfy their expectations. On the other hand, lower levels of perceived manipulative intent might also imply reduced critical elaborations of the advertising or the strategy. Critical reflections, however, are necessary to evaluate the manipulative intent of advertising (Campbell Citation1995), which constitutes an important dimension of PKM (Friestad and Wright Citation1994). Without the activation of critical thinking processes, which can make the manipulative intent of a strategy overt, people might not be able to activate their defense mechanisms. Such defense mechanisms, however, are important for individuals to protect themselves against unwanted messages (Fransen, Smit, and Verlegh Citation2015).

On a more societal level, we investigated the perceived democratic implications of TPA for democracy. Our findings show a relationship between the perceived fit at Time 1 and perceived benefits for democracy at Time 2. Two explanations might apply. On one hand, our findings are in line with the assumptions of SIT (Tajfel and Turner Citation1986). Our results indicate that when TPA comes from one’s ingroup, in other words, the preferred party, individuals strive to keep a positive image of their party’s actions, further protecting their partisanship identity (e.g., West and Iyengar Citation2020). On the other hand, individuals might perceive fitting TPA as positive and beneficial. Scholars have argued that possible benefits of TPA for democracy could be related to more relevant advertising or more mobilization of the electorate (Zuiderveen Borgesius et al. Citation2018). In our study, however, we did not account for these individual-level benefits of TPA. Hence, future research should investigate these relationships and include aspects such as personal usefulness. In this regard, it would also be of interest to investigate how fit and misfit perceptions are related to the privacy calculus, that is, benefits associated with more self-disclosure and privacy risks associated with less self-disclosure (see Bol et al. Citation2018). Based on the rationale of the privacy calculus model, users engage in trade-off reflections, weighing up potential benefits and risks connected to disclosing personal information online (Trepte et al. Citation2017; see also Laufer and Wolfe Citation1977). Individuals’ willingness to disclose their personal information online might have important implications on the preciseness or fit of algorithm-based advertising formats.

Our additional analysis of reciprocal relationships provides insights into possible positive spiraling mechanisms. The more individuals perceived that TPA is beneficial for democracy, the more they perceived the fit of TPA at a later point in the election campaign. However, panel surveys employing more waves are necessary to provide stronger evidence for such a spiraling mechanism.

Contrary to the perceived fit, we did not find any significant relationships between the perceived misfit and individual-level or societal-level implications. Previous research on algorithmic disillusionment helps put our null findings into perspective. Algorithmic disillusionment describes how individuals believe that algorithms in reality might not be as capable and sophisticated as they expect them to be (Felzmann et al. Citation2019). Such disillusionment might explain why the misfit did not yield any consequences. In this sense, when individuals experience a misfit, they might become more aware of the inaccuracy of targeting strategies and might not perceive them as manipulative or harmful. Future research would need to empirically investigate these processes in depth.

Our null findings regarding the perceived misfit highlight the complexity of this concept. While we expected overall negative consequences of the misfit of TPA on individuals’ perceptions, previous research has also pointed to possible benefits of misfit. Endres (Citation2020) showed that an ideological misfit (i.e., when Republicans targeted Democrats in the 2012 U.S. presidential election) led to stronger mobilization among Democrats when the issue was congruent. At the same time, processes such as linked fate could influence the perceived misfit of TPA (see Hersh and Schaffner Citation2013). In other words, when individuals receive content targeted to a group they do not belong to, they might still “feel an affinity to [the] group that they are not a part of” (Hersh and Schaffner Citation2013, p. 527). When such a linked fate is established, the misfit might not have the expected negative effects.

Future research should also further look into different forms of fit and misfit. Our study empirically showed that the political and issue facets formed the concept of (mis)fit. The interrelatedness between political and thematic aspects can be explained based on the issue ownership theory (Bélanger and Meguid Citation2008). However, as Endres (Citation2020) showed, issue-based targeting could override party preferences. Nevertheless, the findings of Endres (Citation2020) are based on the U.S. context. Therefore, research in the European context is warranted due to different party structures and weaker lines of partisanship (e.g., Huddy and Bankert Citation2017; Zuiderveen Borgesius et al. Citation2018). In addition, to develop an in-depth understanding, content analytical evidence is needed to investigate which issues are used for TPA.

Regarding perceived harms, our findings suggest that perceived harms for democracy remain stable and are not influenced by the fit or the misfit of TPA. One possible explanation is rooted in the third-person effect, which describes that individuals perceive the influence of persuasive communication to be stronger for others than for themselves (Davison Citation1983). In the commercial context, Ham and Nelson (Citation2016) showed that subjective persuasion knowledge—in other words, knowledge about how persuasion functions—was positively associated with third-person perceptions (TPPs). Furthermore, they revealed that harm (in terms of privacy infringement) and benefit (in terms of relevance) assessments of OBA functioned as mediators. More precisely, Ham and Nelson (Citation2016) found a negative relationship between perceived benefits of OBA and TPPs and a positive relationship between perceived harms and TPPs. Similarly, Baum, Meissner, and Krasnova (Citation2021) found not only that individuals thought that TPA would influence others more than themselves but also that the supporters of the opposing party (either Democrats or Republicans) were more influenced by TPA than the supporters of their own party. Similar mechanisms might apply to our context. Hence, evaluations of the harms of TPA for democracy might not depend on what one receives but on the extent to which one thinks such advertising would influence others. However, we did not account for such mechanisms, which opens avenues for future research.

In addition, it is important to note that our conceptualization of perceived harms grasped only an overall abstract assessment. However, many different potential threats of microtargeting practices exist, which are discussed in the literature, such as exclusion or polarization of voters, the spread of misinformation, exposure to siloed information, or potential chilling effects. Hence, we cannot make any assumptions about the relationship between (mis)fit and more concrete perceived harms of TPA, which remains to be investigated in follow-up studies.

While the concepts of perceived fit and misfit give us valuable insights into how individuals’ perceptions about the implications of TPA can be shaped, future research should also investigate other relevant predictors, including individuals’ knowledge (e.g., OBA) or political dispositions (e.g., interest or distrust), which could explain perceptions of individual-level and societal-level implications of TPA.

Limitations

The present study has some limitations. First, we relied on self-reported measures. Memory biases might have influenced individuals’ reported perceptions because some ads might be better memorized than others. Because we cannot know which content individuals saw, it reduces the generalizability of our findings to all targeted political ads. A systematic content analysis would be necessary to shed more light on the actual content to which a person is exposed. Individuals’ memory biases could be addressed methodologically with mobile experience sampling studies. This method allows for measuring individuals’ perceptions immediately after exposure to the content (Otto et al. Citation2021). Second, longitudinal panel data have advantages over cross-sectional data, as prior levels of attitudes can be taken into account and the temporal order can be established with the different measurement points (e.g., Bartels Citation2006; Taris Citation2000). While temporal order is one criterion of causality, we can only hint at directional relationships in this article. Experimental research is needed to investigate the strict causal direction of our established relationships. Third, while our study provides insights into the perceptions of TPA during a state election in Austria, it is necessary to replicate our study in different country contexts and election campaigns. Connected to this, panel studies with more waves would be needed to cover more phases of an election campaign.

Fourth, the measures used in this study come with certain limitations: The concepts of perceived fit and misfit were self-developed. Extensive analysis of the factorial structure of our measures confirmed fit and misfit to be two separate concepts, and reliability proved to be high. To further validate our measures, future research should integrate these measures in different contexts. Because the focus of our study was to evaluate participants’ overall fit and misfit perceptions, we did not ask participants to evaluate one specific targeted political ad regarding a concrete political party or the content. While this might have exceeded the cognitive burden on participants in a panel study, methodological approaches, such as mobile experience sampling methods, could cover this research interest more accurately. Such a method would allow participants to evaluate targeted political ads at the very moment of exposure. This would increase external validity due to the unforced, real-world setting of exposure and strengthen the preciseness of concrete (mis)fit perceptions of TPA.

In this study, we assessed the (mis)fit in terms of political and issue components, which are important aspects of an election campaign. Other components or a combination should also be considered, for example, geographical or identity-based targeting. This also calls for developing a scale that fully reflects the concepts of fit and misfit with all necessary components in the context of TPA.

Regarding our measures of perceived benefits and harms of TPA for democracy, we used self-developed measures that were inspired by work on the democratic implications of TPA (Zuiderveen Borgesius et al. Citation2018). We accounted for overall perceptions about the benefits and harms of TPA for democracy. Nevertheless, our measures of perceived benefits are more specific (e.g., engagement of voters) compared to more abstract perceived harms (e.g., danger to democracy). These measures do not allow us to compare the two concepts. Therefore, we cannot conclude whether benefits or harms (also in a more specific manner) play a more influential role. This, however, would be an interesting focus for future research, which could also investigate the development of a specific scale of perceived benefits and harms for democracy.

Theoretical and Practical Implications

This study investigated the perceived influence of the fit and misfit of TPA on an individual and societal level. For the first time, we empirically showed that perceived fit of TPA at Time 1 reduced the perceived manipulative intent and increased perceived benefits for democracy at Time 2. On a theoretical level, our findings contribute to our conceptual understanding of individuals’ perceptions of the fit and misfit of TPA as being conceptually different. Second, our findings show that congruency mechanisms stemming from self-congruity theory and schema incongruity processing theory (Mandler Citation1982; Sirgy Citation2018) might also apply to the context of political marketing. In addition, we showed that when recipients perceive TPA to be fitting, they are less likely to perceive manipulative intent behind the persuasive strategy. In other words, successfully tailored TPA might hinder the activation of evaluative dimensions of persuasion knowledge (see Friestad and Wright Citation1994). When the presented TPA was successfully tailored to individuals’ party preferences (i.e., political fit) and issue interests (i.e., issue fit), it was associated with less suspicion about manipulative intent and more positive evaluations of democratic implications.

Our findings have relevant implications for practitioners and voters. On one hand, our findings imply that successful targeting might not be disadvantageous for political parties, especially when communicating to the ingroup, as individuals’ levels of perceived manipulative intent were low when ads were targeted successfully in terms of fit. On the other hand, this has important implications for recipients. Individuals’ critical evaluation of TPA might be limited, especially when fit is perceived as high, which manifests in fewer reflections about the appropriateness of an ad or an advertising strategy (i.e., perceived manipulative intent) and a stronger prevalence of perceived benefits for democracy related to TPA. Losing out on critical evaluations of advertising appeals could also imply that individuals cannot activate their defense mechanisms or coping strategies (see Friestad and Wright Citation1994). Hence, individuals might be unable to equip themselves against manipulative attempts of invasive advertising strategies, like targeting. Therefore, regulations and regular evaluations of TPA gain importance. Another way to counteract such influences could be initiatives and campaigns enhancing the awareness of new digital campaigning strategies. At the same time, our study indicates that individuals who encounter TPA that fits their party preferences or issue interests perceive TPA to be beneficial to democracy. This again raises questions about individuals’ capabilities of activating defense mechanisms against persuasive techniques aiming to create a fit with individuals’ self-concept. As a result, individuals might potentially underestimate the negative societal consequences of TPA when they are successfully targeted by ads that fit their party preferences and issue interests. This highlights the importance of increasing individuals’ awareness of targeting practices in political campaigning.

Declaration of Conflicting Interests

The authors have no conflicts of interest to disclose.

Supplemental material

Supplemental Online Appendices

Download MS Word (46.5 KB)

Additional information

Notes on contributors

Melanie Hirsch

Melanie Hirsch (MSc, University of Vienna) is a doctoral candidate, Department of Communication, University of Vienna.

Marlis Stubenvoll

Marlis Stubenvoll (MS, Aarhus University/University of Amsterdam) is a doctoral candidate, Department of Communication, University of Vienna.

Alice Binder

Alice Binder (PhD, University of Vienna) is a senior scientist, Department of Communication, University of Vienna.

Jörg Matthes

Jörg Matthes (PhD, University of Zurich) is a professor of communication science, Department of Communication, University of Vienna.

References

  • Aaker, J. L. 1999. “The Malleable Self: The Role of Self-Expression in Persuasion.” Journal of Marketing Research 36 (1):45–57. doi:10.1177/002224379903600104.
  • Auxier, B., L. Rainie, M. Anderson, A. Perrin, M. Kumar, and E. Turner. 2019, November 15. “Americans and Privacy: Concerned, Confused, and Feeling Lack of Control over Their Personal Information." https://www.pewresearch.org/internet/2019/11/15/americans-and-privacy-concerned-confused-and-feeling-lack-of-control-over-their-personal-information/.
  • Barocas, S. 2012. “The Price of Precision: Voter Microtargeting and Its Potential Harms to the Democratic Process.” Proceedings of the First Edition Workshop on Politics, Elections and Data – PLEAD 12:31–6. doi:10.1145/2389661.2389671.
  • Bartels, L. M. 2006. “Three Virtues of Panel Data for the Analysis of Campaign Effects.” In Capturing Campaign Effects, edited by H. E. Brady and R. G. C. Johnston, 134–63. Ann Arbor: The University of Michigan Press.
  • Baum, K., S. Meissner, and H. Krasnova. 2021. “Partisan Self-Interest Is an Important Driver for People’s Support for the Regulation of Targeted Political Advertising.” PLoS One 16 (5):e0250506. doi:10.1371/journal.pone.0250506.
  • Beam, M. A. 2014. “Automating the News: How Personalized News Recommender System Design Choices Impact News Reception.” Communication Research 41 (8):1019–41. doi:10.1177/0093650213497979.
  • Bélanger, É., and B. M. Meguid. 2008. “Issue Salience, Issue Ownership, and Issue-Based Vote Choice.” Electoral Studies 27 (3):477–91. doi:10.1016/j.electstud.2008.01.001.
  • Bennett, C. J. 2016. “Voter Databases, Micro-Targeting, and Data Protection Law: Can Political Parties Campaign in Europe as They Do in North America?” International Data Privacy Law 6 (4):261–75. doi:10.1093/idpl/ipw021.
  • Binder, A., M. Stubenvoll, M. Hirsch, and J. Matthes. 2022. “Why Am I Getting This Ad? How the Degree of Targeting Disclosures and Political Fit Affect Persuasion Knowledge, Party Evaluation, and Online Privacy Behaviors.” Journal of Advertising 51 (2):206–22. doi:10.1080/00913367.2021.2015727.
  • Bleier, A., and M. Eisenbeiss. 2015. “Personalized Online Advertising Effectiveness: The Interplay of What, When, and Where.” Marketing Science 34 (5):669–88. doi:10.1287/mksc.2015.0930.
  • Boerman, S. C., and S. Kruikemeier. 2016. “Consumer Responses to Promoted Tweets Sent by Brands and Political Parties.” Computers in Human Behavior 65:285–94. doi:10.1016/j.chb.2016.08.033.
  • Boerman, S. C., S. Kruikemeier, and F. J. Zuiderveen Borgesius. 2017. “Online Behavioral Advertising: A Literature Review and Research Agenda.” Journal of Advertising 46 (3):363–76. doi:10.1080/00913367.2017.1339368.
  • Boerman, S. C., E. A. van Reijmersdal, E. Rozendaal, and A. L. Dima. 2018. “Development of the Persuasion Knowledge Scales of Sponsored Content (PKS-SC).” International Journal of Advertising 37 (5):671–97. doi:10.1080/02650487.2018.1470485.
  • Bol, N., T. Dienlin, S. Kruikemeier, M. Sax, S. C. Boerman, J. Strycharz, N. Helberger, and C. H. de Vreese. 2018. “Understanding the Effects of Personalization as a Privacy Calculus: Analyzing Self-Disclosure across Health, News, and Commerce Contexts.” Journal of Computer-Mediated Communication 23 (6):370–88. doi:10.1093/jcmc/zmy020.
  • Büchi, M., E. Fosch-Villaronga, C. Lutz, A. Tamò-Larrieux, and S. Velidi. 2021. “Making Sense of Algorithmic Profiling: User Perceptions on Facebook.” Information, Communication & Society. Advance online publication. doi:10.1080/1369118X.2021.1989011.
  • Budge, I., and D. J. Farlie. 1983. Explaining and Predicting Elections: Issue Effects and Party Strategies in 23 Democracies. London: Allen & Unwin.
  • Burkholder, G. J., and L. L. Harlow. 2003. “An Illustration of a Longitudinal Cross-Lagged Design for Larger Structural Equation Models.” Structural Equation Modeling: A Multidisciplinary Journal 10 (3):465–86. doi:10.1207/S15328007SEM1003_8.
  • Byrne, B. M. 2016. Structural Equation Modeling with AMOS: Basic Concepts, Applications, and Programming. New York: Routledge. doi:10.4324/9781315757421
  • Campbell, M. C. 1995. “When Attention-Getting Advertising Tactics Elicit Consumer Inferences of Manipulative Intent: The Importance of Balancing Benefits and Investments.” Journal of Consumer Psychology 4 (3):225–54. doi:10.1207/s15327663jcp0403_02.
  • Chan, S. 1997. “Effects of Attention to Campaign Coverage on Political Trust.” International Journal of Public Opinion Research 9 (3):286–96. doi:10.1093/ijpor/9.3.286.
  • Charter of Fundamental Rights of the European Union. 2012, October 26. “Charter of Fundamental Rights of the European Union (2012/C 326/02).” Official Journal of the European Union. https://eur-lex.europa.eu/legal-content/EN/TXT/PDF/?uri=CELEX:C2012/326/02
  • Craig, S. C., R. G. Niemi, and G. E. Silver. 1990. “Political Efficacy and Trust: A Report on the NES Pilot Study Items.” Political Behavior 12 (3):289–314. doi:10.1007/BF00992337.
  • Davison, W. P. 1983. “The Third-Person Effect in Communication.” The Public Opinion Quarterly 47 (1):1–15. doi:10.1086/268763.
  • Dimitrova, D. V., A. Shehata, J. Strömbäck, and L. W. Nord. 2014. “The Effects of Digital Media on Political Knowledge and Participation in Election Campaigns: Evidence from Panel Data.” Communication Research 41 (1):95–118. doi:10.1177/0093650211426004.
  • Dobber, T., D. Trilling, N. Helberger, and C. de Vreese. 2019. “Spiraling Downward: The Reciprocal Relation between Attitude toward Political Behavioral Targeting and Privacy Concerns.” New Media & Society 21 (6):1212–31. doi:10.1177/1461444818813372.
  • Dobber, T., D. Trilling, N. Helberger, and C. H. de Vreese. 2017. “Two Crates of Beer and 40 Pizzas: The Adoption of Innovative Political Behavioural Targeting Techniques.” Internet Policy Review 6 (4):1–25. doi:10.14763/2017.4.777.
  • Dommett, K. 2019. “Data-Driven Political Campaigns in Practice: Understanding and Regulating Diverse Data-Driven Campaigns.” Internet Policy Review 8 (4):1–18. doi:10.14763/2019.4.1432.
  • Endres, K. 2020. “Targeted Issue Messages and Voting Behavior.” American Politics Research 48 (2):317–28. doi:10.1177/1532673X19875694.
  • E. U. General Data Protection Regulation. 2016, April 27. “Regulation (EU) 2016/679 of the European Parliament and of the Council of 27 April 2016 on the Protection of Natural Persons with Regard to the Processing of Personal Data and on the Free Movement of Such Data, and Repealing Directive 95/46/EC (General Data Protection Regulation).” Official Journal of the European Union. https://eur-lex.europa.eu/legal-content/EN/TXT/HTML/?uri=CELEX:32016R0679&from=EN.
  • Facebook. 2022. “How Does Facebook Decide Which Ads to Show Me?" Help Center. https://www.facebook.com/help/562973647153813?helpref=related&source_cms_id=794535777607370&ref=related&cms_id=562973647153813.
  • Felzmann, H., E. F. Villaronga, C. Lutz, and A. Tamò-Larrieux. 2019. “Transparency You Can Trust: Transparency Requirements for Artificial Intelligence between Legal Norms and Contextual Concerns.” Big Data & Society 6 (1):1–14. doi:10.1177/2053951719860542.
  • Fransen, M. L., E. G. Smit, and P. W. J. Verlegh. 2015. “Strategies and Motives for Resistance to Persuasion: An Integrative Framework.” Frontiers in Psychology 6:1201–12. doi:10.3389/fpsyg.2015.01201.
  • Friestad, M., and P. Wright. 1994. “The Persuasion Knowledge Model: How People Cope with Persuasion Attempts.” Journal of Consumer Research 21 (1):1–31. doi:10.1086/209380.
  • Garaus, M., U. Wagner, and R. C. Rainer. 2021. “Emotional Targeting Using Digital Signage Systems and Facial Recognition at the Point-of-Sale.” Journal of Business Research 131:747–62. doi:10.1016/j.jbusres.2020.10.065.
  • Germelmann, C. C., J.-L. Herrmann, M. Kacha, and P. R. Darke. 2020. “Congruence and Incongruence in Thematic Advertisement–Medium Combinations: Role of Awareness, Fluency, and Persuasion Knowledge.” Journal of Advertising 49 (2):141–64. doi:10.1080/00913367.2020.1745110.
  • Green, D. P., B. Palmquist, and E. Schickler. 2004. Partisan Hearts and Minds: Political Parties and the Social Identities of Voters. New Haven, CT: Yale University Press.
  • Haenschen, K., and J. Jennings. 2019. “Mobilizing Millennial Voters with Targeted Internet Advertisements: A Field Experiment.” Political Communication 36 (3):357–75. doi:10.1080/10584609.2018.1548530.
  • Halkias, G., and F. Kokkinaki. 2011. “How Schema Incongruity Influences Consumer Responses: Exploring the Degree of Incongruity for Different Sources of Discrepancy.” In E – European Advances in Consumer Research, edited by A. Bradshaw, C. Hackley, and P. Maclaran, 144–50. Duluth, MN: Association for Consumer Research.
  • Halkias, G., and F. Kokkinaki. 2013. “Increasing Advertising Effectiveness through Incongruity-Based Tactics: The Moderating Role of Consumer Involvement.” Journal of Marketing Communications 19 (3):182–97. doi:10.1080/13527266.2011.592346.
  • Ham, C.-D., and M. R. Nelson. 2016. “The Role of Persuasion Knowledge, Assessment of Benefit and Harm, and Third-Person Perception in Coping with Online Behavioral Advertising.” Computers in Human Behavior 62:689–702. doi:10.1016/j.chb.2016.03.076.
  • Hersh, E. D., and B. F. Schaffner. 2013. “Targeted Campaign Appeals and the Value of Ambiguity.” The Journal of Politics 75 (2):520–34. doi:10.1017/S0022381613000182.
  • Hetherington, M. J., and S. Globetti. 2002. “Political Trust and Racial Policy Preferences.” American Journal of Political Science 46 (2):253. doi:10.2307/3088375.
  • Hillygus, D. S., and T. G. Shields. 2009. The Persuadable Voter: Wedge Issues in Presidential Campaigns. Princeton: Princeton University Press. doi:10.1515/9781400831593
  • Holman, M. R., M. C. Schneider, and K. Pondel. 2015. “Gender Targeting in Political Advertisements.” Political Research Quarterly 68 (4):816–29. doi:10.1177/1065912915605182.
  • Hong, J. W., and G. M. Zinkhan. 1995. “Self-Concept and Advertising Effectiveness: The Influence of Congruency, Conspicuousness, and Response Mode.” Psychology and Marketing 12 (1):53–77. doi:10.1002/mar.4220120105.
  • Hoomans, J. 2015, March 20. “35,000 Decisions: The Great Choices of Strategic Leaders.” The Leading Edge. https://go.roberts.edu/leadingedge/the-great-choices-of-strategic-leaders.
  • Hsu, C.-L., and J. C.-C. Lin. 2018. “Exploring Factors Affecting the Adoption of Internet of Things Services.” Journal of Computer Information Systems 58 (1):49–57. doi:10.1080/08874417.2016.1186524.
  • Huddy, L., and A. Bankert. 2017. “Political Partisanship as a Social Identity.” In Oxford Research Encyclopedia of Politics, edited by W. R. Thompson, 1–24. New York: Oxford University Press. doi:10.1093/acrefore/9780190228637.013.250
  • Jamieson, K. H. 2013. “Messages, Micro-Targeting, and New Media Technologies.” The Forum 11 (3):429–35. doi:10.1515/for-2013-0052.
  • Kline, R. B. 2011. Principles and Practice of Structural Equation Modeling. New York: Guilford Press.
  • Knobloch-Westerwick, S., and J. Meng. 2011. “Reinforcement of the Political Self through Selective Exposure to Political Messages.” Journal of Communication 61 (2):349–68. doi:10.1111/j.1460-2466.2011.01543.x.
  • König, P. D. 2020. “Why Digital-Era Political Marketing Is Not the Death Knell for Democracy: On the Importance of Placing Political Microtargeting in the Context of Party Competition.” Statistics, Politics and Policy 11 (1):87–110. doi:10.1515/spp-2019-0006.
  • Kreiss, D. 2017. “Micro-Targeting, the Quantified Persuasion.” Internet Policy Review 6 (4):1–14. doi:10.14763/2017.4.774.
  • Krotzek, L. J. 2019. “Inside the Voter’s Mind: The Effect of Psychometric Microtargeting on Feelings toward and Propensity to Vote for a Candidate.” International Journal of Communication 13:3609–29. https://ijoc.org/index.php/ijoc/article/view/9605.
  • Kruikemeier, S., M. Sezgin, and S. C. Boerman. 2016. “Political Microtargeting: Relationship between Personalized Advertising on Facebook and Voters’ Responses.” Cyberpsychology, Behavior and Social Networking 19 (6):367–72. doi:10.1089/cyber.2015.0652.
  • Lane, D. S., S. S. Lee, F. Liang, D. H. Kim, L. Shen, B. E. Weeks, and N. Kwak. 2019. “Social Media Expression and the Political Self.” Journal of Communication 69 (1):49–72. doi:10.1093/joc/jqy064.
  • Laufer, R. S., and M. Wolfe. 1977. “Privacy as a Concept and a Social Issue: A Multidimensional Developmental Theory.” Journal of Social Issues 33 (3):22–42. doi:10.1111/j.1540-4560.1977.tb01880.x.
  • Lavigne, M. 2021. “Strengthening Ties: The Influence of Microtargeting on Partisan Attitudes and the Vote.” Party Politics 27 (5):965–76. doi:10.1177/1354068820918387.
  • Lefevere, J., A. Tresch, and S. Walgrave. 2015. “Introduction: Issue Ownership.” West European Politics 38 (4):755–60. doi:10.1080/01402382.2015.1039375.
  • Leiner, D. J. 2019. “Too Fast, Too Straight, Too Weird: Non-Reactive Indicators for Meaningless Data in Internet Surveys.” Survey Research Methods 13 (3):229–48. doi:10.18148/srm/2019.v13i3.7403.
  • Li, C. 2016. “When Does Web-Based Personalization Really Work? The Distinction between Actual Personalization and Perceived Personalization.” Computers in Human Behavior 54:25–33. doi:10.1016/j.chb.2015.07.049.
  • Lock, A., and P. Harris. 1996. “Political Marketing – vive la différence!.” European Journal of Marketing 30 (10/11):14–24. doi:10.1108/03090569610149764.
  • Lovejoy, J., H. Cheng, and D. Riffe. 2010. “Voters’ Attention, Perceived Effects, and Voting Preferences: Negative Political Advertising in the 2006 Ohio Governor’s Election.” Mass Communication and Society 13 (5):487–511. doi:10.1080/15205430903457430.
  • Maheswaran, D., and S. Chaiken. 1991. “Promoting Systematic Processing in Low-Motivation Settings: Effect of Incongruent Information on Processing and Judgment.” Journal of Personality and Social Psychology 61 (1):13–25. doi:10.1037/0022-3514.61.1.13.
  • Mandler, G. 1982. “The Structure of Value: Accounting for Taste.” In Affect and Cognition : 17th Annual Carnegie Mellon Symposium on Cognition, edited by M. S. Clark and S. T. Fiske, 3–36. Hillsdale, NJ: Lawrence Erlbaum Associates.
  • Mani, Z., and I. Chouk. 2017. “Drivers of Consumers’ Resistance to Smart Products.” Journal of Marketing Management 33 (1–2):76–97. doi:10.1080/0267257X.2016.1245212.
  • Matthes, J., M. Hirsch, M. Stubenvoll, A. Binder, S. Kruikemeier, S. Lecheler, and L. Otto. 2022. “Understanding the Democratic Role of Perceived Online Political Micro-Targeting: Longitudinal Effects on Trust in Democracy and Political Interest.” Journal of Information Technology & Politics 19 (4):435–48. doi:10.1080/19331681.2021.2016542.
  • Matthes, J., and F. Marquart. 2015. “A New Look at Campaign Advertising and Political Engagement: Exploring the Effects of Opinion-Congruent and -Incongruent Political Advertisements.” Communication Research 42 (1):134–55. doi:10.1177/0093650213514600.
  • Meyer, T. M., and M. Wagner. 2016. “Issue Engagement in Election Campaigns the Impact of Electoral Incentives and Organizational Constraints.” Political Science Research and Methods 4 (3):555–71. doi:10.1017/psrm.2015.40.
  • Nanz, A., and J. Matthes. 2022. “Seeing Political Information Online Incidentally. Effects of First- and Second-Level Incidental Exposure on Democratic Outcomes.” Computers in Human Behavior 133:107285. doi:10.1016/j.chb.2022.107285.
  • Nelson, M. R., C. D. Ham, E. Haley, and U. C. Chung. 2021. “How Political Interest and Gender Influence Persuasion Knowledge, Political Information Seeking, and Support for Regulation of Political Advertising in Social Media.” Journal of Interactive Advertising 21 (3):225–42. doi:10.1080/15252019.2021.1978352.
  • Otto, L. P., F. Thomas, I. Glogger, and C. H. De Vreese. 2021. “Linking Media Content and Survey Data in a Dynamic and Digital Media Environment – Mobile Longitudinal Linkage Analysis.” Digital Journalism 10 (1):200–15. doi:10.1080/21670811.2021.1890169.
  • Papakyriakopoulos, O., S. Hegelich, M. Shahrezaye, and J. C. M. Serrano. 2018. “Social Media and Microtargeting: Political Data Processing and the Consequences for Germany.” Big Data & Society 5 (2):1–15. doi:10.1177/2053951718811844.
  • Petrocik, J. R. 1996. “Issue Ownership in Presidential Elections, with a 1980 Case Study.” American Journal of Political Science 40 (3):825–50. doi:10.2307/2111797.
  • Pilditch, T., and J. K. Madsen. 2021. “Targeting Your Preferences: Modelling Micro-Targeting for an Increasingly Diverse Electorate.” Journal of Artificial Societies and Social Simulation 24 (1):1–16. doi:10.18564/jasss.4452.
  • Reiter, F., and J. Matthes. 2021. ““The Good, the Bad, and the Ugly”: A Panel Study on the Reciprocal Effects of Negative, Dirty, and Positive Campaigning on Political Distrust.” Mass Communication and Society 25 (5):649–72. doi:10.1080/15205436.2021.1934702.
  • Roemmele, A., and R. Gibson. 2020. “Scientific and Subversive: The Two Faces of the Fourth Era of Political Campaigning.” New Media & Society 22 (4):595–610. doi:10.1177/1461444819893979.
  • Rosseel, Y. 2012. “Lavaan: An R Package for Structural Equation Modeling.” Journal of Statistical Software 48:1–36. doi:10.18637/jss.v048.i02.
  • Sirgy, M. J. 1985. “Using Self-Congruity and Ideal Congruity to Predict Purchase Motivation.” Journal of Business Research 13 (3):195–206. doi:10.1016/0148-2963(85)90026-8.
  • Sirgy, M. J. 2018. “Self-Congruity Theory in Consumer Behavior: A Little History.” Journal of Global Scholars of Marketing Science 28 (2):197–207. doi:10.1080/21639159.2018.1436981.
  • Smit, E. G., G. Van Noort, and H. A. M. Voorveld. 2014. “Understanding Online Behavioural Advertising: User Knowledge, Privacy Concerns and Online Coping Behaviour in Europe.” Computers in Human Behavior 32:15–22. doi:10.1016/j.chb.2013.11.008.
  • Stubenvoll, M., A. Binder, S. Noetzel, M. Hirsch, and J. Matthes. 2022. “Living Is Easy with Eyes Closed: Avoidance of Targeted Political Advertising in Response to Privacy Concerns, Perceived Personalization, and Overload.” Communication Research. Advance online publication. doi:10.1177/00936502221130840.
  • Tajfel, H., and J. C. Turner. 1986. “The Social Identity Theory of Intergroup Behavior.” In Psychology of Intergroup Relations, edited by S. Worchel and L. W. Austin, 276–93. Chicago: Nelson-Hall.
  • Taris, T. 2000. A Primer in Longitudinal Data Analysis. London: SAGE Publications Ltd.
  • Thorson, K., K. Cotter, M. Medeiros, and C. Pak. 2019. “Algorithmic Inference, Political Interest, and Exposure to News and Politics on Facebook.” Information, Communication & Society 24 (2):183–200. doi:10.1080/1369118X.2019.1642934.
  • Trepte, S., L. Reinecke, N. B. Ellison, O. Quiring, M. Z. Yao, and M. Ziegele. 2017. “A Cross-Cultural Perspective on the Privacy Calculus.” Social Media + Society 3 (1):1–13. doi:10.1177/2056305116688035.
  • Van den Broeck, E., K. Poels, and M. Walrave. 2020. “How Do Users Evaluate Personalized Facebook Advertising? An Analysis of Consumer- and Advertiser Controlled Factors.” Qualitative Market Research: An International Journal 23 (2):309–27. doi:10.1108/QMR-10-2018-0125.
  • van Doorn, J., and J. C. Hoekstra. 2013. “Customization of Online Advertising: The Role of Intrusiveness.” Marketing Letters 24 (4):339–51. doi:10.1007/s11002-012-9222-1.
  • Walgrave, S., A. Tresch, and J. Lefevere. 2015. “The Conceptualisation and Measurement of Issue Ownership.” West European Politics 38 (4):778–96. doi:10.1080/01402382.2015.1039381.
  • West, E. A., and S. Iyengar. 2020. “Partisanship as a Social Identity: Implications for Polarization.” Political Behavior 44:807–38. doi:10.1007/s11109-020-09637-y.
  • Zarouali, B., T. Dobber, G. De Pauw, and C. de Vreese. 2020. “Using a Personality-Profiling Algorithm to Investigate Political Microtargeting: Assessing the Persuasion Effects of Personality-Tailored Ads on Social Media.” Communication Research 49 (8):1066–91. doi:10.1177/0093650220961965.
  • Zarouali, B., K. Poels, M. Walrave, and K. Ponnet. 2019. “The Impact of Regulatory Focus on Adolescents’ Evaluation of Targeted Advertising on Social Networking Sites.” International Journal of Advertising 38 (2):316–35. doi:10.1080/02650487.2017.1419416.
  • Zuiderveen Borgesius, F. J. 2015. “Improving Privacy Protection in the Area of Behavioural Targeting.” SSRN. https://ssrn.com/abstract=2654213 or doi:10.2139/ssrn.2654213.
  • Zuiderveen Borgesius, F. J., J. Möller, S. Kruikemeier, R. Ó Fathaigh, K. Irion, T. Dobber, B. Bodo, and C. De Vreese. 2018. “Online Political Microtargeting: Promises and Threats for Democracy.” Utrecht Law Review 14 (1):82–96. doi:10.18352/ulr.420.