Cross-Modal Impact of Recent Word Encountering Experience

ABSTRACT

Purpose

This study was designed to distinguish the degree of sharing of representations between different modalities by investigating whether a word encountering experience in one modality impacts word processing in another modality.

Method

In three experiments, participants experienced some words frequently in the auditory modality (Experiment 1, sample size 30, mean age 23.4, 56.7% female, all participants were native Chinese speakers) or visual modality (Experiment 2, sample size 30, mean age 22.4 years, 63.3% female, all participants were native Chinese speakers) in the training session, and were tested whether the word encountering experience impacts the results of Chinese word segmentation in the visual modality in the test session. In Experiment 3 (sample size 30, mean age 24.6 years, 76.7% female, all participants were native Chinese speakers), we used a within-subjects design, in which each participant received both auditory and visual training tasks.

Results

The results of the three experiments showed that encountering a word frequently in a short period of time in the auditory modality or visual modality can affect word segmentation in Chinese reading, with a recently experienced word being more likely to be segmented as a word. This effect was long-lasting, as it could still be observed after 7 days.

Conclusion

The results suggest that the effect of a word encountering experience in listening can be transferred to reading. Thus, word encountering experiences should be stored at a location in the mind that is used for both listening and reading.

Funding

This work was jointly funded by the National Natural Science Foundation of China (NSFC) and the German Research Foundation (DFG) in Project Crossmodal Learning, NSFC 62061136001/DFG TRR-169. This research was supported by a grant from the National Natural Science Foundation of China (31970992).

Disclosure statement

No potential conflict of interest was reported by the author(s).

Data availability statement

The data that support the findings of this study are openly available in OSF at https://osf.io/x9dc6/?view_only=3adbcf8e31dd4039a269f3046557acde

Notes

1. The frequency of 33 of these target words was comparable (M = 1.07 occurrences per million, SE = 0.05, ranging between 0.03 and 12.10) in another word frequency corpus (Cai et al., 2010). The other 7 targets were not listed in Cai et al. (2010).