2,692
Views
26
CrossRef citations to date
0
Altmetric
Articles

Examining the roles of social presence and human-likeness on Iranian EFL learners’ motivation using artificial intelligence technology: a case of CSIEC chatbot

&
Pages 655-673 | Received 05 Apr 2021, Accepted 22 Jun 2022, Published online: 25 Jul 2022

References

  • Almenara, J. C., Lozano, J. A. M., Osuna, J. B., Batanero, J. M. F., Tena, R. R., Graván, P. R., Llorente, C., & Regaña, C. B. (2010). Análisis de centros de recursos de producción de las TIC de las universidades españolas. Analysis of production resource centers of the Spanish universities’ ICT’s. Revista de Educación, 351, 237–257.
  • Angeli, C., & Valanides, N. (2020). Developing young children’s computational thinking with educational robotics: An interaction effect between gender and scaffolding strategy. Computers in Human Behavior, 105, 105954. http://doi.org/10.1016/j.chb.2019.03.018.
  • Araujo, T. (2018). Living up to the chatbot hype: The influence of anthropomorphic design cues and communicative agency framing on conversational agent and company perceptions. Computers in Human Behavior, 85, 183–189. https://doi.org/10.1016/j.chb.2018.03.051
  • Balzarotti, S., Piccini, L., Andreoni, G., & Ciceri, R. (2014). “I know that you know how I feel”: Behavioral and physiological signals demonstrate emotional attunement while interacting with a computer simulating emotional intelligence. Journal of Nonverbal Behavior, 38(3), 283–299. https://doi.org/10.1007/s10919-014-0180-6
  • Bibauw, S., François, T., & Desmet, P. (2019). Discussing with a computer to practice a foreign language: Research synthesis and conceptual framework of dialogue-based CALL. Computer Assisted Language Learning, 32(8), 827–877.
  • Biocca, F., Harms, C., & Gregg, J. (2001, May). The networked minds measure of social presence: Pilot test of the factor structure and concurrent validity. In 4th annual international workshop on presence, Philadelphia, PA (pp. 1–9).
  • Chang, W., Park, J. E., & Chaiy, S. (2010). How does CRM technology transform into organizational performance? A mediating role of marketing capability. Journal of Business Research, 63(8), 849–855. https://doi.org/10.1016/j.jbusres.2009.07.003
  • Cheng, L. T., & Wang, J. W. (2019). Enhancing learning performance through classroom response systems: The effect of knowledge type and social presence. The International Journal of Management Education, 17(1), 103–118. https://doi.org/10.1016/j.ijme.2019.01.001
  • Coniam, D. (2014). The linguistic accuracy of chatbots: Usability from an ESL perspective. Text & Talk, 34(5), 545–567. https://doi.org/10.1515/text-2014-0018
  • Creswell, J. W., & Plano Clark, V. L. (2011). Designing and conducting mixed methods research. Sage.
  • Creswell, J. W., Plano Clark, V. L., Gutmann, M., & Hanson, W. (2003). Advanced mixed methods research designs. In A. Tashakkori & C. Teddlie (Eds.), Handbook on mixed methods in the behavioral and social sciences (pp. 209–240). Sage.
  • Davari, A., & Rezazadeh, A. (2013). Structural equation modeling with PLS. Tehran: Jahad University, 215(2), 224. (In Persian).
  • Divekar, R. R., Drozdal, J., Chabot, S., Zhou, Y., Su, H., Chen, Y., Zhu, H., Hendler, J. A., & Braasch, J. (2021). Foreign language acquisition via artificial intelligence and extended reality: Design and evaluation. Computer Assisted Language Learning, 1–29. https://doi.org/10.17762/turcomat.v12i10.5268
  • D’Souza, M. J., & Rodrigues, P. (2015). Extreme pedagogy: An agile teaching-learning methodology for engineering education. Indian Journal of Science and Technology, 8(9), 828. https://doi.org/10.17485/ijst/2015/v8i9/53274
  • Edwards, A., & Edwards, C. (2017). The machines are coming: Future directions in instructional communication research. Communication Education, 66(4), 487–488. https://doi.org/10.1080/03634523.2017.1349915
  • Edwards, C., Edwards, A., Spence, P. R., & Westerman, D. (2016). Initial interaction expectations with robots: Testing the human-to-human interaction script. Communication Studies, 67(2), 227–238. https://doi.org/10.1080/10510974.2015.1121899
  • El Shazly, R. (2021). Effects of artificial intelligence on English speaking anxiety and speaking performance: A case study. Expert Systems, 38(3), e12667. https://doi.org/10.1111/exsy.12667
  • Else-Quest, N. M., Hyde, J. S., & Linn, M. C. (2010). Cross-national patterns of gender differences in mathematics: A meta-analysis. Psychological Bulletin, 136(1), 103–127. https://doi.org/10.1037/a0018053
  • Fesakis, G., Dimitracopoulou, A., & Palaiodimos, A. (2013). Graphical interaction analysis impact on groups collaborating through blogs. Educational Technology & Society, 16(1), 243–253.
  • Fornell, C., & Larcker, D. F. (1981). Evaluating structural equation models with unobservable variables and measurement error. Journal of Marketing Research, 18(1), 39–50. https://doi.org/10.1177/002224378101800104
  • Freedman, M. (1993). The kindness of strangers: Adult mentors, urban youth, and the new voluntarism. Cambridge University Press.
  • Freiermuth, M. R., & Huang, H. C. (2012). Bringing Japan and Taiwan closer electronically: A look at an intercultural online synchronic chat task and its effect on motivation. Language Teaching Research, 16(1), 61–88. https://doi.org/10.1177/1362168811423341
  • Fryer, L. K., Nakao, K., & Thompson, A. (2019). Chatbot learning partners: Connecting learning experiences, interest, and competence. Computers in Human Behavior, 93, 279–289. https://doi.org/10.1016/j.chb.2018.12.023
  • Gan, C., & Li, H. (2018). Understanding the effects of gratifications on the continuance intention to use WeChat in China: A perspective on uses and gratifications. Computers in Human Behavior, 78, 306–315. https://doi.org/10.1016/j.chb.2017.10.003
  • Gefen, D., & Straub, D. (2003). Managing user trust in B2C e-services. e-Service Journal, 2(2), 7–24. https://doi.org/10.2979/esj.2003.2.2.7
  • Gefen, D., & Straub, D. W. (1997). Gender differences in the perception and use of e-mail: An extension to the technology acceptance model. MIS Quarterly, 21(4), 389–400. https://doi.org/10.2307/249720
  • George, D., & Mallery, P. (2010). SPSS for Windows step by step: A simple guide and reference, 17.0 update. SPSS for Windows step by step answers to selected exercises.
  • Graesser, A. C., Chipman, P., Haynes, B. C., & Olney, A. (2005). Autotutor: An intelligent tutoring system with mixed-initiative dialogue. IEEE Transactions on Education, 48(4), 612–618. https://doi.org/10.1109/TE.2005.856149
  • Gunawardena, C. N., & Zittle, F. J. (1997). Social presence as a predictor of satisfaction within a computer-mediated conferencing environment. American Journal of Distance Education, 11(3), 8–26. https://doi.org/10.1080/08923649709526970
  • Hackman, M. Z., & Walker, K. B. (1990). Instructional communication in the televised classroom: The effects of system design and teacher immediacy on student learning and satisfaction. Communication Education, 39(3), 196–206. https://doi.org/10.1080/03634529009378802
  • Hair, J. F., Ringle, C. M., & Sarstedt, M. (2011). PLS-SEM: Indeed a silver bullet. Journal of Marketing Theory and Practice, 19(2), 139–152. https://doi.org/10.2753/MTP1069-6679190202
  • Han, J., Jo, M., Jones, V., & Jo, J. H. (2008). Comparative study on the educational use of home robots for children. JIPS, 4(4), 159–168.
  • Han, S., & Lee, M. K. (2022). FAQ chatbot and inclusive learning in massive open online courses. Computers & Education, 179(1), 104395.
  • Hernández-del-Olmo, F., Gaudioso, E., Duro, N., & Dormido, R. (2019). Machine learning weather soft-sensor for advanced control of wastewater treatment plants. Sensors, 19(14), 3139. https://doi.org/10.3390/s19143139
  • Hill, J., Ford, W. R., & Farreras, I. G. (2015). Real conversations with artificial intelligence: A comparison between human–human online conversations and human–chatbot conversations. Computers in Human Behavior, 49(2), 245–250.
  • Holtgraves, T., & Han, T.-L. (2007). A procedure for studying online conversational processing using a chat bot. Behavior Research Methods, 39(1), 156–163. https://doi.org/10.3758/BF03192855
  • Holtgraves, T., Ross, S. J., Weywadt, C. R., & Han, T.-L. (2007). Perceiving artificial social agents. Computers in Human Behavior, 23(5), 2163–2174. https://doi.org/10.1016/j.chb.2006.02.017
  • Hooshyar, D., Ahmad, R. B., Yousefi, M., Yusop, F. D., & Horng, S. J. (2015). A flow chart-based intelligent tutoring system for improving problem-solving skills of novice programmers. Journal of Computer Assisted Learning, 31(4), 345–361. https://doi.org/10.1111/jcal.12099
  • Hyland, K. (2008). Disciplinary voices: Interactions in research writing. English Text Construction, 1(1), 5–22. https://doi.org/10.1075/etc.1.1.03hyl
  • Hyland, K., & Guinda, C. S. (Eds.). (2012). Stance and voice in written academic genres. Palgrave Macmillan.
  • Ivanič, R., & Camps, D. (2001). I am how I sound: Voice as self-representation in L2 7 writing. Journal of Second Language Writing, 10(1), 3–33. https://doi.org/10.1016/S1060-3743(01)00034-0
  • Jeon, J. (2021). Exploring AI chatbot affordances in the EFL classroom: Young learners’ experiences and perspectives. Computer Assisted Language Learning, 1–27. https://doi.org/10.1080/09588221.2021.1987272
  • Jia, J. (2004, August). CSIEC (Computer simulator in educational communication): A virtual context-adaptive chatting partner for foreign language learners. In IEEE international conference on advanced learning technologies, 2004. Proceedings (pp. 690–692). IEEE.
  • Jia, J. (2009). CSIEC: A computer assisted English learning chatbot based on textual knowledge and reasoning. Knowledge-Based Systems, 22(4), 249–255. https://doi.org/10.1016/j.knosys.2008.09.001
  • Jia, J. (2018). The cost-effect analysis of integration of CSIEC system into English instruction. Online Course Management: Concepts, Methodologies, Tools, and Applications, 18(3), 1917–1939. https://doi.org/10.4018/978-1-5225-5472-1.ch100
  • Jia, J., & Chen, W. (2009). The further development of CSIEC project driven by application and evaluation in English education. British Journal of Educational Technology, 40(5), 901–918. https://doi.org/10.1111/j.1467-8535.2008.00881.x
  • Jonassen, D., Davidson, M., Collins, M., Campbell, J., & Hagg, B. B. (1995). Constructivism and computer mediated communication in distance education. American Journal of Distance Education, 9(2), 7–26. https://doi.org/10.1080/08923649509526885
  • Kacprzyk, J., & Zadrozny, S. (2010). Computing with words is an implementable paradigm: Fuzzy queries, linguistic data summaries, and natural-language generation. IEEE Transactions on Fuzzy Systems, 18(3), 461–472. https://doi.org/10.1109/TFUZZ.2010.2040480
  • Kerly, A., Hall, P., & Bull, S. (2007). Bringing chatbots into education: Towards natural language negotiation of open learner models. Knowledge-Based Systems, 20(2), 177–185. https://doi.org/10.1016/j.knosys.2006.11.014
  • Kim, J. H. (2017). Smartphone-mediated communication vs. face-to-face interaction: Two routes to social support and problematic use of smartphone. Computers in Human Behavior, 67, 282–291. https://doi.org/10.1016/j.chb.2016.11.004
  • Kose, U., Arslan, A., & Campus, A. K. (2015). E-learning experience with artificial intelligence supported software: An international application on English language courses. GLOKALde, 1(3), 61–75.
  • Kozan, K., & Richardson, J. C. (2014). Interrelationships between and among social, teaching and cognitive presence. The Internet and Higher Education, 21, 68–73. https://doi.org/10.1016/j.iheduc.2013.10.007
  • Krashen, S. D. (1982). Principles and practice in second language acquisition. Pergamon Press.
  • Lowenthal, P. R., & Snelson, C. (2017). In search of a better understanding of social presence: An investigation into how researchers define social presence. Distance Education, 38(2), 141–159. https://doi.org/10.1080/01587919.2017.1324727
  • Makransky, G., Wismer, P., & Mayer, R. E. (2019). A gender matching effect in learning with pedagogical agents in an immersive virtual reality science simulation. Journal of Computer Assisted Learning, 35(3), 349–358. https://doi.org/10.1111/jcal.12335
  • Meyer, J., Miller, C., Hancock, P., de Visser, E. J., & Dorneich, M. (2016, September). Politeness in machine-human and human-human interaction. In Proceedings of the human factors and ergonomics society annual meeting (Vol. 60, No. 1, pp. 279–283). Los Angeles, CA: Sage.
  • Monahan, T., McArdle, G., & Bertolotto, M. (2008). Virtual reality for collaborative e-learning. Computers & Education, 50(4), 1339–1353. https://doi.org/10.1016/j.compedu.2006.12.008
  • Murgia, A., Janssens, D., Demeyer, S., & Vasilescu, B. (2016, May). Among the machines: Human-bot interaction on social Q&A websites. In Proceedings of the 2016 CHI conference extended abstracts on human factors in computing systems (pp. 1272–1279).
  • Nass, C., Moon, Y., Fogg, B. J., Reeves, B., & Dryer, C. (1995, May). Can computer personalities be human personalities? International Journal of Human-Computer Studies, 43(2), 223–239.
  • Nawaila, M., Kanbul, S., & Alhamroni, R. (2020). Technology and English language teaching and learning: A content analysis. Journal of Learning and Teaching in Digital Age, 5(1), 16–23. Retrieved from https://dergipark.org.tr/en/pub/joltida/issue/55477/760130
  • Oztok, M., Zingaro, D., Makos, A., Brett, C., & Hewitt, J. (2015). Capitalizing on social presence: The relationship between social capital and social presence. The Internet and Higher Education, 26, 19–24. https://doi.org/10.1016/j.iheduc.2015.04.002
  • Park, C. W., & Kim, D. G. (2020). Exploring the roles of social presence and gender difference in online learning. Decision Sciences Journal of Innovative Education, 18(2), 291–312. https://doi.org/10.1111/dsji.12207
  • Park, E., Kim, K. J., & Del Pobil, A. P. (2011, November). The effects of a robot instructor’s positive vs. negative feedbacks on attraction and acceptance towards the robot in classroom. In International conference on social robotics (pp. 135–141). Berlin, Heidelberg: Springer.
  • Peterson, M. (2006). Learner interaction management in an avatar and chat-based virtual world. Computer Assisted Language Learning, 19(1), 79–103.
  • Phakiti, A. (2018). Confirmatory factor analysis and structural equation modeling. In The Palgrave handbook of applied linguistics research methodology (pp. 459–500). London: Palgrave Macmillan.
  • Pishghadam, R., & Khajavy, G. H. (2014). Development and validation of the student stroke scale and examining its relation with academic motivation. Studies in Educational Evaluation, 43, 109–114. https://doi.org/10.1016/j.stueduc.2014.03.004
  • Pishghadam, R., Naji Meidani, E., & Khajavy, G. H. (2015). Language teachers’ conceptions of intelligence and their roles in teacher care and teacher feedback. Australian Journal of Teacher Education, 40(1), 60–82. https://doi.org/10.14221/ajte.2015v40n1.4.
  • Reich-Stiebert, N., & Eyssel, F. (2017, March). (Ir) relevance of gender? On the influence of gender stereotypes on learning with a robot. In 2017 12th ACM/IEEE international conference on human-robot interaction (pp. 166–176). IEEE. https://doi.org/10.1145/2909824.3020242
  • Richardson, J. C., & Swan, K. P. (2003). Examining social presence in online courses in relation to students’ perceived learning and satisfaction. Journal of Asynchronous Learning Networks, 7(4), 68–88. http://doi.org/10.24059/olj.v7i1.1864
  • Sayaf, A. M., Alamri, M. M., Alqahtani, M. A., & Alrahmi, W. M. (2022). Factors influencing university students’ adoption of digital learning technology in teaching and learning. Sustainability, 14(1), 493. https://doi.org/10.3390/su14010493
  • Schuetzler, R. M., Giboney, J. S., Grimes, G. M., & Nunamaker, J. F., Jr. (2018). The influence of conversational agent embodiment and conversational relevance on socially desirable responding. Decision Support Systems, 114, 94–102. https://doi.org/10.1016/j.dss.2018.08.011
  • Schuetzler, R. M., Grimes, M., Giboney, J. S., & Buckman, J. (2014). Facilitating natural conversational agent interactions: Lessons from a deception experiment.
  • Schumacker, R. E., & Lomax, R. G. (2016). A beginner’s guide to structural equation modeling (4th ed.). Routledge.
  • Seneff, S. (2006, December). Interactive computer aids for acquiring proficiency in Mandarin. In International Symposium on Chinese Spoken Language Processing (pp. 1–12). Berlin, Heidelberg: Springer.
  • Seraji, F., Attaran, M., & Azizi, S. M. (2019). Blended learning researches in Iran: Several fundamental criticisms. Digital Education Review, 36(36), 190–206. https://doi.org/10.1344/der.2019.36.190-206
  • Serholt, S., Barendregt, W., Vasalou, A., Alves-Oliveira, P., Jones, A., Petisca, S., & Paiva, A. (2017). The case of classroom robots: Teachers’ deliberations on the ethical tensions. AI & Society, 32(4), 613–631. https://doi.org/10.1007/s00146-016-0667-2
  • Sharkey, A. J. (2016). Should we welcome robot teachers? Ethics and Information Technology, 18(4), 283–297. https://doi.org/10.1007/s10676-016-9387-z
  • Shen, K. N., & Khalifa, M. (2008). Exploring multidimensional conceptualization of social presence in the context of online communities. International Journal of Human-Computer Interaction, 24(7), 722–748. https://doi.org/10.1080/10447310802335789
  • Shirai, S. (2006, April). How transactional analysis can be used in terminal care. In International congress series (Vol. 1287, pp. 179–184). Elsevier.
  • Short, J., Williams, E., & Christie, B. (1976). The social psychology of telecommunications. Wiley.
  • Smestad, T. L., & Volden, F. (2018, October). Chatbot personalities matters. In International conference on internet science (pp. 170–181). Cham: Springer.
  • Subramaniam, N. K. (2019). Teaching & learning via chatbots with immersive and machine learning capabilities. In ICE 2019 conference proceedings (pp. 145). Open University Malaysia (OUM). http://ice2019.oum.edu.my/proceed ings.php
  • Sundar, S. S., & Limperos, A. M. (2013). Uses and gratifications 2.0: New gratifications for new media. Journal of Broadcasting & Electronic Media, 57(4), 504–525. https://doi.org/10.1080/08838151.2013.845827
  • Thompson, G., & Hunston, S. (Eds.). (2000). Evaluation in text: Authorial stance and the construction of discourse: Authorial stance and the construction of discourse. Oxford University Press.
  • Timpe-Laughlin, V., Sydorenko, T., & Daurio, P. (2020). Using spoken dialogue technology for L2 speaking practice: What do teachers think? Computer Assisted Language Learning, https://doi.org/10.1080/09588221.2020.1774904
  • Warschauer, M. (2001). On-line communication. In R. Carter & D. Nunan (Eds.), The Cambridge guide to teaching English to speakers of other languages (pp. 207–212). Cambridge University Press.
  • Weisleder, A., & Fernald, A. (2013). Talking to children matters: Early language experience strengthens processing and builds vocabulary. Psychological Science, 24(11), 2143–2152. https://doi.org/10.1177/0956797613488145
  • Weizenbaum, J. (1966). ELIZA—a computer program for the study of natural language communication between man and machine. Communications of the ACM, 9(1), 36–45.
  • Wohlwend, K., & Peppler, K. (2015). All rigor and no play is no way to improve learning. Phi Delta Kappan, 96(8), 22–26.
  • Woodrow, L. (2006). Anxiety and speaking English as a second language. RELC Journal, 37(3), 308–328. https://doi.org/10.1177/0033688206071315
  • Xu, Y., Wang, D., Collins, P., Lee, H., & Warschauer, M. (2021). Same benefits, different communication patterns: Comparing children’s reading with a conversational agent vs. a human partner. Computers & Education, 161, 104059. https://doi.org/10.1016/j.compedu.2020.104059
  • Xu, Y., & Warschauer, M. (2020, April). What are you talking to?: Understanding children’s perceptions of conversational agents. In Proceedings of the 2020 CHI conference on human factors in computing systems (pp. 1–13).
  • Yin, J., Goh, T. T., Yang, B., & Xiaobin, Y. (2021). Conversation technology with micro-learning: The impact of chatbot-based learning on students’ learning motivation and performance. Journal of Educational Computing Research, 59(1), 154–177. https://doi.org/10.1177/0735633120952067
  • York, J., Shibata, K., Tokutake, H., & Nakayama, H. (2021). Effect of SCMC on foreign language anxiety and learning experience: A comparison of voice, video, and VR-based oral interaction. ReCALL, 33(1), 49–70. https://doi.org/10.1017/S0958344020000154
  • Zou, B., Li, H., & Li, J. (2018). Exploring a curriculum app and a social communication app for EFL learning. Computer Assisted Language Learning, 31(7), 694–713. https://doi.org/10.1080/09588221.2018.1438474

Reprints and Corporate Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

To request a reprint or corporate permissions for this article, please click on the relevant link below:

Academic Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

Obtain permissions instantly via Rightslink by clicking on the button below:

If you are unable to obtain permissions via Rightslink, please complete and submit this Permissions form. For more information, please visit our Permissions help page.