Collaborative Intelligence: A Scoping Review Of Current Applications

References

• Abeywickrama, D. B., and S. D. Ramchurn. 2024. Engineering responsible and explainable models in human-agent collectives. Applied Artificial Intelligence 38 (1):2282834. doi:10.1080/08839514.2023.2282834.
   Web of Science ®Google Scholar
• Agrawal, A., J. Cleland-Huang, and J. P. Steghöfer. 2020. Model-driven requirements for humans-on-the-loop multi-UAV missions. Paper presented at the 2020 IEEE Tenth International Model-Driven Requirements Engineering (MoDRE). Aug 31-31. p.1-10, Article 9233025.
   Google Scholar
• Agrawal, A., J. S. Gans, and A. Goldfarb. 2019. Exploring the impact of artificial intelligence: Prediction versus judgment. Information Economics and Policy 47:1–23. doi:10.1016/j.infoecopol.2019.05.001.
   Web of Science ®Google Scholar
• Akata, Z., D. Balliet, M. D. Rijke, F. Dignum, V. Dignum, G. Eiben, and M. Welling, D. Grossi, K. Hindriks, H. Hoos. 2020. A research agenda for hybrid intelligence: Augmenting human intellect with collaborative, adaptive, responsible, and explainable artificial intelligence. Computer 53 (8):18–28. doi:10.1109/MC.2020.2996587.
   Web of Science ®Google Scholar
• Arksey, H., and L. O’Malley. 2005. Scoping studies: Towards a methodological framework. International Journal of Social Research Methodology 8 (1):19–32. doi:10.1080/1364557032000119616.
   Google Scholar
• Asfour, T., L. Kaul, M. Wächter, S. Ottenhaus, P. Weiner, S. Rader, and H. Haubert 2018. ARMAR-6: A collaborative humanoid robot for industrial environments. Paper presented at the 2018 IEEE-RAS 18th International Conference on Humanoid Robots (Humanoids). Beijing, China, Nov 6-9.
   Google Scholar
• Avdeeff, M. 2019. Artificial intelligence & popular music: SKYGGE, flow machines, and the audio uncanny valley. Arts 8 (4):130. doi:10.3390/arts8040130.
   Web of Science ®Google Scholar
• Battina, D. S. 2018. The future of artificial intelligence at work: A review on effects of decision automation and augmentation on workers targeted by algorithms and third-party observers. International Journal of Innovations in Engineering Research and Technology 5 (7): 40–47.
   Google Scholar
• Bettoni, A., E. Montini, M. Righi, V. Villani, R. Tsvetanov, S. Borgia, and C. Secchi, E. Carpanzano. 2020. Mutualistic and adaptive human-machine collaboration based on machine learning in an injection moulding manufacturing line. Procedia CIRP 93:395–400. doi:10.1016/j.procir.2020.04.119.
   Google Scholar
• Billman, D., G. Convertino, J. Shrager, P. Pirolli, and J. Massar. 2006. Collaborative intelligence analysis with CACHE and its effects on information gathering and cognitive bias. Paper presented at the Human Computer Interaction Consortium Workshop: Fraser, Colorado, USA.
   Google Scholar
• Birhane, A., P. Kalluri, D. Card, W. Agnew, R. Dotan, and M. Bao. 2022. The values encoded in machine learning research. Paper presented at the Proceedings of the 2022 ACM Conference on Fairness, Accountability, and Transparency, Seoul, Republic of Korea. doi:10.1145/3531146.3533083.
   Google Scholar
• Brynjolfsson, E., D. Li, and L. R. Raymond. 2023. Generative AI at work. National Bureau of Economic Research Working Paper Series 31161: 1–65.
   Google Scholar
• Cabitza, F., A. Campagner, and C. Simone. 2021. The need to move away from agential-AI: Empirical investigations, useful concepts and open issues. International Journal of Human-Computer Studies 155 (C):11. doi:10.1016/j.ijhcs.2021.102696.
   Google Scholar
• Cesta, A., A. Orlandini, and A. Umbrico (2018, May 16–18). Fostering robust human-robot collaboration through AI task planning. Paper presented at the 51st CIRP Conference on Manufacturing Systems (CIRP CMS), Stockholm, SWEDEN.
   Google Scholar
• Cienki, A. 2015. Insights into coordination, collaboration, and cooperation from the behavioral and cognitive sciences: A commentary. Interaction Studies 16 (3):553–60. doi:10.1075/is.16.3.09cie.
   Web of Science ®Google Scholar
• Coenen, A., L. Davis, D. Ippolito, E. Reif, and A. Yuan. 2021. Wordcraft: A human-AI collaborative editor for story writing, Ithaca: Cornell University Library. arXiv.org.
   Google Scholar
• Daugherty, P. R., and H. J. Wilson. 2018. Human + machine: Reimagining work in the age of AI. Brighton, USA: Harvard Business Review Press.
   Google Scholar
• Dell’acqua, F., E. McFowland, E. R. Mollick, H. Lifshitz-Assaf, K. Kellogg, S. Rajendran, and K. R. Lakhani (2023). Navigating the jagged technological frontier: Field experimental evidence of the effects of AI on knowledge worker productivity and quality Harvard business school technology & operations Mgt. Unit Working Paper No. 24-013. doi:10.2139/ssrn.4573321
   Google Scholar
• Dellermann, D., A. Calma, N. Lipusch, T. Weber, S. Weigel, and P. Ebel. 2019. The future of human-AI collaboration: A taxonomy of design knowledge for hybrid intelligence systems. Proceedings of the Annual Hawaii International Conference on System Sciences, Vol. 2019, p.274–283, Hawaii, USA.
   Google Scholar
• De Luca, G. 2021. The development of machine intelligence in a computational universe. Technology in Society 65:101553. doi:10.1016/j.techsoc.2021.101553.
   Web of Science ®Google Scholar
• De, M., L. Nul, A. Petridis, and European Commission, Directorate-General for Research Innovation, Breque. 2021. Industry 5.0: Towards a sustainable, human-centric and resilient European industry. Brussels, Belgium: Publications Office.
   Google Scholar
• Diao, J. A., R. J. Chen, and J. C. Kvedar. 2021. Efficient cellular annotation of histopathology slides with real-time AI augmentation. NPJ Digital Medicine 4 (1). doi:10.1038/s41746-021-00534-0.
   Web of Science ®Google Scholar
• Dimitropoulos, N., T. Togias, G. Michalos, and S. Makris. 2020. Operator support in human–robot collaborative environments using AI enhanced wearable devices. Procedia CIRP 97:464–69. doi:10.1016/j.procir.2020.07.006.
   Google Scholar
• Dimitropoulos, N., T. Togias, N. Zacharaki, G. Michalos, and S. Makris. 2021. Seamless human–robot collaborative assembly using artificial intelligence and wearable devices. Applied Sciences 11 (12):5699. doi:10.3390/app11125699.
   Google Scholar
• Dubey, A., K. Abhinav, S. Jain, V. Arora, and A. Puttaveerana. 2020. HACO: A framework for developing human-AI teaming. ACM International Conference Proceeding Series, 2020, Article 3385044, Jabalpur, India, doi:10.1145/3385032.3385044.
   Google Scholar
• Epstein, S. L. 2015. Wanted: Collaborative intelligence. Artificial Intelligence 221:36–45. doi:10.1016/j.artint.2014.12.006.
   Web of Science ®Google Scholar
• Feldman, S. 2017. Co-creation: Human and AI collaboration in creative expression. Paper presented at the Proceedings of the conference on Electronic Visualisation and the Arts, London, United Kingdom. doi:10.14236/ewic/EVA2017.84.
   Google Scholar
• Festo. 2018. Bionicworkplace: Human-robot collaboration with artificial intelligence. Paper presented at the Proceedings of 2018 International Conference on Hydraulics and Pneumatics, Romania.
   Google Scholar
• Gao, X., L. Yan, G. Wang, and C. Gerada. 2021. Hybrid recurrent neural network architecture-based intention recognition for human-robot collaboration. IEEE Transactions on Cybernetics, 1–9. doi:10.1109/TCYB.2021.3106543.
   Google Scholar
• Goldberg, S., S. Belyaev, and V. Sluchak. 2021. Dr. Watson type artificial intellect (AI) systems, Ithaca: Cornell University Library. arXiv.org.
   Google Scholar
• Goldfarb, A., and J. Lindsay. 2020. Artificial Intelligence in War: Human Judgment As an Organizational Strength and a Strategic Liability. Washington D.C., USA: https://www.brookings.edu/wp-content/uploads/2020/11/fp_20201130_artificial_intelligence_in_war.pdf.
   Google Scholar
• Hackman, J. R., and G. R. Oldham. 1975. Development of the job diagnostic survey. Journal of Applied Psychology 60 (2):159–70. doi:10.1037/h0076546.
   Web of Science ®Google Scholar
• Hart, S. N., N. G. Hoffman, P. Gershkovich, C. Christenson, D. S. McClintock, L. J. Miller, and R. Jackups, V. Azimi, N. Spies, V. Brodsky. 2023. Organizational preparedness for the use of large language models in pathology informatics. Journal of Pathology Informatics 14:100338. doi:10.1016/j.jpi.2023.100338.
   PubMedGoogle Scholar
• Irons, J., C. Mason, P. Cooper, S. Sidra, A. Reeson, and C. Paris. 2023. Exploring the impacts of ChatGPT on future scientific work. doi:10.31235/osf.io/j2u9x.
   Google Scholar
• Jarrahi, M. H. 2018. Artificial intelligence and the future of work: Human-AI symbiosis in organizational decision making. Business Horizons 61 (4):577–86. doi:10.1016/j.bushor.2018.03.007.
   Web of Science ®Google Scholar
• Johnson, M., J. M. Bradshaw, P. J. Feltovich, C. M. Jonker, M. B. V. Riemsdijk, and M. Sierhuis. 2014. Coactive design: designing support for interdependence in joint activity. Journal of Human-Robot Interaction 3 (1):43–69. doi:10.5898/JHRI.3.1.Johnson.
   Google Scholar
• Kärcher, N., M. Moerdijk, S. Schrof, C. Trapp, M. Purucker, M. Baltes, and R. Neumann. 2017. BionicCobot: Sensitive Helper for Human-Robot Collaboration. Germany: https://www.festo.com/PDF_Flip/corp/Festo_BionicCobot/en/files/assets/common/downloads/Festo_BionicCobot_en.pdf.
   Google Scholar
• Kasparov, G. 2010. The Chess Master and the Computer. USA: https://www.nybooks.com/articles/2010/02/11/the-chess-master-and-the-computer/.
   Google Scholar
• Kolbeinsson, A., E. Lagerstedt, and J. Lindblom. 2019. Foundation for a classification of collaboration levels for human-robot cooperation in manufacturing. Production and Manufacturing Research 7 (1):448–71. doi:10.1080/21693277.2019.1645628.
   Web of Science ®Google Scholar
• Langer, M., and R. N. Landers. 2021. The future of artificial intelligence at work: A review on effects of decision automation and augmentation on workers targeted by algorithms and third-party observers. Computers in Human Behavior 123:106878. doi:10.1016/j.chb.2021.106878.
   Web of Science ®Google Scholar
• Liberati, A., D. G. Altman, J. Tetzlaff, C. Mulrow, P. C. Gøtzsche, J. P. A. Ioannidis, and M. Clarke, P. J. Devereaux, J. Kleijnen, D. Moher. 2009. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate healthcare interventions: Explanation and elaboration. BMJ 339 (jul21):b2700. doi:10.1136/bmj.b2700.
   PubMedGoogle Scholar
• Lin, Y. Y., J. H. Guo, Y. Chen, C. Yao, F. T. Ying, and Acm. 2020. It is your turn: Collaborative ideation with a Co-creative robot through sketch. Paper presented at the CHI Conference on Human Factors in Computing Systems (CHI), Electr Network. Honolulu, HI, USA, Apr 25-30.
   Google Scholar
• Maddikunta, P. K. R., Q.-V. Pham, N. Deepa, K. Gadekallu, T. R. Dev, and M. Liyanage, R. Ruby, M. Liyanage. 2022. Industry 5.0: A survey on enabling technologies and potential applications. Journal of Industrial Information Integration 26:100257. doi:10.1016/j.jii.2021.100257.
   Web of Science ®Google Scholar
• Madni, A. M., and C. C. Madni. 2018. Architectural framework for exploring adaptive human-machine teaming options in simulated dynamic environments. Systems 6 (4):44. doi:10.3390/systems6040044.
   Web of Science ®Google Scholar
• Mason, C. M., M. Ayre, and S. M. Burns. 2022. Implementing industry 4.0 in Australia: Insights from advanced Australian manufacturers. Journal of Open Innovation: Technology, Market, and Complexity 8 (1):53. doi:10.3390/joitmc8010053.
   Google Scholar
• McDermott, P. N. A. I. N., C. Dominguez, N. Kasdaglis, M. Ryan, I. Trahan, and A. Nelson. 2018. Human-Machine Teaming Systems Engineering Guide. USA: https://apps.dtic.mil/sti/pdfs/AD1108020.pdf.
   Google Scholar
• Nahavandi, S. 2019. Industry 5.0—A human-centric solution. Sustainability 11 (16):4371. doi:10.3390/su11164371.
   Web of Science ®Google Scholar
• Noy, S., and W. Zhang. 2023. Experimental evidence on the productivity effects of generative artificial intelligence. doi:10.2139/ssrn.4375283.
   Google Scholar
• O’Brien, M. 2017. Nightmare Machine Writes Bone-Chilling Tales. Halifax, N.S: 08281807). https://www.proquest.com/docview/1958636667?accountid=26957.
   Google Scholar
• Oh, C., J. Song, J. Choi, S. Kim, S. Lee, and B. Suh. 2018. I lead, you help but only with enough details: Understanding user experience of Co-creation with artificial intelligence. Paper presented at the Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems, Montreal QC, Canada. doi:10.1145/3173574.3174223
   Google Scholar
• Ostheimer, J., S. Chowdhury, and S. Iqbal. 2021. An alliance of humans and machines for machine learning: Hybrid intelligent systems and their design principles. Technology in Society 66:101647. doi:10.1016/j.techsoc.2021.101647.
   Web of Science ®Google Scholar
• Pachet, F., P. Roy, and B. Carré. 2021. Assisted music creation with flow machines: Towards new categories of new. In Handbook of artificial intelligence for music: Foundations, advanced approaches, and developments for creativity, ed. E. R. Miranda, 485–520. Cham: Springer International Publishing.
   Google Scholar
• Parker, S. K., and G. Grote. (n/a). Automation, algorithms, and beyond: Why work design matters more than ever in a digital world. Applied Psychology. doi:10.1111/apps.12241.
   Web of Science ®Google Scholar
• Poser, M., and E. A. Bittner (2020). Hybrid teamwork: Consideration of teamwork concepts to reach naturalistic interaction between Humans and conversational agents. Paper presented at the Wirtschaftsinformatik (Zentrale Tracks).
   Google Scholar
• Rachatasumrit, N., G. Ramos, J. Suh, R. Ng, and C. Meek. 2021. ForSense: Accelerating online research through sensemaking integration and machine research support. International Conference on Intelligent User Interfaces, Proceedings IUI, 2021, p.608-618, College Station, TX, USA.
   Google Scholar
• Saffiotti, A., P. Fogel, P. Knudsen, L. de Miranda, and O. Thörn. 2020. On human-AI collaboration in artistic performance. CEUR Workshop Proceedings, Vol.2659, p.38-43, 17-20 June 2020, St. Petersburg, Russia.
   Google Scholar
• Sartori, L., and A. Theodorou. 2022. A sociotechnical perspective for the future of AI: Narratives, inequalities, and human control. Ethics and Information Technology 24 (1):4. doi:10.1007/s10676-022-09624-3.
   Web of Science ®Google Scholar
• Schuh, G., R. Anderl, R. Dumitrescu, A. Krüger, and M. T. Hompel. 2020. Industrie 4.0 Maturity Index: Managing the Digital Transformation of Companies – Update 2020. Germany: https://en.acatech.de/publication/industrie-4-0-maturity-index-update-2020/.
   Google Scholar
• Seeber, I., E. Bittner, R. O. Briggs, T. de Vreede, G.-J. de Vreede, A. Elkins, and M. Söllner, A. B. Merz, S. Oeste-Reiß, N. Randrup, G. Schwabe. 2020. Machines as teammates: A research agenda on AI in team collaboration. Information & Management 57 (2):103174. doi:10.1016/j.im.2019.103174.
   Web of Science ®Google Scholar
• Shneiderman, B. 2020. Human-centered artificial intelligence: Three fresh ideas. AIS Transactions on Human-Computer Interaction 12 (3):109–24. doi:10.17705/1thci.00131.
   Google Scholar
• Shook, E., and M. Knickrehm. 2018. Reworking the Revolution. https://www.accenture.com/_acnmedia/pdf-69/accenture-reworking-the-revolution-jan-2018-pov.pdf.
   Google Scholar
• Sindhwani, R., S. Afridi, A. Kumar, A. Banaitis, S. Luthra, and P. L. Singh. 2022. Can industry 5.0 revolutionize the wave of resilience and social value creation? A multi-criteria framework to analyze enablers. Technology in Society 68:101887. doi:10.1016/j.techsoc.2022.101887.
   Web of Science ®Google Scholar
• Stowers, K., L. L. Brady, C. MacLellan, R. Wohleber, and E. Salas. 2021. Improving teamwork competencies in human-machine teams: Perspectives from team science. Frontiers in Psychology 12:12. doi:10.3389/fpsyg.2021.590290.
   Web of Science ®Google Scholar
• Szász, L., K. Demeter, B.-G. Rácz, and D. Losonci. 2021. Industry 4.0: A review and analysis of contingency and performance effects. Journal of Manufacturing Technology Management 32 (3):667–94. doi:10.1108/JMTM-10-2019-0371.
   Web of Science ®Google Scholar
• Thompson, C. 2013. Smarter than you think: How technology is changing our minds for the better. East Rutherford: Penguin Publishing Group.
   Google Scholar
• Thörn, O., P. Knudsen, and A. Saffiotti (2020, 31 Aug). Human-robot artistic Co-creation: A study in improvised robot dance. Paper presented at the 2020 29th IEEE International Conference on Robot and Human Interactive Communication (RO-MAN), Naples, Italy.
   Google Scholar
• Traumer, F., S. Oeste-Reiß, and J. M. Leimeister. 2017. Towards a future Reallocation of Work between Humans and machines – taxonomy of tasks and interaction types in the context of machine learning. Paper presented at the Thirty Eighth International Conference on Information Systems, South Korea.
   Google Scholar
• Urban Davis, J., F. Anderson, M. Stroetzel, T. Grossman, and G. Fitzmaurice. 2021. Designing Co-creative AI for virtual environments. In Creativity and Cognition (C&C ’21), June 22, 23, 2021, Virtual Event, Italy. doi:10.1145/3450741.3465260.
   Google Scholar
• van der Wal, D., I. Jhun, I. Laklouk, J. Nirschl, L. Richer, R. Rojansky, and A. Esteva, J. Wheeler, J. Sander, F. Feng, O. Mohamad. 2021. Biological data annotation via a human-augmenting AI-based labeling system. NPJ Digital Medicine 4 (1):145. doi:10.1038/s41746-021-00520-6.
   PubMed Web of Science ®Google Scholar
• Veile, J. W., D. Kiel, J. M. Müller, and K.-I. Voigt. 2020. Lessons learned from industry 4.0 implementation in the German manufacturing industry. Journal of Manufacturing Technology Management 31 (5):977–97. doi:10.1108/JMTM-08-2018-0270.
   Web of Science ®Google Scholar
• Wang, D., E. Churchill, P. Maes, X. Fan, B. Shneiderman, Y. Shi, and Q. Wang. 2020. From human-human collaboration to human-AI collaboration: Designing AI systems that can work together with people. Paper presented at the Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems, Honolulu, HI, USA. doi:10.1145/3334480.3381069.
   Google Scholar
• Wolf, F. D., and R. M. Stock-Homburg. 2023. How and when can robots be team members? Three decades of research on human–robot teams. Group & Organization Management 48 (6):1666–1744. doi:10.1177/10596011221076636.
   Web of Science ®Google Scholar
• Yanardag, P., M. Cebrian, and I. Rahwan. 2021. Shelley: A crowd-sourced collaborative horror Writer. In Proceedings of the 13th Conference on Creativity and Cognition (C&C ‘21). Association for Computing Machinery, New York, NY, USA, Article 11, 1–8. doi:10.1145/3450741.3465251.
   Google Scholar
• Zhang, C., C. Yao, J. Liu, Z. Zhou, W. Zhang, L. Liu, F. Ying, Y. Zhao, and G. Wang. 2021. StoryDrawer: A Co-creative agent supporting children’s storytelling through collaborative drawing. Conference on Human Factors in Computing Systems - Proceedings. CHI ‘21: CHI Conference on Human Factors in Computing Systems Yokohama Japan. doi:10.1145/3411763.3451785.
   Google Scholar