Objective and Subjective Methods for Evaluating the Usability of Schematic Maps: The Case Against Informal Expert Assessments

References

• Andre, A.D. and Wickens, C.D. (1995) “When Users Want What’s Not Best for Them” Ergonomics in Design 3 10–14.
   Google Scholar
• Boston Globe (2013) “MBTA Map-Making Contest Garners 17,000 Votes.” https://www.bostonglobe.com/metro/2013/09/21/map-making-contest-garners-votes/egeCO7 ( 7Q8rbfciGVHaSyI/story.html (Accessed: 12th June 2023).
   Google Scholar
• Chabris, C. and Simons, D. (2010) The Invisible Gorilla New York: Crown Publishing.
   Google Scholar
• Chi, M.T.H., Feltovich, P.J. and Glaser, R. (1981) “Categorization and Representation of Physics Problems by Experts and Novices” Cognitive Science 5 pp. 121–152.
   Web of Science ®Google Scholar
• Chivers, D. and Rodgers, P. (2015) “Improving Search-Based Schematic Layout by Parameter Manipulation” International Journal of Software Engineering and Knowledge Engineering 25 pp. 961–991.
   Web of Science ®Google Scholar
• Daily Mail (2009) “Boris Johnson Puts Thames Back on London Underground Map After Outrage Over Redesign.” https://www.dailymail.co.uk/news/article-1213932/Boris-Johnson-puts-Thames-London-Underground-map-outrage-redesign.html (Accessed: 12th June 2023).
   Google Scholar
• Dow, A. (2005) Telling the Passenger Where To Get Off London: Capital Transport Publishing.
   Google Scholar
• Field, K. and Cartwright, W. (2014) “Becksploitation: The Over-use of a Cartographic Icon” The Cartographic Journal 51 pp. 343–359.
   Web of Science ®Google Scholar
• Gallotti, R., Porter, M.A. and Barthelemy, M. (2016) “Lost in Transportation: Information Measures and Cognitive Limits in Multilayer Navigation” Science Advances 2 e1500445.
   PubMed Web of Science ®Google Scholar
• Garland, K. (1994) Mr Beck’s Underground Map London: Capital Transport Publishing.
   Google Scholar
• Gelman, S.A. and Legare, C.H. (2011) “Concepts and Folk Theories” Annual Review of Anthropology 40 pp. 379–388.
   PubMed Web of Science ®Google Scholar
• Griffin, A.L., White, T., Fish, C., Tomio, B., Huang, H., Sluter, C.R., Bravo, J.V.M., Fabrikant, S.I., Bleisch, S., Yamada, M. and Picanço, P. (2017) “Designing Across Map Use Contexts: A Research Agenda” International Journal of Cartography 3 (sup. 1) pp.90–114.
   Google Scholar
• Guo, Z. (2011) “Mind the Map! The Impact of Transit Maps on Travel Decisions in Public Transit” Transportation Research Part A 45 pp. 625–639.
   Google Scholar
• Hegarty, M. (2013) “Cognition, Metacognition, and the Design of Maps” Current Directions in Psychological Science 22 pp. 3–9.
   Web of Science ®Google Scholar
• Hegarty, M., Smallman, H.S., and Stull, A.T. (2012) “Choosing and Using Geospatial Displays: Effects of Design on Performance and Metacognition” Journal of Experimental Psychology: Applied 18 pp.1–17.
   PubMed Web of Science ®Google Scholar
• Hegarty, M., Smallman, H.S. Stull, A.T. and Canham, M.S. (2009) “Naïve Cartography: How Intuitions About Display Configuration Can Hurt Performance” Cartographica 44 pp.171–186.
   Google Scholar
• Ishikawa, T., Fujiwara, H., Imai, O. and Okabe, A. (2008) “Wayfinding with a GPS-Based Mobile Navigation System: A Comparison with Maps and Direct Experience” Journal of Environmental Psychology 28 pp.74–82.
   Web of Science ®Google Scholar
• Kölnische Rundschau (2021) “KVB führt im Dezember den konzentrischen Netzplan ein” https://www.rundschau-online.de/koeln/jetzt-geht-es-rund-in-koeln-kvb-fuehrt-im-dezember-den-konzentrischen-netzplan-ein-290274 (Accessed: 12th June 2023).
   Google Scholar
• Kruger, J. and Dunning, D. (1999) “Unskilled and Unaware of It” Journal of Personality and Social Psychology 77 pp.1121–1134.
   PubMed Web of Science ®Google Scholar
• McCloskey, M. (1983) “Intuitive Physics” Scientific American 248 pp.122–130.
   Web of Science ®Google Scholar
• Mijksenaar, P. and Vroman, R. (1983) “London Transport Map: A Delft Project” Typos 6 pp.36–40.
   Google Scholar
• Newton, E.J. and Roberts, M.J. (2018) “Concentric Circles Maps: Data and Implications” Diagrams 2018: 10th International Conference, Edinburgh, 18th to 22nd June http://www.tubemapcentral.com/writing/academicfiles/Newton_Roberts_Diagrams2018_2018.pdf (Accessed 12th June 2023).
   Google Scholar
• Nöllenburg, M. (2014) A Survey on Automated Metro Map Layout Methods. Schematic Mapping Workshop 2014, University of Essex, 2nd to 3rd April. https://www.researchgate.net/publication/281587114_A_survey_on_automated_metro_map_layout_methods (Accessed 12th June 2023).
   Google Scholar
• Nöllenburg, M. and Wolff, A. (2011) “Drawing and Labeling High-Quality Metro Maps by Mixed-Integer Programming” IEEE Transactions on Visualization and Computer Graphics 17 pp.626–641.
   PubMed Web of Science ®Google Scholar
• Ovenden, M. (2003) Metro Maps of the World London: Capital Transport Publishing.
   Google Scholar
• Ovenden, M. (2005) Metro Maps of the World (2nd ed.) London: Capital Transport Publishing.
   Google Scholar
• Ovenden, M. (2009) Paris Underground: The Maps, Stations, and Design of the Métro New York: Penguin Books.
   Google Scholar
• Ovenden, M. (2015) Transit Maps of the World (2nd ed.) New York: Penguin Books.
   Google Scholar
• Roberts, M.J. (2005) Underground Maps After Beck London: Capital Transport Publishing.
   Google Scholar
• Roberts, M.J. (2012) Underground Maps Unravelled, Explorations in Information Design Wivenhoe, Essex: Author.
   Google Scholar
• Roberts, M.J. (2014) “Schematic Maps in the Laboratory” Schematic Mapping Workshop 2014, University of Essex, 2nd to 3rd April http://www.tubemapcentral.com/writing/academicfiles/Roberts_empirical_SMW2014_2014.pdf [accessed 12/06/2023].
   Google Scholar
• Roberts, M.J. (2019a) “The Decade of Diagrams” Schematic Mapping Workshop 2019, TU Wien, 11th to 12th April http://www.tubemapcentral.com/writing/academicfiles/Roberts_diagramsdecade_SMW2019_2019.pdf (Accessed 12th June 2023).
   Google Scholar
• Roberts, M.J. (2019b) Tube Map Travels London: Capital Transport Publishing.
   Google Scholar
• Roberts, M.J. (2019c) “Us Versus Them: Ensuring Practical and Psychological Utility of Measurements of Schematic Map Usability” Schematic Mapping Workshop 2019, TU Wien, 11th to 12th April http://www.tubemapcentral.com/writing/academicfiles/Roberts_usabilitygap_SMW2019_2019.pdf (Accessed: 12th June 2023).
   Google Scholar
• Roberts, M.J., Gray, H. and Lesnik, J. (2017) “Preference Versus Performance: Investigating the Dissociation Between Objective Measures and Subjective Ratings of Usability for Schematic Metro Maps and Intuitive Theories of Design” International Journal of Human Computer Studies 98 pp.109–128.
   Web of Science ®Google Scholar
• Roberts, M.J., Newton, E.J. and Canals, M. (2016) “Radi(c)al Departures: Comparing Conventional Octolinear Versus Concentric Circles Schematic Maps for the Berlin U-Bahn/S-Bahn Networks Using Objective and Subjective Measures of Effectiveness” Information Design Journal 22 pp.92–115.
   Google Scholar
• Roberts, M.J., Newton, E.J., Lagattolla, F.D., Hughes, S. and Hasler, M.C. (2013) “Objective Versus Subjective Measures of Paris Metro Map Usability: Investigating Traditional Octolinear Versus all-Curves Schematic Maps” International Journal of Human Computer Studies 71 pp.363–386.
   Web of Science ®Google Scholar
• Roberts, M.J. and Rose, D. (2016) “Map-Induced Journey-planning Biases for a Simple Network: A Docklands Light Railway Study” Transportation Research A 94 pp.446–460.
   Google Scholar
• Roberts, M.J. and Vaeng, I.C.N. (2016) “Expectations and Prejudices Usurp Judgements of Schematic Map Effectiveness” In: Lloyd, P. and Bohemia, E. (Eds) Proceedings of DRS2016: Design + Research + Society – Future-Focused Thinking 8 pp. 2343-2359 DOI:10.21606/drs.2016.123.
   Google Scholar
• Stott, J.M., Rodgers, P.J., Martinez-Ovando, J.C. and Walker, S.G. (2011) “Automatic Metro Map Layout Using Multicriteria Optimization” IEEE Transactions on Visualization and Computer Graphics 17 pp.101–114.
   PubMed Web of Science ®Google Scholar
• Willis, K.S., Hölscher, C., Wilbertz, G. and Li, C. (2009) “A Comparison of Spatial Knowledge Acquisition with Maps and Mobile Maps” Computers, Environment and Urban Systems 33 pp.100–110.
   Web of Science ®Google Scholar
• Wolff, A. (2007) “Drawing Subway Maps: A Survey” Informatik 22 pp.23–44.
   Google Scholar
• Wu, H.-Y., Niedermann, B., Takahashi, S., Roberts, M.J. and Nöllenburg, M. (2020) “A Survey on Transit Map Layout – from Design, Machine, and Human Perspectives” Computer Graphics Forum (Proceedings of EuroVis 2020) 39 (3) pp.619–646.
   Google Scholar