The use of magnets for the nonvisual construction of syntax-based tangible object assemblies by individuals who are blind or visually impaired

ABSTRACT

Many students have difficulty in mastering syntax when programming. To alleviate this problem, the Scratch programming language was developed to have a visual block-based drag and drop code editor, where the shapes of the blocks and animation are used to make the syntax intuitive. To similarly make syntax intuitive to individuals who are blind or visually impaired (BVI) using tangible code blocks, a method needs to take into account perceptual processing differences between the senses and implementation differences between the physical and virtual world. The studies in this paper examined the effectiveness of using localized reciprocal shape information in combination with magnetic attraction for providing intuitive feedback about syntax. Supplementing the use of localized reciprocal shape constraints with magnetic attraction increased the accuracy and perceived ease of use by blindfolded BVI users to detect whether blocks successfully connected and, therefore, represented a code segment with valid syntax. This did not appear to change significantly with changes in the size and weight of the blocks, although stronger magnetic connections appeared preferred. We also introduced a “stopper” design to allow for code blocks to have exceptions to the regular syntax rules, while not adding complexity to the majority of code blocks.

KEYWORDS:

• accessibility
• blind
• haptic
• programming
• tangibles
• visually impaired

Disclosure statement

No potential conflict of interest was reported by the author(s).

Additional information

Funding

This material is based upon work supported by the National Science Foundation under grant  [1742242].