Sensory substitution is the use of one sense (for example, the sense of hearing, or the sense of touch) to deliver information that is usually delivered using another sense (for example, the sense of vision). For instance, a picture, which we usually use vision to see, can be "seen" using sounds. The EyeMusic is one example of a sensory substitution device (SSD). It takes in a picture (e.g., from your Instagram account) and translates it into sound. A pixel that appears low on the picture is played by a low-pitched musical note. A high pixel is represented by a high-pitched musical note. Each color is played by a different musical instrument. It currently represents six colors: white (choir), blue (trumpet), red (Rapman's reed), green (reggae organ), yellow (strings), and black (represented by silence). This musical "image" is played column-by-column from left to right. So, an object on the left of the image would be heard before an object on the right. The resolution can be set to 40 pixels or 50 pixels.

License information: CC BY 4.0
MPAA: G
Go to source: https://kids.frontiersin.org/article/10.3389/frym.2013.00012