Blaming Screen Readers đźš©Ă—5

The title of this post is pretty specific. It relates to the meme on Twitter where users identify a trait or preference that they see as problematic, and identify it as a red flag. The emoji represents the red flag. For example: 

<g>
  <path class="wh" d="m93.3 105.3-1-.2c-.6-.3-1.1-.8-1.3-1.4L56.7 11.5c-.5-1.3.2-2.7 1.4-3.2l4.3-1.6.9-.2 1 .2c.7.3 1.2.8 1.4 1.4l34.2 92.1c.5 1.3-.2 2.7-1.4 3.2l-4.3 1.6-.9.3z"></path>
  <path class="wh" d="m39.3 53-.6-.1c-.8-.2-1.4-.8-1.7-1.5-4.3-10.9-8.3-21.9-12.2-32.6-.2-.5-.2-1.1 0-1.7 2.1-6.3 7.3-9.3 15.6-9.3 4 0 8.2.6 12.3 1.3l5.4.8c.9.1 1.7.7 2.1 1.6L73 46.4c.3.8.2 1.6-.3 2.3-.5.7-1.2 1.1-2 1.1h-2.1c-2.7 0-5.4-.1-8-.3l-7-.2c-6.2 0-10 .9-12.5 3.1-.6.4-1.2.6-1.8.6z"></path>
  <path class="wh" d="M46.9 57.9h-.5l-8.2-1.6c-.9-.2-1.7-.9-1.9-1.8-.2-.9.1-1.9.8-2.5l1.9-1.6a10 10 0 0 1 5.1-2.6h.5c1 0 1.9.6 2.3 1.5l2.3 5.3c.4.9.2 1.8-.3 2.6-.5.4-1.2.7-2 .7z"></path>
  <path class="wh" d="M22.6 67.1c-3.9 0-7.9-.5-11.8-1.4-.7-.2-1.3-.6-1.6-1.2-.3-.6-.4-1.4-.2-2l3.5-9.7 3-8.3C10.6 39 5.6 33.4.7 28.2c-.6-.7-.9-1.7-.5-2.6s1.1-1.5 2.1-1.6L27 21h.3c1 0 2 .7 2.4 1.7L34 34.3c2 5.3 4 10.7 5.9 16.3l1 2.2.2.8 7.6 1.7c1 .2 1.8 1 1.9 2.1.2 1-.3 2-1.2 2.5a55.9 55.9 0 0 1-26.8 7.2zm35.8-55.6a2 2 0 0 1-1.1-.3 6.1 6.1 0 0 1-2.9-3.4c-.6-1.5-.5-3.2.3-4.6A5.5 5.5 0 0 1 58 .7c.7-.2 1.3-.4 2-.4 2.4 0 4.4 1.4 5.3 3.5l.2.9c0 1.1 0 2.1-.5 3.4-.2.7-.8 1.3-1.5 1.5l-4.3 1.6c-.2.3-.5.3-.8.3z"></path>
  <path class="bl" d="m63.4 9 34.2 92.1-4.3 1.7-34.2-92.1z"></path>
  <path class="rd" d="M70.6 47.2c-12.2.3-24.3-2.6-31.2 3.3-4.3-10.9-8.2-21.7-12.2-32.6 3.9-11.5 19.4-6.9 30.6-5.6l12.8 34.9zm-31.9 6.6 2-1.6a8 8 0 0 1 3.9-2l2.3 5.3-8.2-1.7z"></path>
  <path class="rd" d="m37.4 51.5 1 2.3v.3l.7 1.6 8.9 2a50.2 50.2 0 0 1-36.5 5.6l6.9-19.4C13 38 7.8 32 2.5 26.5l24.7-3c3.3 9.2 6.9 18.4 10.2 28z"></path>
  <path class="bl" d="M63 4.7c0 1 0 1.6-.3 2.6L58.4 9a3 3 0 0 1-1.6-2c-.7-1.6.3-3.6 2-3.9 1.6-.7 3.6 0 4.2 1.6z"></path>
</g>

Blaming Screen Readers đźš©đźš©đźš©đźš©đźš©

And here we see the usual pattern repeat itself. An inaccessible meme goes viral. After it is so tired that brands use it, someone relying on assistive technology points out how annoying this can be. Authors and developers jump up to blame assistive technology for being terrible at internetting.

In the last few days I have seen more than a few people on Twitter blame screen readers for not being evergreen like browsers, for not understanding the context, for not returning just a count of emoji, and so on. I have even seen people post code snippets on how they could fix screen readers.

Screen Readers Are Not…

…to blame for your inaccessible content.

Screen Readers Are Not Browsers

To address one false assumption, screen readers do not read pages. Not exactly. Screen readers announce what information the web browser hands them. Screen readers will add instructions for operating things, but even that is based on how the browser reports it. In the context of the web, barring heuristics and bugs, the browser is in charge.

This means that all those bits of content, navigation, the states of controls, the count of how many items are in a list, cues for form field errors, and so on, are themselves built on what the developers write. The HTML.

I am leaving out a bunch of technical detail about accessibility APIs, the DOM, the virtual DOM, heuristics, and so on. I just want to impress upon you that browsers are what screen readers announce.

Screen Readers Do Not Use Natural Language Processing

Another false assumption is that screen readers understand the human content they are reading. They do not. Mostly. Screen reader heuristics will look at some strings of characters and announce them differently than what you may see (1st as first). But even that varies across screen readers and browsers.

I have a long history trying to stop developers from overriding how screen readers announce things when it is not what they expect.

A screen reader does not know the context of what you wrote, the implications of what it contains, or even what you wanted to convey. It just reads words aloud the best it can, adding inflection based on punctuation and maybe some other cues.

Screen Readers Do Not See What You See

But here is a curve ball — the red flag emoji isn’t a red flag. It is a triangular flag on post.

Blaming Screen Readers triangular flag on post triangular flag on post triangular flag on post triangular flag on post triangular flag on post

That is not the fault of screen readers. That is the risk of using emoji to convey meanings that are not part of the Unicode standard for the character. It is a fluke that they appear red. Platforms could make them yellow, or green, or striped, and so on.

The author intent is completely dependent on the arbitrary color in the emoji. Without it, the meaning you wanted to convey is completely lost.

Screen Readers Do Not Update Overnight

Screen readers are software with release cycles. They add features, fix bugs, and have to contend with browsers that change every six weeks, all at whatever pace they can muster.

Some are tied into the operating system, like VoiceOver, and historically only update with the operating system. Just because Apple is a trillion dollar company does not mean it will move any faster or even get it right. NVDA may be able to pivot more quickly, but it is open source and its release cycle reflects its revenue stream. JAWS has a public bug tracker, and you can see it has a lot sitting out there, more important than memes.

Never mind that the half-life of a typical meme is measured in days. Some are done and gone before the screen reader engineers have been able to get their VMs fired up to do regression testing.

Screen Readers Are Not Free

As in beer. There is a cost to being able to run a screen reader, particularly the latest release.

The disabled community is historically under-employed. This means older hardware, older software, less frequent access to tech support, to updates, and so on. The latest screen reader may require the latest browser. It may require the latest hardware (when built into the operating system). It may require more time and effort to even update than its users reasonably have.

Let’s not forget the opportunity cost. First think about everyone in your family who is not comfortable with technology. Now apply that same ratio to the disabled community. Now consider that if something goes wrong in their upgrade, that the tool that may be their lifeline is suddenly broken, and they cannot fix it. Now imagine the existential risk involved in upgrading to read a meme.

Screen Readers Are Not Stagnant

We have seen screen readers update to account for memes already. TalkBack used to ignore all the special characters used to mimic bold and italic text in tweets. Now it treats them as if they were regular ASCII letters.

The trade-off is that for users who had a genuine purpose to use those characters, whether for math or science, those characters are now lost to them.

I have also been told (sadly, it is anecdata and I have no specific example to show) that VoiceOver will ignore runs of emoji altogether. Which could be a problem if those emoji have meaning to convey, especially if the sender and receiver previously relied on them being announced.

How Should a Screen Reader Handle…

…the red flag meme? Some people suggested round them all up and give a count.

Although, Twitter could step in here too. We already know Twitter does some emoji processing on the fly, and it has a dedicated accessibility team. As the venue for the meme, it is in the best place to consider how (or if) it should concatenate those repetitive emoji.

How do you propose it handle some of the other memes that have been popular? That rely on spacing and position? That mix words and letters with symbols and emoji?

That Text Intersecting Year Thing

As captured in VoiceOver for macOS using Safari. I wrote the captions instead of relying on the speech viewer.

Clapping Hands

TalkBack 9.1 on Android 11 with Chrome 91. First using Read from next item (which announces every image but does not announce its emoji alt text), then reading the entire tweet as a block, and then reading the tweet as a block after Twitter’s script has updated it with the plain language alternative text on the emoji images.

Sheriff

Captured in Firefox 93 with NVDA 2021.2. Announced just from putting focus on the page. Had I done a read-all command, each emoji would have been announced as clickable. Try it yourself.

Sign Bunny

Captured in Chrome 94 with JAWS 2021. Notice how it fails to announce the majority of characters. You can test it in your favorite combination.

Building Jump

Captured in Edge 94 with Narrator (Windows 10). The only part of this meme it announced was the word and preceding slash.

Peeking

As heard using VoiceOver on iOS 14.8 with Safari 14. I did not investigate why it switches languages on the second read (starting at 1:25), but you can try it with the original tweet and see what you get.

Wrap-up

The better, more immediate, solution is to be more thoughtful in how you post your content (memes). Be considerate of others, even if it takes an extra minute. Stop offloading blame. Stop making it someone else’s problem.

Screen readers happen to be the focus of this post, but everything holds true for other disabilities and other assistive technologies. Videos without captions, blinking and flashing imagery, unnecessary animations, loud noises, terrible audio, CAPTCHAs, and so on.

Techniques to make your content accessible abound. They are no more than a quick search away should you care to try. Once a user (a fellow human) has raised a problem, you would have to actively work to ignore it. Which might make you kind of a jerk.

Also, while you are thinking of other people, wear a mask and get vaccinated.