Algospeak and algo-design in platformed book publishing: Revolutionary creative tactics in digital paratext to circumvent content moderation

Publication year
2023
Journal
AoIR Selected Papers of Internet Research
Volume
Paper presented at AoIR2023: The 24th Annual Conference of the Association of Internet Researchers. Philadelphia, PA, USA
Comment

Here's the abstract:

This paper examines the rise of algo-design in the context of platformed book publishing. Building on conceptualizations of algospeak, a strategy that involves creating code words or phrases to create a brand-safe lexicon, I theorize algo-design as a broader creative strategy used by online creators that involves using and avoiding specific language and visuals to evade content moderation by platforms. Specifically, this research explores the use of algo-design in the paratext of romance and erotica novels by authors of color and LGBTQIA authors who publish their fiction on digital publishing platforms, such as Amazon, and market them on social media platforms. I argue that, in many cases, algo-design is a revolutionary creative tactic for BIPOC and LGBTQIA authors of romance fiction, who are disproportionately affected by content
moderation systems (Monea, 2022) and often have their works flagged as adult material due to the genre’s tendency to include intimate relationships (Parnell, 2021). The use of algo-design by authors is a clear effort to push back against bluntly imposed content moderation interventions and subvert platform power.

---

Several authors reported being propelled to change language in their book titles and descriptions on Amazon in response to moderation outcomes. One author decided to change the title of her debut novel to remove the phrase One Night Stand after Facebook’s automatic detection software interpreted the original title as mature content and banned the book from being advertised on the platform. Another author stated that when she tried updating the product descriptions of her books, the word ‘erotica’ and the flame emoji were flagged by Amazon as keywords that violated community guidelines. Some authors reported that they will avoid tagging their work as ‘erotica’ on Amazon, even if it fits within this subgenre, because doing so often results in the book being removed from the site, prevented from being published in the first place, or algorithmically suppressed in the platform’s marketplace – a fate referred to by authors publishing and selling their books on Amazon as being relegated to “Amazon’s dungeon,” or “dungeoned.”
 

Other authors reported that terms relating to queer identities, including ‘queer’ and ‘bisexual’, were also flagged by Amazon’s content moderation system, providing further evidence that demonstrates platform restrictions of adult content particularly impact people from marginalized groups, including LGBTQIA+ people (especially queer people of color), gender nonconforming folks, and kink communities who often use digital networks for sexual self-expression, community and knowledge (Bronstein, 2020; Sundén et al., 2020). (2)

--- 

In one instance, the cover featured a black and white photo-style image of a Black woman bordered by a red, Christmas-themed background. The woman in the image has bare shoulders, but her torso and legs are covered by a white sheet. Despite the minimal nudity, Amazon’s automatic detection software prevented the book from being published, deeming that the cover contained adult materials. The author appealed the decision with Amazon’s author services and although the book was eventually published on Amazon, it has been suppressed from appearing in the search results, limiting its discoverability and sales potential. Other authors changed cover designs to avoid this technological suppression. (3)