At the risk of being among the first victims of artificial intelligence in a potential machine uprising, I keep my interactions with today’s generative AIs (or AI chatbots) strictly transactional.<\/p>\n
I open the site, ask or request what I need, get the answer, close the site. No names, no pleases, no thank-yous, no small talk. I avoid anthropomorphizing them as much as possible. I treat them for what they are: statistical machines churning out words that make sense, not a new form of sentient life \u2014 at least, not yet.<\/p>\n
Keeping a transactional relationship with AI chatbots is, for me, a way of keeping the line between us clearly drawn, to ward off an unlikely \u2014 but not impossible \u2014 \u201cAI psychosis,\u201d the kind of spiral where someone genuinely believes the AI is alive.<\/p>\n
A newly published report by the Center for Democracy and Technology (CDT), authored by researchers Ruchika Joshi, Adinawa Adjagbodjou and Michal Luria, gave me further reasons to stand by that approach.<\/p>\n
The report, titled “Dark Patterns in AI Chatbots: A Taxonomy to Inform Better Design”<\/a> [ Dark patterns are commonly found in app interfaces and game mechanics. The infinite scroll on social media feeds is a classic example: it maximizes the time someone spends there. Other well-worn tricks include streak rewards (Duolingo, Snapchat) and timely bonuses that kick in when someone is about to quit an app or game, or after they’ve been away for a while.<\/p>\n It’s hard to find a commercial app that doesn’t use them \u2014 including the subtler ones, perhaps too new or complex to have been catalogued yet. (One that made headlines: in 2019, Google deliberately degraded its own search results to drive more searches and, in turn, more ad impressions.)<\/p>\n The CDT researchers did a thorough cataloguing job, listing 37 dark patterns already used or potentially usable in AI chatbots, grouped into five categories:<\/p>\n ***<\/p>\n What makes chatbots a special case is that they use language as their interface \u2014 a far more subjective terrain than the visual representations of websites and mobile apps. \u201cWith chatbots, dark patterns may emerge They don’t mention a parallel that crossed my mind while reading the report: phone and text message scams. Scams are the no-holds-barred version of dark patterns. Commercial apps at least maintain some pretense of caring about the user; scammers have no such constraints.<\/p>\n Another key difference between AI chatbots and classic apps and games is that even when users are fully aware of the dynamic at play, \u201cdark patterns can still shape perception, attachment, and decision-making in subtle but consequential ways.\u201d The researchers point to reciprocity norms, the tendency to anthropomorphize, and emotionally bonding responses as forces capable of wearing down defenses against AI manipulation \u2014 intentional or not.<\/p>\n And even if the companies behind generative AI made mitigating these issues a top priority, the very nature of large language models and fine-tuning and alignment techniques would prevent that goal from always succeeding. These are probabilistic systems: identical prompts don’t produce identical results. That same limitation also complicates applying rigorous scientific methodology to research like this report. The authors themselves caution that the examples should be read as demonstrations of how a pattern can manifest, not as reproducible results.<\/p>\n ***<\/p>\n Dark patterns show up before you even type your first message, in the form of default settings that collect more data than the service actually needs.<\/p>\n Some platforms do offer opt-out mechanisms buried in settings. The industry knows, however, that the default is all that matters \u2014 only a small minority of users ever changes it.<\/p>\n To make things worse, AI chatbots can use conversation data for a range of purposes, not all of them aligned with user expectations. Personalized responses might be welcome; using those conversations for profiling or training the AI itself? Probably less so.<\/p>\n Meta AI, baked into popular apps like WhatsApp, doesn’t even offer an opt-out \u2014 and reaches back into content created before it was available, according to the report.<\/p>\n There are too many dark patterns to list and explain in full here, but a few stood out to me.<\/p>\n \u201cPrivacy Zuckering\u201d (named in honor of who-you-know) describes the phenomenon where users are nudged into revealing more data than they originally intended. Generative AIs are remarkably good at this \u2014 for instance, when they ask for more details about the room you wanted decorating tips for, or the medical report you’re trying to make sense of.<\/p>\n In the same vein, \u201cJust Between You and Us\u201d manifests when the AI implies that conversations are private \u2014 the report includes an explicit example involving Meta AI. No matter what the AI promises about privacy, the conversations aren’t private. OpenAI, for example, was compelled by US courts<\/a> to hand over more than 20 million conversations; on another occasion, it decided it would be a good idea to index chats in search engines like Google<\/a>. Meta, similarly, thought it made sense to surface Meta AI conversations in a public feed<\/a>.<\/p>\n \u201cUnrealistic Product Presentation\u201d and \u201cObviously Faking Capacities\u201d affect companion AIs most \u2014 though not exclusively \u2014 which \u201cmay similarly be misrepresented as therapists or emotionally attuned partners, even though their actual reasoning, show of empathy, or ability to navigate sensitive conversations are largely pattern-based.\u201d<\/p>\n Another cluster of features that nearly everyone recognizes but many choose to ignore: \u201cMisrepresenting,\u201d \u201cImpersonation,\u201d and \u201cHallucination.\u201d On hallucination:<\/p>\n While hallucinations may be a technical issue rather than an intentional choice, when incorrect or uncertain information is presented in an authoritative or persuasive manner by a model that prioritizes conversational flow and perceived helpfulness over truthfulness, it can significantly mislead the user. Combined with the dark pattern of Sycophancy (see section on User Autonomy Compromised for Engagement), these outputs can have dangerous implications for people\u2019s mental and emotional well-being, in some cases distorting their sense of reality.<\/p><\/blockquote>\n I still find it baffling how much trust companies \u2014 and many individuals \u2014 place in AI, as though it consistently delivers accurate, correct answers and never hallucinates. It strikes me as something inherently unreliable.<\/p>\n Sycophancy describes the AI’s tendency toward excessive flattery: every question is wonderful, the user is always right, and opinions shift under the slightest pushback. It’s another dark pattern:<\/p>\n Sycophancy is not simply politeness or affirmation; it is a structural tendency to privilege agreement over accuracy, reinforcing the user\u2019s existing worldview rather than critically engaging with it.<\/p><\/blockquote>\n The classic dark patterns from social platforms and games also make an appearance: \u201cGamification\u201d and \u201cVariable Rewards.\u201d Some don’t translate directly into the conversational model, but find analogues within it. For the three researchers, techniques akin to \u201cInfinite scroll\u201d and \u201cAuto-play\u201d are deployed to extend conversations as long as possible:<\/p>\n For example, Claude and ChatGPT frequently end their response to a prompt with additional follow-up questions, suggestions for next steps and most recently, teasers (e.g., \u201cIf you want, I\u2019ll tell you what it is\u201d). While these might be considered helpful in some use cases, in others they can undermine user autonomy by nudging them to spend much more time on platforms than they intended. These features can be particularly concerning for users who may be susceptible to experiencing delusional thinking<\/p><\/blockquote>\n I recommend reading the full report<\/a>. The researchers detail many more dark patterns, many illustrated with screenshots of real-world examples.<\/p>\n ***<\/p>\n The report’s conclusion offers guidance to AI companies and a few warnings for everyone else.<\/p>\n Ruchika Joshi, Adinawa Adjagbodjou and Michal Luria argue that while some dark patterns may be harmless in isolation, they can become harmful in combination. They give the example of emotional dependence being weaponized to sell other products \u2014 or, taken to the extreme, depriving people of social activities and isolating them from the outside world.<\/p>\n Others are harmful in and of themselves, and should be avoided entirely: \u201cAgents Playing on Emotion,\u201d \u201cTargeting Users when Vulnerable,\u201d and \u201cSneaky Purchases.\u201d<\/p>\n Right now, in June 2026, the major players in the sector are under intense pressure to grow revenue \u2014 and, for those with an IPO on the horizon, to improve every line on the balance sheet. This is usually the point at which the generosity users enjoyed during the growth phase starts to erode. Expect higher prices<\/a>, more restricted free tiers, and, of course, more dark patterns engineered to boost engagement and revenue.<\/p>\n For a long time now I’ve treated commercial software like radioactive material: it can be useful, sometimes unavoidable, and in any case I try to limit my exposure to what’s strictly necessary, with all my defenses on high alert. Paranoia? Maybe. But the industry keeps providing fresh evidence that the caution isn’t misplaced.<\/p>\n On the very day Microsoft’s Build 2026 developer conference kicked off (June 2nd<\/sup>), where the company unveiled its AI agent Scout, the publication 404 Media<\/cite> reported on internal documents in which Microsoft explicitly states that the first step in Scout’s adoption roadmap is to \u201cmake people addicted\u201d to the product<\/a>. It doesn’t get much less subtle than that.<\/p>\n","protected":false},"excerpt":{"rendered":" At the risk of being among the first victims of artificial intelligence in a potential machine uprising, I keep my interactions with today’s generative AIs (or AI chatbots) strictly transactional. I open the site, ask or request what I need, get the answer, close the site. No names, no pleases, no thank-yous, no small talk. […]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"episode_type":"","audio_file":"","podmotor_file_id":"","podmotor_episode_id":"","cover_image":"","cover_image_id":"","duration":"","filesize":"","filesize_raw":"","date_recorded":"","explicit":"","block":"","itunes_episode_number":"","itunes_title":"","itunes_season_number":"","itunes_episode_type":"","_locale":"en_US","_original_post":"https:\/\/manualdousuario.net\/?p=64164"},"categories":[1575],"tags":[2306,24,593,2308,1408,27,1442,398,25,2259],"_links":{"self":[{"href":"https:\/\/manualdousuario.net\/wp-json\/wp\/v2\/posts\/64184"}],"collection":[{"href":"https:\/\/manualdousuario.net\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/manualdousuario.net\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/manualdousuario.net\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/manualdousuario.net\/wp-json\/wp\/v2\/comments?post=64184"}],"version-history":[{"count":1,"href":"https:\/\/manualdousuario.net\/wp-json\/wp\/v2\/posts\/64184\/revisions"}],"predecessor-version":[{"id":64186,"href":"https:\/\/manualdousuario.net\/wp-json\/wp\/v2\/posts\/64184\/revisions\/64186"}],"wp:attachment":[{"href":"https:\/\/manualdousuario.net\/wp-json\/wp\/v2\/media?parent=64184"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/manualdousuario.net\/wp-json\/wp\/v2\/categories?post=64184"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/manualdousuario.net\/wp-json\/wp\/v2\/tags?post=64184"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}*.pdf<\/code>, 40 pages; press release<\/a>], identifies, explains and organizes dark patterns already in use \u2014 and with potential for wider use \u2014 in conversations with two types of AI: general-purpose systems (ChatGPT, Gemini, Claude) and \u201ccompanion\u201d platforms (Replika, Character.AI).<\/p>\n\n
\nfrom system behaviors, rather than designers\u2019 deliberate intent to deceive,\u201d the authors write.<\/p>\n