cross-posted from: https://lemmy.world/post/49778353

Also /c/modabuse. Also /c/yepowertrippinbastards. Also lemmy.ml/c/worldnews, comrade, ACAB, and 552 individual accounts across 67 instances, about half of them on lemmy.world.

None of this is in the source code. It’s downloaded at runtime from a file nobody has ever looked at.

If you’re just tuning in

Tesseract is a third-party web frontend for Lemmy, maintained by asimons04 and licensed AGPL-3.0. Admins deploy it on their own servers alongside or instead of lemmy-ui, and there are public instances of it people use to browse Lemmy generally. If you’ve used a Lemmy site that didn’t look like stock Lemmy, there’s a fair chance it was this.

Last week db0 posted a PSA: Tesseract contains a blacklist of instance domains compiled directly into the application. 32 of them. Admins can’t see it, can’t configure it, and aren’t told it’s there. Connect to a listed instance and the app tells you it’s “incompatible,” which is not true.

I went through the code to see how that was implemented. The hardcoded list turns out to be the small half of the system.

There’s a second filter policy fetched over HTTP every time the app loads. It isn’t in the git repository. It’s unauthenticated and world-readable, so anyone can pull it. Right now it carries 552 user accounts, 2,275 username patterns, 54 instances, 97 communities, 289 keyword patterns and 351 domains, with every category set to hide matches rather than flag them. Not collapsed behind a click. Simply absent, with no indication anything was removed.

Verify all of it in ten seconds

curl -s https://tesseract.dubvee.org/tesseract/api/system/policy \
  | base64 -d | gunzip > policy.json

That’s the live policy, base64-wrapped gzip, 111KB of JSON when it unpacks. There’s a stale fallback copy at /data/policy.dat as well.

It filters criticism of moderators

  • lemmy.sdf.org/c/modabuse — listed
  • lemmy.dbzer0.com/c/yepowertrippinbastards — listed
  • lemmy.dbzer0.com/c/YPTBcirclejerk — listed
  • community regex power ?tripping?
  • keyword censoring me

Call the rest of it whatever you like. This part is not spam defence.

It filters words

The 32 community name patterns include Communis(t|m), Conservativ(e|es|ism), Leftis(t|m), Libertarian(ism)?, ^Green Part(y|ies), Zionis(t|m), (Police|Cops), guillotine and billionaire.

Keywords include comrade, ACAB, neoliberal, proletaria(n|t) and death to.

Filtered communities on instances that aren’t blocked: lemmy.ml/c/worldnews, lemmy.today/c/news, lemmy.ca/c/politicalnewscanada, lemmy.ca/c/usa, infosec.pub/c/strategic_unions.

The 552 users aren’t bots

67 instances. 272 on lemmy.world alone, 40 on sh.itjust.works, 19 on lemmy.ca, and 28 instances contributing exactly one person each.

355 of the 552 usernames are plain alphabetic, twelve characters or under, median length eight. Only 36 look like spam registrations. A bot list looks like the opposite of that.

Seven of them aren’t even Lemmy. There are Mastodon and Friendica accounts in there: people who have never used Lemmy, hidden by a Lemmy frontend, with no possible way of finding out.

I have the list and I’m not posting it. Most of these are ordinary people who got pattern-matched, and 552 names on this comm is a harassment target inside an hour. Run the command above and grep for yourself.

And it lies about it

When the instance block fires you get: “Incompatible Instance. Not Supported. $instance is not compatible with Tesseract.”

Nothing is incompatible. It’s a policy decision dressed as an API error, and it’s what had db0 chasing a version mismatch that never existed.

For the hidden users, communities and keywords, you get no message at all.

Admins can’t switch it off

Tesseract has env vars for PUBLIC_DOMAIN_BLACKLIST, PUBLIC_FAKE_NEWS_BLACKLIST and the shortener lists. There is none for either blocklist. enableToxicMode bypasses the other filters and explicitly not this one.

Self-host it and you cannot disable this, nothing in your config admits it exists, and the contents can change without you pulling a commit.

Before someone says it

A lot of that domain list is real spam defence. It filters conservatism as well as communism. “It targets the left” doesn’t survive the data and I’m not going to pretend it does.

The problem is that spam filtering and political editorial got welded into one undocumented, remotely-updatable blob, shipped hidden, to admins who’ve never read it and users who don’t know it’s there. The spam work is what makes the rest unauditable: “it’s a spam list” answers every individual question and none of the whole.

And /c/modabuse is not spam.

Asks

  1. Publish the runtime policy in the repo, or kill the endpoint.
  2. Stop reporting a policy block as a technical incompatibility.
  3. Tell users when something’s been hidden. One line.
  4. Give operators an off switch, like every other blacklist in the codebase has.

It’s AGPL-3.0 and db0 already forked it. That’s the licence working as designed. But forking isn’t disclosure, and the admins who need this are precisely the ones with no reason to go looking.

If you run Tesseract, you are relaying a 111KB moderation policy you have never read, under your instance’s name, to users who don’t know it exists.

Full contents of every list, unedited, in the comments.

  • Fmstrat@lemmy.world
    link
    fedilink
    English
    arrow-up
    3
    ·
    2 hours ago

    If you wanted to, it would be good to know which maintainers made the commits and approved PRs, and what other projects they run or contribute to.

    What happened with Tesseract could happen with any of those.

    • Skullgrid@lemmy.world
      link
      fedilink
      English
      arrow-up
      7
      ·
      5 hours ago

      I’m pretty sure he went by making the broad lists of banned shit, and then ran a query on all the users that came up with saying that stuff.

      I’m also on there, so I feel significant.

      Or, he hates modern heavy metal, Devin Townsend and Colin Marston in particular.

    • bitjunkie@lemmy.world
      link
      fedilink
      English
      arrow-up
      9
      ·
      9 hours ago

      Pissing off this thin-skinned little bitch doesn’t seem like that much of an achievement tbh

  • qaz@lemmy.world
    link
    fedilink
    English
    arrow-up
    2
    arrow-down
    1
    ·
    edit-2
    4 hours ago

    It seems none of the communities I mod have made the list this time

  • davidgro@lemmy.world
    link
    fedilink
    English
    arrow-up
    8
    ·
    16 hours ago

    Wow, I’m famous enough to have made the list. Nice!

    I kinda wonder if I wasn’t on the list, but now I am because of my previous comment on this post.

  • dual_sport_dork 🐧🗡️@lemmy.world
    link
    fedilink
    English
    arrow-up
    38
    ·
    edit-2
    21 hours ago

    The developer behind Tesseract is the same user who has displayed the habit of preemptively banning users who have never participated in or even visited his communities, particularly those that were on dubvee.org. Apparently for ideological reasons, or simply for being associated with a particular Lemmy instance.

    So at the risk of stirring up even more Fediverse drama by saying it, it seems like the findings above are squarely on brand.

    Not to come over all Graham Chapman about it or anything, but I always found that type of behavior to be very silly.

    Edit!

    I got curious and pulled down the data to have a look. If you want to do this on Windows (don’t @ me about it, alright?)

    spoiler

    you can just point your browser to https://tesseract.dubvee.org/tesseract/api/system/policy and save it someplace or, if you insist on doing it from a commandline, curl --output [filename] https://tesseract.dubvee.org/tesseract/api/system/policy.

    Then to decode from base64:

    certutil -decode [inputfile] policy.gz

    And extract:

    tar -xf policy.gz

    Or, you know, just open it in Explorer. The resultant file is just plain text.

    Anyway, guess what! I’m on the list. I’m a celebrity, ma! I ought to be on TV.

  • Apytele@sh.itjust.works
    link
    fedilink
    English
    arrow-up
    5
    ·
    edit-2
    14 hours ago

    probably gonna get shit on for not using a VPN for literally everything all the time but I didn’t realize that I was going to need to attach my terminal to a VPN to download that file! All that and I’m not even on the list as far as I can tell. I’m almost offended that I haven’t offended this person.

  • bamboo@lemmy.blahaj.zone
    link
    fedilink
    English
    arrow-up
    25
    ·
    23 hours ago

    I took a look at it earlier today and the addition of instances to be blocked was super shady and sloppy on part of the maintainer. Some high profile instances were added to the blocklist alongside unrelated changes and not mentioned in the git commit message, for example this commit: https://github.com/asimons04/tesseract/commit/fcd71e01e9f64d5ff40dbee9b815971bc00e9a2a

    Also apparently the error you’d get when going to the blocked instance was a generic error which makes the user think there’s a network issue or incompatibility with the API or something and the idea of a hard coded blocklist is never presented to the user as the source of the issue.

  • Ech@lemmy.ca
    link
    fedilink
    English
    arrow-up
    6
    ·
    edit-2
    21 hours ago

    Lol, I made the list. Didn’t this admin have a big ol’ crashout and “retire” some time ago?

  • dohpaz42@lemmy.world
    link
    fedilink
    English
    arrow-up
    2
    ·
    22 hours ago

    This is the beauty and downside to open source. Anybody can force their political views in their software. But once discovered, it can be forked and fixed.

    It’s a shame that everything has become so politicized that people feel the need to shove their religious political beliefs down everyone else’s throats. Yeah, we all know who the Bad Guys™ are; we don’t need to be constantly reminded.

    Give users their voices back (or at least choice in what they want to see and block). It’s the decent thing to do. Anything else makes you a certified asshole.

    I said what I said.