• I Cast Fist@programming.dev
    link
    fedilink
    arrow-up
    2
    ·
    21 days ago

    they should advocate for a more robust robots.txt on their instances server.

    Only a couple of bots respect that file anyway