PubSub FUN
  • Communities
  • Create Post
  • Create Community
  • heart
    Support Lemmy
  • search
    Search
  • Login
  • Sign Up
tekeous@usenet.lol to Lemmy Shitpost@lemmy.world · 6 months ago

robots.txt is a suggestion

usenet.lol

message-square
23
fedilink
621

robots.txt is a suggestion

usenet.lol

tekeous@usenet.lol to Lemmy Shitpost@lemmy.world · 6 months ago
message-square
23
fedilink
  • ekZepp@lemmy.world
    link
    fedilink
    English
    arrow-up
    17    ·
    6 months ago

    All this robot.txt stuff “perplex” me.

@lemmy.worldRemoved by mod

lemmyshitpost@lemmy.world

Subscribe from Remote Instance

Create a post
You are not logged in. However you can subscribe from another Fediverse account, for example Lemmy or Mastodon. To do this, paste the following into the search field of your instance: !lemmyshitpost@lemmy.world
Visibility: Local Only
house

Only users on this instance can interact with this community.

  • 474 users / day
  • 1.69K users / week
  • 3.07K users / month
  • 7.68K users / 6 months
  • NaN local subscribers
  • 1 subscriber
  • 11K Posts
  • 159K Comments
  • Modlog
  • mods:
  • Aer@lemmy.world
  • Striker@lemmy.world
  • WiildFiire@lemmy.world
  • Decoy321@lemmy.world
  • Thekingoflorda@lemmy.world
  • YoBuckStopsHere@lemmy.world
  • The Picard Maneuver@startrek.website
  • Flying Squid@lemmy.world
  • The Picard Maneuver@lemmy.world
  • BE: unknown version
  • Modlog
  • Instances
  • Docs
  • Code
  • join-lemmy.org