this post was submitted on 07 Apr 2024
530 points (95.8% liked)

Security

5041 readers
1 users here now

Confidentiality Integrity Availability

founded 5 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
[–] goferking0@lemmy.sdf.org 4 points 7 months ago

There's also the question of what happens if they just ignore the robots.txt file