Have you asked the operator of those sites if they are fine with this?
It would be a shame if they were to be taken down because of people scraping the site causing too much traffic costs or something.
Have you asked the operator of those sites if they are fine with this?
It would be a shame if they were to be taken down because of people scraping the site causing too much traffic costs or something.
Why not just message them at their contact email address and ask in advance if your assumption about their CDN server is true, you should set a specific user agent etc.? Then they wouldn't have to potentially waste time on figuring out what's happening, writing and deploying filtering/rate limiting logic or finding the repository and contacting you on GitHub.