On Fri, 4 Oct 2024, Joe wrote:
An Incapsula competitor, ScrapFly, explains why they think the
blocking is primarily Javascript based:
https://scrapfly.io/blog/how-to-avoid-web-scraping-blocking-javascript/
"..javascript is by far the most powerful tool because it allows
arbitrary code execution on the client machine."
The work of the Devil.
I had the site not work in FF with No-Script nor in Opera with no
restrictions. But we are not getting to the web page at all, so
JavaScript is not involved. It's a filtering proxy, and We Are Not
Welcome. Not, as far as I can see, that anyone outside the US has any
use for the site.
The ScrapFly author Granitosaurus also wrote:
https://stackoverflow.com/questions/47581662/how-incapsula-works-and-how-to-beat-it
« Incapsula, like many other anti-scraping services, uses 3 types of details to
identify web scrapers:
1. IP address meta information
2. Javascript Fingerprinting
3. Request analysis »
So it's either your IP or something in your Request. For me it's very
probably my Starlink IP. Roger
