On Fri, 4 Oct 2024 16:16:42 +0200 (CEST) Roger Price <deb...@rogerprice.org> wrote:
> On Fri, 4 Oct 2024, Greg Wooledge wrote: > > > On Fri, Oct 04, 2024 at 15:24:11 +0200, Roger Price wrote: > >> On Fri, 4 Oct 2024, Joe wrote: > >> > >>>>> https://www.bobevans.com/ > >> Bob Evans use Incapsula to prevent scraping. Probably a waste of > >> money. Scrapers will scrape and real customers are driven away. > > > > As a counter data point, that web site loads for me in Google > > Chrome. In Firefox with NoScript installed, I get "We're sorry but > > BobEvans.com doesn't work properly without JavaScript enabled. > > Please enable it to continue." > > > > I'm in the United States, so if there's blocking it might be geo-IP > > based. > > An Incapsula competitor, ScrapFly, explains why they think the > blocking is primarily Javascript based: > https://scrapfly.io/blog/how-to-avoid-web-scraping-blocking-javascript/ "..javascript is by far the most powerful tool because it allows arbitrary code execution on the client machine." The work of the Devil. I had the site not work in FF with No-Script nor in Opera with no restrictions. But we are not getting to the web page at all, so JavaScript is not involved. It's a filtering proxy, and We Are Not Welcome. Not, as far as I can see, that anyone outside the US has any use for the site. -- Joe