Thanks Hans for the code and your help
i don't get the gz'ed page with curl at all (no matter what i send - headers/no
header -L/no -L etc) - just the 'needs javascript and cookies' page'
a line from 'band of brothers' comes to mind here
https://www.youtube.com/watch?v=cQE1YIJDNWo
substitue 'clo
On Wed, 8 Jan 2025 22:09:41 +0100
Hans Henrik Bergan via curl-users wrote:
> >i don;t get the 'are you a human' page with any of them
>
> lucky you: cloudflare's automated systems deems it unnecessary to
> challenge you. A variation of a "trustworthy IP range" and
> "correct-looking headers"
> a
On Wed, 8 Jan 2025 12:27:00 -0800
Dan Fandrich via curl-users wrote:
> On Wed, Jan 08, 2025 at 10:59:15AM -0700, toby via curl-users wrote:
> > the page is actually gzipped - dillo can gunzip but curl can't by itself
> > (found out using w3m)
>
> curl will uncompress
st bet to automate anything on that page is with
> "headless chrome running in headless mode" - idk how CF is detecting
> it, but it detects headless chromium running headless as bots, but it
> does not detect headless-chromium-running-in-headful-mode as bots.
>
> On Wed, 8
but it detects headless chromium running headless as bots, but it
> does not detect headless-chromium-running-in-headful-mode as bots.
>
> On Wed, 8 Jan 2025 at 16:23, toby via curl-users
> wrote:
> >
> > Maybe someone can help me with this
> >
> > dillo
> >
Maybe someone can help me with this
dillo
https://www.podchaser.com/podcasts/crypto-corner-bitcoin-and-bloc-950963/episodes/recent
gives a good page
curl -b cookies.txt -c cookies.txt -A "Mozilla/5.0" -k -L -o crypto.html
https://www.podchaser.com/podcasts/crypto-corner-bitcoin-and-bloc-950963/
