Skip to content

v0.2.6
Compare
Choose a tag to compare
@D4Vinci D4Vinci released this 24 Nov 13:37
· 86 commits to main since this release
v0.2.6
bbbc97a
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Learn about vigilant mode.

What's changed

New features

  • Now the PlayWrightFetcher can use the real browser directly with the real_chrome argument passed to the PlayWrightFetcher.fetch function but this requires you to have Chrome browser installed. Scrapling will launch an instance of your Chrome browser and you can use most of the options as normal. (Before you only had the cdp_url argument to do so)
  • Pumped up the version of headers generated for real browsers.

Bugs Squashed

  1. Turns out the format of the browser headers generated by BrowserForge was outdated which made Scrapling detected by some protections so now BrowserForge is only used to generate real useragent.
  2. Now the hide_canvas argument is turned off by default as it's being detected by Google's ReCaptcha.

Note

A friendly reminder that maintaining and improving Scrapling takes a lot of time and effort which I have been happily doing for months even though it's becoming harder. So, if you like Scrapling and want it to keep improving, you can help by supporting me through the Sponsor button.

Assets 2
Loading