Cloakbits - Headless web scraping with bypass for anti-bot WAFs

Hacker News

There is a growing number of companies offering anti-bot protection SaaS to protect websites from scraping by automated bots based on Puppeteer/Selenium. Most of them rely on browser properties such as headers, javascript properties (window. , navigator. ), behavior analysis, to build device/user fingerprints and match it against a database of "whitelisted" fingerprints (typical user behavior/settings/device props etc). For the past few months, together with two other devs I have worked on a customized Puppeteer/Playwright scraping backend. It's essentially a drop-in replacement for default Chrome/FF binaries. We managed to successfully go through Coinbase, Amazon, Aliexpress login pages in headless mode without getting captcha, or any other verification. We are planning to roll out a beta version. If you are interested in getting beta access leave us details about your use case here: https://a90eq67iroz.typeform.com/to/FAkWnrtv The motivation for our project is that open-source solutions such as puppeteer-extra-stealth cover only a small portion of what popular anti-bot software such as Akamai Bot Manager or Imperva use to detect and ban emulated browsers.

Visit product View on Hacker NewsJan 9, 2021

Share card

Actual performance

8points

5comments

Made the leaderboard

Launch Intel predictions

Analyze your own launch →

Hacker NewsStrong engagement from HN community · Strong signals: io · Missing: https docs, excited, just released

77%77% predicted probability of success on Hacker News, based on ML models trained on real launch data.

nativeThis product was originally launched on this platform.

Indie HackersFits the IH revenue-focused audience · Missing: supports, reddit linkedin, podcasting

67%67% predicted probability of success on Indie Hackers, based on ML models trained on real launch data.

Product HuntOn track for Day 1 leaderboard · Strong signals: user, open · Missing: mac, agents, macos

52%52% predicted probability of success on Product Hunt, based on ML models trained on real launch data.

TrustMRRLess likely to generate early MRR · Strong signals: month · Missing: mobile apps, ios, personal

40%40% predicted probability of success on TrustMRR, based on ML models trained on real launch data.

AppSumoMay struggle as an AppSumo deal · Missing: plus, platform, intuitive

22%22% predicted probability of success on AppSumo, based on ML models trained on real launch data.

Acquire.comPre-revenue stage for this audience · Strong signals: saas · Missing: arr, mrr, revenue

15%15% predicted probability of success on Acquire.com, based on ML models trained on real launch data.

BetaListMay not resonate with beta-testers · Missing: web3, chat, crypto

1%1% predicted probability of success on BetaList, based on ML models trained on real launch data.

Correct prediction on native model

Similar products

Cloakbits67%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

A webdriver for stealth web scraping to bypass anti-bot WAFs

Indie Hackerscommitment-full-time

The Java Web Scraping Handbook57%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

The Java Web Scraping Handbook

Hacker News2

The Java Web Scraping Handbook57%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

The Java Web Scraping Handbook

Hacker News2

The Java Web Scraping Handbook57%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

The Java Web Scraping Handbook

Hacker News4

The Java Web Scraping Handbook57%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

The Java Web Scraping Handbook

Hacker News7

Meter – Web scraping that syncs only what changed62%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Meter – Web scraping that syncs only what changed

Hacker News2

Web Scraping and Crawling – FetchRelay53%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Web Scraping and Crawling – FetchRelay

Hacker News1

Getting started with Puppeteer and Chrome Headless for Web Scraping76%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Getting started with Puppeteer and Chrome Headless for Web Scraping

Hacker News142

XHR anti bot bypass (xhr.dev)71%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

XHR anti bot bypass (xhr.dev)

Hacker News19

Java Web Scraping Handbook79%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

A book about web scraping in Java

Indie Hackers3$600/mobooks

Browse all products Analyze your launch