Go

Got Tired of LLMs refusing to visit URLs Built open source analyzer CLI

Hacker News

Got Tired of LLMs refusing to visit URLs Built open source analyzer CLI

Built this because I got tired of ChatGPT/Claude refusing to visit websites when doing research. Crawls sitemaps, parses metadata files (robots.txt, humans.txt, llms.txt), detects tech stack with Wappalyzer, then generates summaries using either AWS Bedrock or a local Llama model via Ollama. Batch mode processes CSVs with checkpoint/resume - hit Ctrl+C anytime and pick up where you left off. The local LLM option means zero API costs and your data never leaves your machine. Llama 3.2 3B works surprisingly well for this task.

Share card

Actual performance

3points
3comments
Did not reach leaderboard

Launch Intel predictions

Analyze your own launch →
Product HuntOn track for Day 1 leaderboard · Strong signals: mac, claude, model · Missing: agents, macos, agent
93%93% predicted probability of success on Product Hunt, based on ML models trained on real launch data.
best fitHighest predicted score across all platforms for this description.
Indie HackersFits the IH revenue-focused audience · Missing: supports, reddit linkedin, podcasting
67%67% predicted probability of success on Indie Hackers, based on ML models trained on real launch data.
Hacker NewsStrong engagement from HN community · Strong signals: open source, llama, io · Missing: https docs, excited, just released
56%56% predicted probability of success on Hacker News, based on ML models trained on real launch data.
nativeThis product was originally launched on this platform.
TrustMRRLess likely to generate early MRR · Missing: mobile apps, ios, personal
38%38% predicted probability of success on TrustMRR, based on ML models trained on real launch data.
AppSumoMay struggle as an AppSumo deal · Missing: plus, platform, intuitive
30%30% predicted probability of success on AppSumo, based on ML models trained on real launch data.
Acquire.comPre-revenue stage for this audience · Missing: arr, mrr, revenue
17%17% predicted probability of success on Acquire.com, based on ML models trained on real launch data.
BetaListMay not resonate with beta-testers · Strong signals: chat · Missing: web3, crypto, cryptocurrency
1%1% predicted probability of success on BetaList, based on ML models trained on real launch data.

Incorrect prediction on native model

Similar products

Po
Poozle – open-source Plaid for LLMs65%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Poozle – open-source Plaid for LLMs

Hacker News132
Le
Leaping – Open-source debugging with LLMs69%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Leaping – Open-source debugging with LLMs

Hacker News15
Ke
Keep – Open-source alerting CLI52%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Keep – Open-source alerting CLI

Hacker News65
Op
Open-Source CLI Copilot Built on Zsh-Autosuggestions62%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Open-Source CLI Copilot Built on Zsh-Autosuggestions

Hacker News1
Co
Configurable Open Source Audio Spectrum Analyzer69%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Configurable Open Source Audio Spectrum Analyzer

Hacker News3
I
I built an open-source benchmark that evaluates LLMs through gameplay55%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

I built an open-source benchmark that evaluates LLMs through gameplay

Hacker News2
Go
Golem – A beautiful open-source UI for LLMs, built on Nuxt 379%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Golem – A beautiful open-source UI for LLMs, built on Nuxt 3

Hacker News4
We
We got fed up with Airbrake, so we built Coalmine47%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

We got fed up with Airbrake, so we built Coalmine

Hacker News8
Op
Open Codex – OpenAI Codex CLI with open-source LLMs72%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Open Codex – OpenAI Codex CLI with open-source LLMs

Hacker News106
I
I built an open-source, privacy-first tool to map contexts for LLMs73%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

I built an open-source, privacy-first tool to map contexts for LLMs

Hacker News1