I

I Scraped 2,200 Software Engineering Jobs from Career Pages Using LLMs

Hacker News

I Scraped 2,200 Software Engineering Jobs from Career Pages Using LLMs

Hi everyone, I built GrepJob because I got frustrated with the user experience of LinkedIn/Indeed while looking for a new SWE job. Specifically: 1) Not being able to trust the date posted of any job. The date shown on LinkedIn is often the date the job was reposted by the recruiter and 2) Being shown too many irrelevant jobs. For example, I get shown senior/staff level roles when I search for "Software Engineer II" GrepJob solves 1) by populating the date_posted time directly from each company's ATS system And 2) by extracting seniority, specialty (frontend, backend, etc.), and tech stack from each job with LLMs Please let me know if you have any feedback, thanks!

Share card

Actual performance

8points
14comments
Made the leaderboard

Launch Intel predictions

Analyze your own launch →
Indie HackersFits the IH revenue-focused audience · Missing: supports, reddit linkedin, podcasting
79%79% predicted probability of success on Indie Hackers, based on ML models trained on real launch data.
best fitHighest predicted score across all platforms for this description.
Product HuntOn track for Day 1 leaderboard · Strong signals: user, new, using · Missing: mac, agents, macos
73%73% predicted probability of success on Product Hunt, based on ML models trained on real launch data.
Hacker NewsMay not resonate with HN audience · Strong signals: io · Missing: https docs, excited, just released
48%48% predicted probability of success on Hacker News, based on ML models trained on real launch data.
nativeThis product was originally launched on this platform.
TrustMRRLess likely to generate early MRR · Missing: mobile apps, ios, personal
31%31% predicted probability of success on TrustMRR, based on ML models trained on real launch data.
AppSumoMay struggle as an AppSumo deal · Missing: plus, platform, intuitive
23%23% predicted probability of success on AppSumo, based on ML models trained on real launch data.
Acquire.comPre-revenue stage for this audience · Missing: arr, mrr, revenue
13%13% predicted probability of success on Acquire.com, based on ML models trained on real launch data.
BetaListMay not resonate with beta-testers · Missing: web3, chat, crypto
1%1% predicted probability of success on BetaList, based on ML models trained on real launch data.

Incorrect prediction on native model

Similar products

IT
IT and software engineering jobs48%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

IT and software engineering jobs

Hacker News1
SWEPro
SWEPro39%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Level up your Software Engineering career!

Indie Hackers1education
MapleStack
MapleStack38%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Canadian jobs, straight from company career pages

Indie Hackers1jobs-hiring
So
Software Engineering 10148%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Software Engineering 101

Hacker News5
Cl
Cleanweb Jobs – Software Jobs in the Environmental Sector47%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Cleanweb Jobs – Software Jobs in the Environmental Sector

Hacker News4
Velai
Velai35%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Only shows jobs still live on company career pages

Indie Hackers
C+
C++ LMAX Disruptor < 200 LOC45%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

C++ LMAX Disruptor < 200 LOC

Hacker News3
Матрац на ліжко 160 на 200
Матрац на ліжко 160 на 20031%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Двоспальний матрац: інженерний компроміс між двома тілами

Indie Hackers
Be
Beautiful career pages61%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Beautiful career pages

Hacker News17
Sp
Space industry jobs aggregation from companies career pages55%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Space industry jobs aggregation from companies career pages

Hacker News2