Be

Best Rejected Papers

Hacker News

Best Rejected Papers

OpenReview.net has been a mainstay of conference reviewing for some of the largest Machine Learning conferences for the past 7 years. As all reviewing and acceptance decisions are public, we can analyse the quality of peer review over time by linking open review papers to academic graphs like Semantic Scholar. Over the past 2-3 months I’ve done this linking process for ~40k papers, as well as compiling a complimentary dataset of ~400k structured review comments from the paper discussions. This blog post has a few preliminary pieces of analysis, including the “Best Rejected Papers” from some recent ML conferences (including ROBERTa (42k citations) and Improved Denoising Diffusion models, a very influential paper in diffusion modeling). Any feedback on the dataset/interesting further analysis is welcome!

Share card

Actual performance

1points
Did not reach leaderboard

Launch Intel predictions

Analyze your own launch →
Hacker NewsStrong engagement from HN community · Strong signals: io, including · Missing: https docs, excited, just released
78%78% predicted probability of success on Hacker News, based on ML models trained on real launch data.
nativeThis product was originally launched on this platform.
Product HuntOn track for Day 1 leaderboard · Strong signals: mac, model, models · Missing: agents, macos, agent
65%65% predicted probability of success on Product Hunt, based on ML models trained on real launch data.
Indie HackersFits the IH revenue-focused audience · Strong signals: including · Missing: supports, reddit linkedin, podcasting
57%57% predicted probability of success on Indie Hackers, based on ML models trained on real launch data.
TrustMRRLess likely to generate early MRR · Strong signals: month · Missing: mobile apps, ios, personal
47%47% predicted probability of success on TrustMRR, based on ML models trained on real launch data.
AppSumoMay struggle as an AppSumo deal · Missing: plus, platform, intuitive
44%44% predicted probability of success on AppSumo, based on ML models trained on real launch data.
Acquire.comPre-revenue stage for this audience · Missing: arr, mrr, revenue
18%18% predicted probability of success on Acquire.com, based on ML models trained on real launch data.
BetaListMay not resonate with beta-testers · Missing: web3, chat, crypto
4%4% predicted probability of success on BetaList, based on ML models trained on real launch data.

Incorrect prediction on native model

Similar products

Th
The “tl;dr” of Recent Transformer Papers58%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

The “tl;dr” of Recent Transformer Papers

Hacker News5
Th
The Federalist Papers, typeset as the 1787 newspapers they ran in67%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

The Federalist Papers, typeset as the 1787 newspapers they ran in

Hacker News58
Ba
Back Me Up – Find papers that back your argument63%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Back Me Up – Find papers that back your argument

Hacker News2
PagePeek
PagePeek59%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Your AI Professor for drafting and evaluating papers in secs

Product Hunt+6
Pl
Plasmyd, a platform for scientists to discuss papers70%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Plasmyd, a platform for scientists to discuss papers

Hacker News6
St
StackOverflow for Research Papers74%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

StackOverflow for Research Papers

Hacker News2
Ha
HackerNews but for research papers59%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

HackerNews but for research papers

Hacker News319
PaperGate
PaperGate51%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Find Research Papers

Indie Hackers1ai
Pa
Papers with Prompts54%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Papers with Prompts

Hacker News4
Eu
Eureka Map visualizes where scientific papers are being published48%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Eureka Map visualizes where scientific papers are being published

Hacker News1