Sy

SycoFact 4B: Open model detecting sycophancy and delusion confirmation

Hacker News

SycoFact 4B: Open model detecting sycophancy and delusion confirmation

I published a model you can use now to help detect sycophantic AI responses before they harm users. It rejects 100% of the sycophantic delusion affirming responses from psychosis-bench. It also does well on the AISI Harmful Advice, PKU-SafeRLHF, and safety subsets of RewardBench. It's small enough it can run on a gaming GPU locally. It's got a GGUF checkpoint on hugging face and is available on ollama. You can pull it and run scenarios against it in minutes: https://ollama.com/izzie/sycofact The synthetic training data is also public, you can train other models over the data or reproduce my results. The labels were all generated by Gemma 3 27B with activation steering based on generated contrastive data. A write-up is planned at a later date, feel free to get in touch if curious.

Share card

Actual performance

2points
Did not reach leaderboard

Launch Intel predictions

Analyze your own launch →
Indie HackersFits the IH revenue-focused audience · Strong signals: ios · Missing: supports, reddit linkedin, podcasting
85%85% predicted probability of success on Indie Hackers, based on ML models trained on real launch data.
best fitHighest predicted score across all platforms for this description.
Product HuntOn track for Day 1 leaderboard · Strong signals: model, user, models · Missing: mac, agents, macos
73%73% predicted probability of success on Product Hunt, based on ML models trained on real launch data.
Hacker NewsMay not resonate with HN audience · Strong signals: llama, io · Missing: https docs, excited, just released
49%49% predicted probability of success on Hacker News, based on ML models trained on real launch data.
nativeThis product was originally launched on this platform.
TrustMRRLess likely to generate early MRR · Strong signals: ios, users · Missing: mobile apps, personal, entrepreneurs
39%39% predicted probability of success on TrustMRR, based on ML models trained on real launch data.
AppSumoMay struggle as an AppSumo deal · Strong signals: users · Missing: plus, platform, intuitive
28%28% predicted probability of success on AppSumo, based on ML models trained on real launch data.
Acquire.comPre-revenue stage for this audience · Strong signals: training · Missing: arr, mrr, revenue
20%20% predicted probability of success on Acquire.com, based on ML models trained on real launch data.
BetaListMay not resonate with beta-testers · Strong signals: reward · Missing: web3, chat, crypto
1%1% predicted probability of success on BetaList, based on ML models trained on real launch data.

Correct prediction on native model

Similar products

Olmo Hybrid
Olmo Hybrid86%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

7B open model mixing transformers and linear RNNs

Product Hunt+107Open Source
GLM-4.5
GLM-4.592%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Unifying agentic capabilities in one open model

Product Hunt+298Open Source
As
Assist: an open-model-first work surface for agents44%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Assist: an open-model-first work surface for agents

Hacker News2
MiniMax M2.5
MiniMax M2.574%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

The first open model to beat Sonnet made for productivity

Product Hunt+194Open Source
Hy4 preview
Hy4 preview83%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Tencent’s 770B open model for long-horizon work

Product Hunt+216Open Source
Kimi K2
Kimi K286%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

The 1T parameter open model for agentic intelligence

Product Hunt+348Open Source
Qwen3-Coder
Qwen3-Coder94%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

A powerful open model for agentic coding tasks

Product Hunt+248Open Source
GLM-4.7 API
GLM-4.7 API55%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

GLM-4.7 is a open model as your coding partner.

Indie Hackers1$1/moai
A
A System Model of Western Civilisation51%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

A System Model of Western Civilisation

Hacker News2
ja
javscript model of Ackermann steering51%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

javscript model of Ackermann steering

Hacker News3