An

Anitag2vec – Tag set embedding for ranking recommendations

Hacker News

Anitag2vec – Tag set embedding for ranking recommendations

I've been experimenting with using a tiny Transformer encoder without positional encoding a replacement for standard Deep Sets (permutation-invariant MLPs). The intuition: while Deep Sets are theoretically cleaner, a Transformer encoder naturally picks up on tag co-occurrence and spelling variations that sum-pooling layers often miss. I have trained this on anime/imageboard tags for now. Interestingly, even when testing on absolute nonsense/out-of-distribution tags, the model holds up fairly well. It seems to develop a strong sense of permutation invariance, with cosine scores remaining robust even when comparing sets to their subsets. Curious to hear if anyone else has experimented with stripping PEs from Transformers for set-based tasks.

Share card

Actual performance

2points
Did not reach leaderboard

Launch Intel predictions

Analyze your own launch →
Product HuntOn track for Day 1 leaderboard · Strong signals: model, tiny, tasks · Missing: mac, agents, macos
87%87% predicted probability of success on Product Hunt, based on ML models trained on real launch data.
best fitHighest predicted score across all platforms for this description.
TrustMRRLess likely to generate early MRR · Missing: mobile apps, ios, personal
43%43% predicted probability of success on TrustMRR, based on ML models trained on real launch data.
AppSumoMay struggle as an AppSumo deal · Missing: plus, platform, intuitive
33%33% predicted probability of success on AppSumo, based on ML models trained on real launch data.
Indie HackersIH features products with proven revenue · Missing: supports, reddit linkedin, podcasting
31%31% predicted probability of success on Indie Hackers, based on ML models trained on real launch data.
Hacker NewsMay not resonate with HN audience · Strong signals: io · Missing: https docs, excited, just released
27%27% predicted probability of success on Hacker News, based on ML models trained on real launch data.
nativeThis product was originally launched on this platform.
BetaListMay not resonate with beta-testers · Missing: web3, chat, crypto
18%18% predicted probability of success on BetaList, based on ML models trained on real launch data.
Acquire.comPre-revenue stage for this audience · Missing: arr, mrr, revenue
15%15% predicted probability of success on Acquire.com, based on ML models trained on real launch data.

Correct prediction on native model

Similar products

An
Anitag2vec – tag embeddings for recommendations49%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Anitag2vec – tag embeddings for recommendations

Hacker News1
Ra
RankFight – We're Ranking Everything50%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

RankFight – We're Ranking Everything

Hacker News6
Co
Covid-19 infection ranking adjusted by population45%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Covid-19 infection ranking adjusted by population

Hacker News5
MissedQueries
MissedQueries57%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

You're ranking for searches you never wrote about.

Indie Hackers1analytics
Em
Embedding visualizations for bloggers and journalists – VizFiddle52%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Embedding visualizations for bloggers and journalists – VizFiddle

Hacker News1
Vi
Visualizing and Comparing Embedding Vectors as Heatmaps56%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Visualizing and Comparing Embedding Vectors as Heatmaps

Hacker News3
Im
Implementing Embedding Gemma in PyTorch28%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Implementing Embedding Gemma in PyTorch

Hacker News3
Em
EmbedFlow –> Upgrade embedding models without re-embedding your corpus56%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

EmbedFlow –> Upgrade embedding models without re-embedding your corpus

Hacker News6
Qu
Quora for Recommendations43%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Quora for Recommendations

Hacker News1
Ti
Tired of Netflix recommendations? Televisor57%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Tired of Netflix recommendations? Televisor

Hacker News1