Anitag2vec – Tag set embedding for ranking recommendations
Anitag2vec – Tag set embedding for ranking recommendations
I've been experimenting with using a tiny Transformer encoder without positional encoding a replacement for standard Deep Sets (permutation-invariant MLPs). The intuition: while Deep Sets are theoretically cleaner, a Transformer encoder naturally picks up on tag co-occurrence and spelling variations that sum-pooling layers often miss. I have trained this on anime/imageboard tags for now. Interestingly, even when testing on absolute nonsense/out-of-distribution tags, the model holds up fairly well. It seems to develop a strong sense of permutation invariance, with cosine scores remaining robust even when comparing sets to their subsets. Curious to hear if anyone else has experimented with stripping PEs from Transformers for set-based tasks.
Share cardActual performance
Launch Intel predictions
Analyze your own launch →Correct prediction on native model
Similar products
Anitag2vec – tag embeddings for recommendations
RankFight – We're Ranking Everything
Covid-19 infection ranking adjusted by population
You're ranking for searches you never wrote about.
Embedding visualizations for bloggers and journalists – VizFiddle
Visualizing and Comparing Embedding Vectors as Heatmaps
Implementing Embedding Gemma in PyTorch
EmbedFlow –> Upgrade embedding models without re-embedding your corpus
Quora for Recommendations
Tired of Netflix recommendations? Televisor