EmuBert – the first open encoder model for Australian law

Hacker News

Hey HN, I'm excited to share one of my most ambitious projects yet, EmuBert. EmuBert is the largest and most accurate open-source masked language model for Australian law. Trained on 180,000 laws, regulations and decisions across six Australian jurisdictions, totalling 1.4 billion tokens, taken from the Open Australian Legal Corpus, the largest open-source database of Australian law, EmuBert is well suited for tasks like: ⦁ Text classification; ⦁ Name extraction; ⦁ Question answering; ⦁ Text similarity; ⦁ Semantic search; and ⦁ Text embedding. Not only that but, despite only being trained to guess missing words, EmuBert seems to know facts such as that Norfolk Island is an Australian territory (try the prompt, 'Norfolk Island is an Australian <mask>.'), it is Section 51 of the Constitution that grants Parliament the power to make laws for the peace, order, and good government of the Commonwealth ('Section <mask> of the Constitution grants the Australian Parliament the power to make laws for the peace, order, and good government of the Commonwealth.'), and that the representative of the monarch of Australia is the Governor-General ('The representative of the monarch of Australia is the <mask>-General.'). Finally, EmuBert achieves a perplexity of 2.05 on the Open Australian Legal QA, the first open dataset of Australian legal questions and answers, outperforming all known state-of-the-art masked language models, including Roberta, Bert and Legal-Bert. You can check out EmuBert on Hugging Face here: https://huggingface.co/umarbutler/emubert The code I used to create EmuBert is also openly available on GitHub: https://github.com/umarbutler/emubert-creator

Visit product View on Hacker NewsMay 14, 2024

Share card

Actual performance

2points

Did not reach leaderboard

Launch Intel predictions

Analyze your own launch →

Product HuntOn track for Day 1 leaderboard · Strong signals: model, models, perplexity · Missing: mac, agents, macos

84%84% predicted probability of success on Product Hunt, based on ML models trained on real launch data.

Hacker NewsStrong engagement from HN community · Strong signals: excited, 000, io · Missing: https docs, just released, exist

83%83% predicted probability of success on Hacker News, based on ML models trained on real launch data.

nativeThis product was originally launched on this platform.

Indie HackersFits the IH revenue-focused audience · Strong signals: including · Missing: supports, reddit linkedin, podcasting

79%79% predicted probability of success on Indie Hackers, based on ML models trained on real launch data.

TrustMRRLess likely to generate early MRR · Strong signals: answers · Missing: mobile apps, ios, personal

43%43% predicted probability of success on TrustMRR, based on ML models trained on real launch data.

AppSumoMay struggle as an AppSumo deal · Missing: plus, platform, intuitive

34%34% predicted probability of success on AppSumo, based on ML models trained on real launch data.

Acquire.comPre-revenue stage for this audience · Missing: arr, mrr, revenue

15%15% predicted probability of success on Acquire.com, based on ML models trained on real launch data.

BetaListMay not resonate with beta-testers · Missing: web3, chat, crypto

1%1% predicted probability of success on BetaList, based on ML models trained on real launch data.

Incorrect prediction on native model

Similar products

Discussion with Milton Friedman's Grandson about Polycentric Law67%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Discussion with Milton Friedman's Grandson about Polycentric Law

Hacker News1

I built the first open LLM for Australian law64%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

I built the first open LLM for Australian law

Hacker News40

west palm beach dui lawyer31%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Check out the law firm in Fort Lauderdale.

Indie Hackersvertical-social-media

TheLawGPT24%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Law, simplified by AI

Product Hunt

Stanzione & Associates56%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Intellectual Property Law Firm

Indie Hackersvertical-legal

how I built the largest open database of Australian law65%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

how I built the largest open database of Australian law

Hacker News172

Slaughter & Lupton.com46%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Slaughter & Lupton law team

Indie Hackers

Q&A with AI Trained on Bankruptcy Law36%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Q&A with AI Trained on Bankruptcy Law

Hacker News3

I created a first-of-its-kind open corpus of Australian law66%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

I created a first-of-its-kind open corpus of Australian law

Hacker News3

Wheatbin – Open Source Kanban Based on the Law of the Harvest73%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Wheatbin – Open Source Kanban Based on the Law of the Harvest

Hacker News5

Browse all products Analyze your launch