Claude and ChatGPT can't do basic operations?

Hacker News

Fascinating experience in trying to get Claude and ChatGPT to do basic data analysis. I pasted a list of 290 locations into each tool and asked each one to tell me the percentage each location represented in the data set as well as a count for each location. Both of them were wildly wrong for different reasons. Claude completely miscounted the number of instances for one location. https://imgur.com/a/ShaORko And then it kind of tried to gaslight me about it. https://imgur.com/a/ehbQ9hu (EDIT) ChatGPT incorrectly counted instances and then reported that one location it said had 189 instances (actually 91) represented 99.47% of the dataset. Other locations had also incorrect percentages and the total percentage was far over 100%. This seems to be because despite identifying the instances individually, it was calculating using a total of 190 instances. https://imgur.com/a/yNcAHZB Presumably this has something to do with the data format, but it was simply a copy-paste from a single column in a Google Sheet, which strikes me as a pretty standard format for data. I also pasted the same data into a different Google Sheet and it behaved normally.

Visit product View on Hacker NewsJan 19, 2024

Share card

Actual performance

2points

Did not reach leaderboard

Launch Intel predictions

Analyze your own launch →

Product HuntOn track for Day 1 leaderboard · Strong signals: claude, google, chatgpt · Missing: mac, agents, macos

65%65% predicted probability of success on Product Hunt, based on ML models trained on real launch data.

best fitHighest predicted score across all platforms for this description.

TrustMRRFits verified-revenue profile · Strong signals: google · Missing: mobile apps, ios, personal

58%58% predicted probability of success on TrustMRR, based on ML models trained on real launch data.

Indie HackersFits the IH revenue-focused audience · Missing: supports, reddit linkedin, podcasting

56%56% predicted probability of success on Indie Hackers, based on ML models trained on real launch data.

Hacker NewsMay not resonate with HN audience · Strong signals: ide, io · Missing: https docs, excited, just released

41%41% predicted probability of success on Hacker News, based on ML models trained on real launch data.

nativeThis product was originally launched on this platform.

AppSumoMay struggle as an AppSumo deal · Missing: plus, platform, intuitive

33%33% predicted probability of success on AppSumo, based on ML models trained on real launch data.

Acquire.comPre-revenue stage for this audience · Missing: arr, mrr, revenue

22%22% predicted probability of success on Acquire.com, based on ML models trained on real launch data.

BetaListMay not resonate with beta-testers · Strong signals: chat · Missing: web3, crypto, cryptocurrency

1%1% predicted probability of success on BetaList, based on ML models trained on real launch data.

Correct prediction on native model

Similar products

Speedrunning Influence Operations with ChatGPT23%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Speedrunning Influence Operations with ChatGPT

Hacker News2

Mongoop – Tame your mongoDB slow operations42%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Mongoop – Tame your mongoDB slow operations

Hacker News1

SuiteOp34%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

One platform, all your lodging operations

Product Hunt+124Productivity

Modou40%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Your AI colleague for business operations.

Indie Hackerscommitment-full-time

Modou67%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Your AI colleague for business operations.

Indie Hackers1ai

Funktors - Array operations using Generics in Golang43%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Funktors - Array operations using Generics in Golang

Hacker News3

Elixir/Unix style pipe operations in Ruby70%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Elixir/Unix style pipe operations in Ruby

Hacker News5

Use ChatGPT, Bing, Bard and Claude in One App20%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Use ChatGPT, Bing, Bard and Claude in One App

Hacker News138

StackOverflow for ChatGPT43%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

StackOverflow for ChatGPT

Hacker News2

This Is How ChatGPT Will Be Monetized27%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

This Is How ChatGPT Will Be Monetized

Hacker News9

Browse all products Analyze your launch