Build a SQLite satabase from your Reddit data
Build a SQLite satabase from your Reddit data
With Reddit's upcoming API changes[0], I got nervous that I'd no longer be able to access the many posts and comments I've left there over the years. Inspired by the Dogsheep projects[1], this CLI lets you immediately pull your most recent 1k comments & 1k posts (the max allowed by the paged API) into a nicely-structured SQLite database. It's perfect for loading into Datasette for nice viewing & full-text search of your content. Taking it a step further, the project's killer feature is the ability to import data from GDPR archives. This allows you to store your full Reddit history (including deleted comments and posts on removed subreddits). I hope you find this tool useful! I'll be around to answer questions and field comments (or feel free to open a GH issue). [0]: https://old.reddit.com/r/reddit/comments/12qwagm/an_update_r... [1]: https://dogsheep.github.io/
Share cardActual performance
Launch Intel predictions
Analyze your own launch →Incorrect prediction on native model
Similar products
Policing the Police with Scraped Data – Started on Reddit/HN
My attempt at a decentralised Reddit
Reddit Imgur Uploader
Reddit 1.0
Afroic – The African Reddit
Dumppit – A Reddit Firehose
Reddit Firehose
Bleuit – A Recursive Reddit
I scraped 5k Reddit, G2, Capterra and Upwork complaints
Rockets – Reddit and websockets