Oxen.ai – Fast Unstructured Data Version Control
Oxen.ai – Fast Unstructured Data Version Control
Hi HN! This is Greg, founder of https://oxen.ai . Oxen at it's core is a version control system built from the ground up optimized for machine learning data. Just like other VCS, Oxen can a building block for a lot of workflows. We are a couple ex-IBM Watson engineers who have seen the waves of AI and know the importance of matching the correct data to the correct model deployment in ML workflows. The commands are modeled one-for-one after git, but can handle large unstructured datasets of images, videos, audio, text, as well as tabular data. If you have a few minutes, go to https://github.com/Oxen-AI/oxen-release#-oxen and check it out! Built in Rust, with modern hashing algorithms and network protocols, it can index hundreds of thousands of images, video, audio, text, in seconds. The vision is to help collaboration on data be as easy as collaboration on code. It still feels like we are in the dark ages of iterating on machine learning datasets, downloading zip files, dumping on s3, or using legacy technology like git-lfs. We would also love to see a community grow around open source datasets, just like open source code. There is a web hub at https://www.oxen.ai where you can sign up for free. Let us know what data you are training your models on today! Running models without the proper dataset infrastructure to iterate on can take the "learn" out of machine learning. With Oxen, we help close that loop.
Share cardActual performance
Launch Intel predictions
Analyze your own launch →Correct prediction on native model
Similar products
Version Control Everything
Version control for everyone
I made a version control for embeddings
Version Control for Whiteboards
lakeFS – Version Control for Big Data
Sfizio-Homebrew Version Control Tool
GitImage – Version Control for Images
A version control system based on rsync
Version Control OmniGraffle Files
esdump-rs, a fast and native version of elasticdump