Review and merge open source data science
Review and merge open source data science
Hey HN! I'm Dean, one of the creators of DAGsHub, a place to host data science projects. DAGsHub lets you track experiments, data, models, and code, with Git. I want to share something we've been working on – Data Science Pull Requests (DS PRs) – expanding Pull Requests (PRs) to include data, models, and experiments. We wanted to create DS PRs to automate the data science review process and enable Open Source Data Science (OSDS). If you've worked on a data science project with other people or tried reviewing someone else's data science work, you know how hard it is to get the information you need in order to understand someone else's work or explain your own to make the review process meaningful. OSDS has the potential to change the world as OSS did, but let's face it – OSDS doesn't really exist. If you maintain an OSDS project and want to accept pull requests – you have to do it almost entirely manually or resort to accepting only code changes (no way to accept data bug fixes). On the other side, if you want to improve your ML portfolio by contributing to some OSDS project, you're also stuck. You can either fork the project and not contribute your work (which means it’s never reviewed – you don't learn as much) or go through a painstaking manual effort. DS PRs let you: - Review, compare, and comment on experiments (metrics, parameters, visualizations), in the context of your PR. - See what data and models have changed (not just code) - Compare and diff notebooks - After review, merge code, data, and models all at once. We're building DAGsHub to be a community-first data science platform. That means you can easily discover and contribute to data science projects created by others, not only by improving code but also by improving data. This has the potential to make ML work better, for everyone. There is a lot of work to do. Your input would be greatly appreciated! https://dagshub.com/docs/collaborating_on_dagshub/data_science_pull_requests/
Share cardActual performance
Launch Intel predictions
Analyze your own launch →Incorrect prediction on native model
Similar products
An Open-Source Data Science Curriculum
LynxKite, an open source graph data science platform
Culll for data science
Data science glossary
What are the essentials of Data Science?
Data Science Congress 2020
Show HN - DataTau, The HN For Data Science
Domino, a PaaS for data science
Data Science in your browser
Open-Source No-Code Platform for Machine Learning and Data Science