PinnedCompleting the Machine Learning Loop“One day, all software will learn” — but not today. — “One day all software will learn…” How many times have you heard that quote at some machine learning talk? As an ML engineer and researcher over the last decade, I’ve heard it so many times it makes my eyes roll. Because, when you’re applying machine learning to real world problems…Machine Learning17 min readMachine Learning17 min read
Jan 4OpenAI’s ChatGPTA Look at the Fascinating History and Products of the AI Leader — ChatGPT, an artificial intelligence chatbot, is the latest in a series of cutting-edge AI products developed by OpenAI. It has captured the attention of millions of users in the span of a few weeks, since its release on November 30, 2022. In this post, we’ll explore the origins, history and…Chatgpt7 min readChatgpt7 min read
Dec 12, 2022ChatGPT can basically explain PachydermWhat AI can tell us about open source software — ChatGPT is impressive. You don’t have to look very far to find even nontechnical people doing amazing things with it. A testament to itself. Here, I wanted to post a little journey I took with ChatGPT to see what it knows about data processing and more specifically, using Pachyderm, an…Chatgpt5 min readChatgpt5 min read
Published in Pachyderm Community Blog·Jun 30, 2022Pachyderm + Label StudioSimplified Storage and Configuration — Tweaking your algorithm or model architecture is a complete waste of time unless you have high quality, labeled data. More than ever before, continuous improvement in machine learning relies on labeled data. And labeled data usually requires a human in the loop. Tools like Label Studio have become popular for…Data Versioning4 min readData Versioning4 min read
Published in Pachyderm Community Blog·Aug 3, 2021Developing Data-Centric AI Applications with Superb AI Suite & PachydermData has become the new source code, and we need a way to manage it. — Data has become the new source code, and we need a way to manage it. Data is so important that many of the leading practitioners in AI are pushing for data to be at the center of the ML workflow. For many years, code has been at the center of…Data Versioning5 min readData Versioning5 min read
Published in Towards Data Science·Mar 19, 2021The Fall of ImageNetData Privacy and the Challenge of Reproducibility — Last week, I went to work on a machine learning example that used the ever popular ImageNet dataset. It’s the classic image classification problem known by every machine learning practitioner at this point. Here’s an image, classify which of the 1,000 categories it fits in. But I noticed something strange…Image Classification6 min readImage Classification6 min read
Published in Pachyderm Community Blog·Mar 18, 2021Learn More by RememberingClearML + Pachyderm — “Move fast, think even faster,” is the ultimate goal of data science. We all want our AI models to do predictions faster and better than we can do them ourselves. Even more, we want to develop those models at lightspeed. But the reality is often a lot different. Running experiments…Machine Learning6 min readMachine Learning6 min read
Published in Pachyderm Community Blog·Feb 9, 2021Versioning and Labeling — Better TogetherLabel Studio + Pachyderm — The key to building powerful machine learning models is learning “the right things from the right data.” Just as we humans constantly take in new information and update what we think about the world, ML models must continually learn from new data to keep their insights sharp and relevant. …Data Labeling7 min readData Labeling7 min read
Published in Pachyderm Community Blog·Oct 20, 2020Scaling Breast Cancer Detection with PachydermBreast cancer is a horrible disease that affects millions worldwide. In the US and other high-income countries, advances in medicine and increased awareness have significantly improved the survival rate of breast cancer to 80% or higher. …Breast Cancer Detection7 min readBreast Cancer Detection7 min read
Published in Pachyderm Community Blog·Oct 14, 20205 Tips and Tricks: Scaling ML with PachydermI’ve been building machine learning and data processing pipelines with Pachyderm for a while now. It’s an incredibly powerful platform, but as with most things, there are some “gotchas” along the way. …Pachyderm6 min readPachyderm6 min read
