A Look at the Fascinating History and Products of the AI Leader — ChatGPT, an artificial intelligence chatbot, is the latest in a series of cutting-edge AI products developed by OpenAI. It has captured the attention of millions of users in the span of a few weeks, since its release on November 30, 2022. In this post, we’ll explore the origins, history and…

What AI can tell us about open source software — ChatGPT is impressive. You don’t have to look very far to find even nontechnical people doing amazing things with it. A testament to itself. Here, I wanted to post a little journey I took with ChatGPT to see what it knows about data processing and more specifically, using Pachyderm, an…

Simplified Storage and Configuration — Tweaking your algorithm or model architecture is a complete waste of time unless you have high quality, labeled data. More than ever before, continuous improvement in machine learning relies on labeled data. And labeled data usually requires a human in the loop. Tools like Label Studio have become popular for…

Data has become the new source code, and we need a way to manage it. — Data has become the new source code, and we need a way to manage it. Data is so important that many of the leading practitioners in AI are pushing for data to be at the center of the ML workflow. For many years, code has been at the center of…

Data Privacy and the Challenge of Reproducibility — Last week, I went to work on a machine learning example that used the ever popular ImageNet dataset. It’s the classic image classification problem known by every machine learning practitioner at this point. Here’s an image, classify which of the 1,000 categories it fits in. But I noticed something strange…

ClearML + Pachyderm — “Move fast, think even faster,” is the ultimate goal of data science. We all want our AI models to do predictions faster and better than we can do them ourselves. Even more, we want to develop those models at lightspeed. But the reality is often a lot different. Running experiments…

Label Studio + Pachyderm — The key to building powerful machine learning models is learning “the right things from the right data.” Just as we humans constantly take in new information and update what we think about the world, ML models must continually learn from new data to keep their insights sharp and relevant. …

Breast cancer is a horrible disease that affects millions worldwide. In the US and other high-income countries, advances in medicine and increased awareness have significantly improved the survival rate of breast cancer to 80% or higher. However, in many lower-income countries the survival rate is below 40%, largely due to…

I’ve been building machine learning and data processing pipelines with Pachyderm for a while now. It’s an incredibly powerful platform, but as with most things, there are some “gotchas” along the way. …