Algorithmia Now Supports Amazon S3 and Dropbox Integrations

Matt Kiser

2 years ago

We know how hard and frustrating it is to have data stored in one location when you need it in another. Wouldn’t it be better to not have to deal with uploading your data to a new service in order to work with it?

That’s why we’re excited to announce the Algorithmia Data Portal. This dedicated I/O hub – a starting point for reading and writing your data from any data source – makes it easy to connect with Amazon S3 and Dropbox to access your data where it’s at. Now, application developers can read their data from an external source, process it using the algorithmic microservices from Algorithmia, and then write the output where it’s needed. No DevOps required.

“Algorithms allow you to gain insights from your data, but without data, what do you need algorithms for?” Diego Oppenheimer says, Algorithmia CEO and co-founder. “That’s why we’re enabling Algorithmia users to access their data where it’s stored, removing the friction of using state-of-the-art algorithms to interpret, and extract insights from data.”

With the Algorithmia Data Portal, we’re addressing one of the core issues of data portability and interoperability. Algorithmia can now retrieve your data on-demand, removing the need for developers to ship or on-board their data in advance. We believe that ingesting, processing, and writing data should be as simple as an API call.

To demonstrate, we’ve created an image processing pipeline in 10-lines of Python code. Simply by connecting to an existing data source, like Amazon S3 or Dropbox, we can easily batch process an entire folder of images. In this demo, we make an API call to our data source to list the files, then make another API call to Algorithmia’s SmartThumbnail microservice. The service processes each image, and then writes a new file to a folder in the same data source.

Learn how to connect, configure, and read/write from your data in a few easy steps with our data portal guides below. If you have any questions or suggestions, please get in touch by email or @Algorithmia.

Don’t use Amazon S3 or Dropbox? No problem. Algorithmia also offers a free hosted data service for storing large files, preserving state, creating collections, and more.

Data Portal Guides

For the algorithm developer, Algorithmia hosted data is perfect for storing trained machine learning models and instantly turning them into a live, scalable API. For more, check out our guides for hosting your NLTK and scikit-learn models on Algorithmia.

By making algorithms composable, interoperable, and portable, algorithms can be written in any supported language, and then made available to application developers where the code is always “on,” and available via a simple REST API.