Tag: S3

Building on last month’s post, for a fixed amount of time, I’m making various API methods discussed on our website freely available. For example, you can GET arxiv figure data using the following curl, where of course the query string must correspond to data in our database: curl -k ‘https://plot2txt-staging.us-east-1.elasticbeanstalk.com/record?type=figure&source=astro&label=temp’ Here we’re requesting figures fromContinue Reading free api methods part 1

For some amount of time (ie., until the bandwidth costs add up 🙂 ) you can download the figures extracted from arxiv documents, during the development and testing of the search API described in prior posts. If you have the AWS CLI installed, getting the figure meta data (from which you can create download URLs)Continue Reading got data?

I’m entering the final stages of a figure search engine, a nice wrapper for the new API method discussed below. It’s also a chance to properly release data mined directly from arxiv figures, and take advantage of the lambda + S3 processing pipeline I developed when pushing the p2t algorithms to cloud initially. Attached isContinue Reading figure meta data

I’ve put some notes together, summarizing the steps involved in taking the p2t backend to AWS. Overall a very intuitive and relatively straightforward process, with very few gotchas; I cover these in these notes (recording below), and in prior blogs. As we prepare for a soft launch/ beta test, and then the collision conference inContinue Reading Soft Launch Prep