What is the current status of compatibility with Amazon Elasticsearch for the streaming pipeline? Is there a plan to do this via HTTP? Is it possible to get Amazon to open up their TransportClient endpoint?

As Amazon have not opened up the TransportClient and as there appears to be little movement to support it we are planning on adding HTTP support. The relevant ticket is here. This will hopefully be going into the next Kinesis Release.

Hey @christoph-buente did they mention why exactly it is preferable to use HTTP in place of the TCP interface? At a recent training I went to the Elasticsearch Engineers actually mentioned that the TCP client was more performant than HTTP for pushing data.