BigData: Reading a twitter feed

John Minkjan

Bigdata is HOT! I made a simple twitter feed reader using BIML. The search term is passed trough the variable SearchTerm. Be aware not to poll twitter every second, twitter will exclude your IP. For most search terms once every hour is enough! The package will only retrieve “new” tweets which are not jet in your table. There is a maximum of 100 tweets per run.
The script uses a ScriptComponentSource. Pay attention to the <IsSynchronous="false" ==> When there are no non-synchronus buffers, the compiler does not emit the CreateNewOutputRows virtual base method (to match the BIDS/SSDT behavior)
Kudos to Scott Curie of Varigence for helping me take this hurdle!