What’s this Blog about?

Thoughts and techniques concerning all things "real time" that revolve around Data Integration, with a focus on IBM Information Server, especially its features for Information Governance, XML and related technologies.

Select Posts by Area

Select Posts by Area

Follow dsrealtime via email

Enter your email address to follow this blog and receive notifications of new posts by email.

Join 205 other followers

Table of Contents (for reasonably useful Postings!)

Here is a consolidated list of all the posts, by major subject and link only. I was having trouble finding old entries myself! The Categories in the side-bar are useful, but bring up entire posts, not just a summary of the urls within that category. Let’s try this.

I haven’t tried it, but I’ve seen it done via JavaPack, where a java class using HTTP (and used within the Java Client Stage) retrieved items from a remote url, and passed them to the output link as an initial source for the Job. I recall someone trying this with Perl years ago also, but the Perl Stage is no longer generally available on the canvas. Java would likely be the best choice.

Hi Ernie,
Are you planning to get into the world of connecting with Twitter, Facebook and Big Data from DataStage or other Information Server products any time soon?
Also, what do you think would be the best way to access data through LDAP – DataStage or something else?

That’s a wide set of subjects….do you mean “me” personally (get into the world of connecting with…), or as a subject on this blog, or Info Server doing thing with it? 🙂

As for LDAP, best solutions I’ve seen are with JavaPack. Most accomplished Java developers are able to use well-proven libraries to tear thru LDAP easily…..incorporating such logic into a class that is designed for use in DS is then childs play….and you and the java developer’s creativity as to what you want to do with the access (send it down a link, receive it and update LDAP, etc.). If you need java examples I have some on the blog or contact me offline.

I’m flattered, but I don’t think anyone wants to hear my opinions about Facebook and Twitter and such… ; ) …and I’ll leave “big data” to my fellow DataStage experts who get heavily into parallelism and other framework stuff. Actually, the big data thing is interesting, and I’m keeping an eye on it, but at the moment I have my hands full with metadata and governance….but they’re coming together… it won’t be long before data lineage and governance finds its way in the hadoop world…(if it hasn’t already — just seems that the attention is on speeds and feeds and giant volume at the moment).

On Facebook…I dabble…even been experimenting with industry topic based “Groups”…but I don’t get on that often for regular Facebook activity.