DataSift And Its Data Center Plans

DataSift is a five year old big data company known best for mining several billion tweets and Wiki edits. The company states that it is around 1 year away from building its own data center. DataSift holds 90 billion tweets on Hadoop servers and also has around 100 per second of Wikistats records edits. According to the CTO of DataSift, Nick Halstead, the costs and the complexity involved in the present operations of the way the company uses colo and mixed services for data can only mean that a data center is in the pipeline sooner rather than later.

According to Halstead, the company cannot afford to run on Amazon from a performance and cost perspective. DataSift will be following in the footsteps of companies like Facebook and eBay who have built their own data centers. But what makes it different for the company that it will be the youngest and smallest company to do so.

2 comments

[…] ensure that they fill up. However, the critical question here is its degree of greenness. The term Big Data has come up only in the recent past. Before that however, it was nothing but analytics. This […]

[…] results like reduced costs and better data center hardware. Open Rack is a test case for the Facebook approach to data center design. Open Compute is a project that designs electrical subsystems, […]