Customized News Data Feeds for UK-basedMarket Research Firm

Business Challenge

MarketWatch, a UK-based market research firm, provides decision support and strategy research to clients in the energy domain.
It monitors more than a 1000 companies for business updates and intellectual property for industry analysis.
This was a labor and cost intensive process given the number of companies to track on a daily basis.
MarketWatch approached Contify to explore automation of monitoring so that its teams could focus on higher value tasks of analysis and recommendations.

Challenge

Automate tracking of business relevant updates and patent filings for more than a 1000 companies, organizing them by topic and delivering them as feeds.

Developed a custom program to create headlines and summaries for the updates so readers could easily understand them

Methodology

There were three key challenges that Contify solved while developing this solution for MarketWatch:

Developing and Maintaining Website Scrapers: Of the 1000+ companies, several hundred had dynamic web pages.
But MarketWatch needed updates only for select segments that its clients operated in.
To do this, we developed custom scrapers that fetched information from relevant sections of websites.
Further, we put together a system for maintaining page integration in case the structure of a webpage changed, which happens frequently.
With this process, MarketWatch never misses an update on companies they track. Here’s an example from GE - one of the tracked companies.
MarketWatch needed to get updates only from the ‘Oil & Gas’ section of the GE Newsroom and not from other sections such as ‘GE Capital’.

Removing Irrelevant content: MarketWatch’s clients were not interested in updates about stock calls,
CSR, philanthropic activities of companies, news on sponsorship of sports, or dated conference calls. Using Contify’s custom modules, we easily tweaked our algorithm
to identify such updates and reject them from the news data feed.
Here’s another example: while tracking Siemens, our system removed updates that did not meet the requirements while letting others pass.

Custom processing of patent filings: MarketWatch’s clients needed specific type of patent filings of companies.
A simple extract using API integration wouldn't suffice. So we added an additional layer of filtering to fetch patent filings with predefined keywords
in title. Another challenge was the overtly scientific language of the patent filings. To understand what the patent was about, each document link needed
to be opened. To address this, we developed a module to generate logical headlines and summaries. Here's an example.

Customer Speak

“Through their company data feeds, Contify has provided us with an outstanding service for the past seven years. Contify identifies and sources information which is vital on an ongoing basis for many of our clients to make critical business decisions and strategy.
I am convinced that the quality of Contify’s work has made an important contribution to the competitive effectiveness of the many large organisations we serve.”