Abstract

Internet has transformed the ways that organizations gather, produce and transmit competitive intelligence (CI), especially in the age of big data. This paper introduces a competitive intelligence digest generation method based on LDA topic modelling and representative text extraction. With the incorporated metric of perplexity, the proposed method is capable of automatic grouping of the texts and generating CI digests in an appropriate number of topics. Moreover, the method is applied to the context of BT Plc in the form of a case study, demonstrating its effectiveness in practical use.

Keywords

Notes

Acknowledgements

The work was partly supported by the National Natural Science Foundation of China (71490724/71110107027/71372044) and the Tsinghua-BT Advanced ICT Lab at Tsinghua University. The authors highly appreciate the support and cooperation of BT and Dr. Quan Li at BT China Research Centre for the work.