Open-source intelligence

The examples and perspective in this article deal primarily with the United States and do not represent a worldwide view of the subject. Please improve this article and discuss the issue on the talk page.(December 2010)

Observation and reporting: amateur airplane spotters, radio monitors and satellite observers among many others have provided significant information not otherwise available. The availability of worldwide satellite photography, often of high resolution, on the Web (e.g., Google Earth) has expanded open-source capabilities into areas formerly available only to major intelligence services.

OSINT is defined by both the U.S. Director of National Intelligence and the U.S. Department of Defense (DoD), as "produced from publicly available information that is collected, exploited, and disseminated in a timely manner to an appropriate audience for the purpose of addressing a specific intelligence requirement."[4]

A wide variety of vendors sell information products specifically within this category.

Open-source intelligence under one name or another has been around for hundreds of years. The significance today of OSINT in the USA is the conflict between military, government, and the private sector as to how the bulk of intelligence should be obtained. With the Internet, instant communications, and advanced media search the bulk of actionable and predictive intelligence can be obtained from public, unclassified sources. Government agencies have been slow to embrace OSINT, or believe they already have suitable information feeds from the media, academia and public records.

OSINT is especially helpful in addressing global coverage, a term encompassing all of the countries and topics that are not considered by the secret or national security worlds to be "vital."

In the private sector, competitive intelligence has become a tool for marketing strategies that focus on strategically prepared information under the direction of private companies or individuals who sell organized information to specific security, law enforcement and military industries, amongst other strategic applications, often on a contractual basis. Governments and civilians both use open source intelligence, both legitimately and illegitimately, the latter being the case with criminals who use information to gain an edge in planning and conducting criminal activities.

There are still opportunities for small and medium businesses to compete in niche markets, but this too is being consolidated by major information providers (e.g.?). OSINT is not a novel concept in media where everyday operations of traditional newsroom methods of operations engage in useful strategies towards obtaining information for unique and original content through investigations of story leads, absent of reliance on formal methods of obtaining inside information through legal documents or basic interview techniques. Investigative journalists use searches, databases, primary interviews, original sources, and leaks (informants/witnesses) who come forward either anonymously or openly, as direct contributors of inside information for journalists. Investigative journalists use specific strategies to obtain information. Sometimes informants come forward on their own to contribute original information that might not otherwise be made available, which often directly contributes to the publication of original feature stories. Such has been the case with regard to many whistle blowers in politics, government, law enforcement and also in commercial, financial and private sectors.

Accredited journalists have some protection in asking questions, and researching for recognized media outlets. Even so they can be imprisoned, even executed, for seeking out OSINT. Private individuals illegally collecting data for a foreign military or intelligence agency is considered espionage in most countries. Of course, espionage that is not treason (i.e. betraying one's country of citizenship) has been a tool of statecraft since ancient times, is widely engaged in by nearly all countries, and is considered an honorable trade.[6] Most countries recognize this, and if their counterintelligence agencies capture a foreign spy, that spy is usually unceremoniously deported or traded back to their homeland (for other spies) after a hostile debriefing; actual execution or refusal to trade back foreign spies with non-official cover would result in consequences in bilateral relations of the gravest possible magnitude, being an extraordinarily hostile act, even if those consequences were unofficially and extrajudicially imposed.[citation needed]

The ever-shifting nature of our intelligence needs compels the IC to quickly and easily understand a wide range of foreign countries and cultures. – … today's threats are rapidly changing and geographically diffuse; it is a fact of life that an intelligence analyst may be forced to shift rapidly from one topic to the next. Increasingly, IC professionals need to quickly assimilate social, economic, and cultural information about a country—information often detailed in open sources.

Open-source information provides a base for understanding classified materials. Despite large quantities of classified material produced by the IC, the amount of classified information produced on any one topic can be quite limited, and may be taken out of context if viewed only from a classified-source perspective. Perhaps the most important example today relates to terrorism, where open-source information can fill gaps and create links that allow analysts to better understand fragmented intelligence, rumored terrorist plans, possible means of attack, and potential targets.

Open-source materials can protect sources and methods. Sometimes an intelligence judgment that is actually informed with sensitive, classified information can be defended on the basis of open-source reporting. This can prove useful when policy-makers need to explain policy decisions or communicate with foreign officials without compromising classified sources.

Only open source can store history. A robust open-source program can, in effect, gather data to monitor the world's cultures and how they change with time. This is difficult, if not impossible, using the snapshots provided by classified collection methods.[7]

Information collection in OSINT is generally a different problem from collection in other intelligence disciplines where obtaining the raw information to be analyzed may be the major difficulty, particularly if it is to be obtained from non-cooperative targets. In OSINT, the chief difficulty is in identifying relevant, reliable sources from the vast amount of publicly available information. However, this is not as great a challenge for those who know how to access local knowledge and how to leverage human experts who can create new tailored knowledge on the fly.[citation needed]

The Foreign Broadcast Information Service (FBIS) was created in 1941 to access and exploit OSINT in relation to World War II. A classic example of their value and success is reflected in the price of oranges in Paris as an indicator of whether railroad bridges had been bombed successfully.

The recent history of OSINT began in 1988 when General Alfred M. Gray, Jr., Commandant of the Marine Corps, called for a redirection of US intelligence away from the collapsing Soviet Union and toward non-state actors and Third World zones of instability. Additionally, he pointed out that most of the intelligence which needs to be known could be obtained via OSINT, and recommended a substantive increase in resources for this aspect of the intelligence collection spectrum of sources.[8]

The Aspin-Brown Commission stated in 1996 that US access to open sources was "severely deficient" and that this should be a "top priority" for both funding and DCI attention.

In issuing its July 2004 report, the 9/11 Commission recommended the creation of an open-source intelligence agency, but without further detail or comment.[9] Subsequently, the WMD Commission (also known as the Robb–Silberman Commission) report in March 2005 recommended the creation of an open-source directorate at the CIA.

Following these recommendations, in November 2005 the Director of National Intelligence announced the creation of the DNI Open Source Center. The Center was established to collect information available from "the Internet, databases, press, radio, television, video, geospatial data, photos and commercial imagery."[10] In addition to collecting openly available information, it would train analysts to make better use of this information. The Center absorbed the CIA's previously existing Foreign Broadcast Information Service (FBIS), originally established in 1941, with FBIS head Douglas Naquin named as director of the Center.[11]

There are a large number of open-source activities taking place throughout the US Government. Frequently, these open-source activities are described as "media monitoring", "media analysis", "internet research" and "public surveys" but are open source nonetheless.

The US Intelligence Community's open-source activities (known as the National Open Source Enterprise) are dictated by Intelligence Community Directive 301 promulgated by the Director of National Intelligence.[16] The Directive establishes the authorities and responsibilities of the Assistant Deputy Director of National Intelligence for Open Source (ADDNI/OS), the DNI's Open Source Center and the National Open Source Committee.

Prior to the establishment of the National Open Source Enterprise, the Foreign Broadcast Information Service (FBIS), established in 1941, was the government's primary open-source unit, transcribing and translating foreign broadcasts. It absorbed the Defense Department's Joint Publications Research Service (JPRS), which did a similar function with foreign printed materials, including newspapers, magazines, and technical journals.

US armed forces are using fake online personas to influence social media opinions.[17] US Air Force had solicited private sector vendors for something called persona management software. Such a technology would allow single individuals to command virtual armies of fake, digital people across numerous social media portals.[18]

The Department of Homeland Security has an active open-source intelligence unit. In congressional testimony before the House Homeland Security Committee's Intelligence, Information Sharing and Terrorism Risk Assessment Subcommittee the Undersecretary of Homeland Security Charles Allen indicated on February 14, 2007, that he had established the "Domestic Open Source Enterprise" to support the Department's OSINT needs and that of state, local and tribal partners.

^Sun Tzu (Warring States period), The Art of War, Chapter 13: "Hostile armies may face each other for years, striving for the victory which is decided in a single day. This being so, to remain in ignorance of the enemy's condition simply because one grudges the outlay of a hundred ounces of silver in honors and emoluments, is the height of inhumanity."