3 Overview Motivations What’s New in 201414/08/12MotivationsThe most popular EL Trend: Collective Inference - disambiguate a set of relevant mentions simultaneously by leveraging the global topical coherence between entitiesA lot of research has been done in parallel in the Wikification community (Bunescu, 2006) - extract prominent ngrams as concept mentions, and link each concept mention to the KBOne important research direction of KBP: “Cold-start”What’s New in 2014Extend English task to Entity Discovery and Linking (full Entity Extraction + Entity Linking + NIL Clustering)Add discussion forums to Cross-lingual tracksShare some source collections and queries with regular and cold-start slot filling tracks, to investigate the role of EDL in the entire cold-start KBP pipelineProvide automatic annotations, reading list, software toolsSome recent in vivo tasks are shown here.Ratinov and Roth used d2w output to aid coreference resolution.For example, knowing that kursk can be a vessel helps link kursk to vessel.WP concepts present in a document help to make document similarity calculation more robust.Also, WP concepts are rich with information including coarse and fine grained properties that can shed light on,for example, a users intent during query formulation.

4 Entity Mention ExtractionIt’s a version of Chicago – the standard classic Macintosh menu font, with that distinctive thick diagonal in the ”N”.Chicago was used by default for Mac menus through MacOS 7.6, and OS 8 was released midChicago VIII was one of the early 70s-era Chicago albums to catch myear, along with Chicago II.

5 Clustering: Cross-doc Coreference ResolutionIt’s a version of Chicago – the standard classic Macintosh menu font, with that distinctive thick diagonal in the ”N”.Chicago was used by default for Mac menus through MacOS 7.6, and OS 8 was released midChicago VIII was one of the early 70s-era Chicago albums to catch myear, along with Chicago II.

6 Linking: Disambiguation to KBIt’s a version of Chicago – the standard classic Macintosh menu font, with that distinctive thick diagonal in the ”N”.Chicago was used by default for Mac menus through MacOS 7.6, and OS 8 was released midChicago VIII was one of the early 70s-era Chicago albums to catch myear, along with Chicago II.

7 Evaluation Measures Added type matching variant into each measure14/08/12Added type matching variant into each measureSome recent in vivo tasks are shown here.Ratinov and Roth used d2w output to aid coreference resolution.For example, knowing that kursk can be a vessel helps link kursk to vessel.WP concepts present in a document help to make document similarity calculation more robust.Also, WP concepts are rich with information including coarse and fine grained properties that can shed light on,for example, a users intent during query formulation.

20 Clustering MeasuresB-cubed is very sensitive to mention extraction errors

21 Cross-lingual Entity LinkingQueryTeamB-cubed+ (%)PRFSpanishHITS178.968.473.2IBM184.081.682.8English60.364.180.677.779.1Both systems followed their English EL approachesIBM achieved similar performance with the top English EDL system (the difficulty level of queries are not comparable)Many Chinese teams chose to focus on English EDL (a cloned version in NLPCC2014 organized by PKU)Tri-lingual EDL in KBP2015

22 What’s New and What Works - Or How to Make My Advisor HappyA roll-coaster-style conversation 12 hours before this presentation…R: I started to question why we are doing all of these…H:  Please don’t tell me all of these are meaningless…R: Did EDL produce any new science?H: Of course! Blabla…blabla…blabla…blabla…and BlablaR: You make me happy

25 Entity Linking to Improve Relation Extraction (Chan and Roth, 2010)DavidCone,aKansasCitynativewasoriginallysignedbytheRoyalsandbrokeintomajorswithteamDavid Brian Cone (born January 2, 1963) is a former Major League Baseball pitcher. He compiled an 8–3 postseason record over 21 postseason starts and was a part of five World Series championship teams (1992 with the Toronto Blue Jays and 1996, 1998, 1999 & 2000 with the New York Yankees). He had a career postseason ERA of He is the subject of the book A Pitcher's Story: Innings With David Cone by Roger Angell. Fans of David are known as "Cone-Heads."Cone lives in Stamford, Connecticut, and is formerly a color commentator for the Yankees on the YES Network.[1]Contents[hide]1 Early years2 Kansas City Royals3 New York MetsPartly because of the resulting lack of leadership, after the 1994 season the Royals decided to reduce payroll by trading pitcher David Cone and outfielder Brian McRae, then continued their salary dump in the 1995 season. In fact, the team payroll, which was always among the league's highest, was sliced in half from $40.5 million in 1994 (fourth-highest in the major leagues) to $18.5 million in 1996 (second-lowest in the major leagues)25

28 Better Meaning RepresentationIt was a pool report typo. Here is exact Rhodes quote: ”this is not gonna be a couple of weeks. It will be a period of days.”At a WH briefing here in Santiago, NSA spox Rhodes came with a litany of pushback on idea WH didn’t consult with Congress.Rhodes singled out a Senate resolution that passed on March 1st which denounced Khaddafy’s atrocities. WH says UN rez incorporates itBen Rhodes(Speech Writer)Go beyond sentence level

29 Select Collaborators from Rich ContextSource: No matter what, he never should have given Michael Jackson that propofol. He seems to think a “proper” court would have let Murray go free.Social RelationMcCain = John_McCainSarah = Sarah_PalinSarah was the nominee for Vice President in the 2008 presidential election alongside John McCainKB:The trial of Conrad Murray was the American criminal trial of Michael Jackson's personal physician, Conrad Murray.

30 Select Collaborators from Rich ContextSource:Mubarak, the wife of deposed Egyptian President Hosni Mubarak, …wifeFamilyKB:Suzanne Mubarak (born 28 February 1941) is the wife of former Egyptian President Hosni Mubarak…

31 Select Collaborators from Rich ContextSource:Hundreds of protesters from various groups converged on the state capitol in Topeka, Kansas today…Second, I have a really hard time believing that there were any ACTUAL “explosives” since the news story they link to talks about one guy getting arrested for THREATENING Governor Brownback.EmploymentPeter BrownbackSam BrownbackKB:Sam Brownback was elected Governor of Kansas in 2010 and took office in January 2011.

32 Select Collaborators from Rich ContextSource:AT&T coverage in GA is good along the interstates and in the major cities like Atlanta, Athens, Rome, Roswell and Albany.Part-wholeRome, GeorgiaRome, ItalyKB:At the 2010 census, Rome had a total population of 36,303, and is the largest city in Northwest [Georgia] and the 19th largest city in the state.

33 Select Collaborators from Rich ContextSource:Going into the big Super Tuesday, Romney had won the most votes, states and delegates, Santorum had won some contests and was second, Gingrich had only one contest.Start-position EventGeorge W. RomneyMitt RomneyKB:The Super Tuesday primaries took place on March 6. Mitt Romney carried six states, Rich Santorum carried three, and Newt Gingrich won only in his home state of Georgia.

40 Popularity Bias If you are called Michael Jordan…Quite impressive, bottleneck: adding more sophisticated contextual features does not help muchWe do not want to level off here

41 A Little Better…Quite impressive, bottleneck: adding more sophisticated contextual features does not help muchWe do not want to level off here

42 Knowledge Gap between Source and KBSource: breaking news/new information/rumorsKB: bio, summary, snapshot of lifeChristies denial of marriage privledges to gays will alienate independents and his “I wanted to have the people vote on it” will ring hollow.Christie has said that he favoured New Jersey's law allowing same-sex couples to form civil unions, but would veto any bill legalizing same-sex marriage in New JerseyTranslation out of hype-speak: some kook made threatening noises at Brownback and go arrestedSamuel Dale "Sam" Brownback (born September 12, 1956) is an American politician, the 46th and current Governor of Kansas.Man Accused Of Making Threatening Phone Call To Kansas Gov. Sam Brownback May Face Felony ChargeConnect/SortBackground KnowledgeLong long time ago there was a fight between MT and distillation; Every one complains about MT; but most complaints are from distillation people…because…We should be ‘guided’ by each other, then we can collaborate and benefit from each other.…MT …a few names…. Not using ie in approriate way… 50% names are not translated correctly so it affects ie performace.

44 Conclusions and Looking ForwardThe new EDL task has attracted much interests from the KBP community and produced some interesting research problems and new directionsKBP2015Improve the annotation guideline and annotation quality of the training and evaluation data setsDevelop more open sources, data and resources for Spanish and Chinese EDLEncourage researchers to re-visit the entity mention extraction problem in the new cold-start KBP settingPropose a new tri-lingual EDL task on a source collection from three languages: English, Chinese and SpanishInvestigate the impact of EDL on the end-to-end cold-start KBP framework; joint inference between EDL and SF