Abstract

Methods and systems are provided for recognizing names entered into a computer-generated document in the context of a plurality of spoken languages and for providing helpful actions to users upon the recognition of the entered names.

Description

FIELD OF THE INVENTION

The present invention relates generally to text recognition in computer-generated documents. More particularly, embodiments of the present invention relate to methods and systems for recognizing names from a plurality of languages entered into computer-generated documents and for providing helpful actions for use in association with recognized names.

BACKGROUND OF THE INVENTION

Since the advent of the computer and software age, software developers have attempted to provide helpful functionality to software users that is contextual in nature. For example, software has been developed for detecting that a user is entering a date into a computer-generated document as the user is typing the date. Before the user can complete the date, the software application popsup today's date to the user and offers to automatically complete the date for the user. Other software has been developed for offering users helpful actions in response to certain data entered by the user. For example, if the user's word processor application recognizes that the user has entered a date, the user may be offered an action that will launch the user's electronic calendar to allow the user to check appointments or to verify information in her calendar for the entered date.

It would be helpful to users to provide them with actions applicable to names entered in computer-generated documents such as contacts documents, word processing documents, spreadsheet documents, slide presentation documents, calendaring documents, and the like. Unfortunately, names are very difficult to recognize because often names are not distinguishable from any other word in a sentence. And, often names have particular meaning in a relation to the language context in which they are entered. Because of the great diversity of name origins, names may be typed into a document written in one language, for example English, but the name may have its origins in a separate language, for example Chinese.

In addition, modern desktop operating systems are provided with various localization features for improving usability for users throughout the world. For instance, some desktop operating systems provide support for multiple user interface languages. Through this type of support for multiple user interface languages, users can configure the user interface of the operating system, for example, a keyboard, to operate in any of a number of languages supported by the host operating system. Additionally, many application programs also support the use of multiple languages for international users. For example, a word processing program or spreadsheet application program may allow a user to create documents in English, Thai, Vietnamese, or other languages installed in the operating system and enabled by the user. Documents may also be created that contain text or other information in a combination of languages. In fact, international users of such applications frequently create documents that include text in more than one language. Different languages often have vastly different grammatical rules for presenting names. For example, some languages commonly place certain titles before names. Some languages commonly place province or location designation after names.

Accordingly, there is a need for a method and system for recognizing names entered into computer-generated documents according to a variety of different languages and language grammatical rules and for providing helpful actions to a user associated with recognized names. It is with respect to these and other considerations that the present invention has been made.

SUMMARY OF THE INVENTION

Embodiments of the present invention provide methods and systems for recognizing names entered into a computer-generated document in the context of a plurality of spoken languages and for providing helpful actions to users upon the recognition of the entered names.

Generally, a user enters text using a host software application such as a word processor application, a spreadsheet application, a contacts application, a calendaring application, a slide presentation application, and the like. Text entered by the user is passed to a recognizer application. Along with the text, a language designation for the text is passed by the host application if a language designation is known. The recognizer application may be a dynamically-linked library (DLL) application. At the recognizer application, the text is passed to a name recognizer application. The name recognizer may be a separate application plug-in that is associated with the recognizer application, or the name recognizer application may be integrated with the recognizer application.

If the language of text is known, the name recognizer application first breaks the text into words. If the text is not already set out in separate words by known delimiters such as spaces or punctuation marks associated with the known language, the name recognizer may pass the text to a word breaker application for breaking the text into words. According to an embodiment of the present invention. The word breaker application may be integrated with the name recognizer application. Alternatively, the word breaker application may be a separate application that may be called by the name recognizer application when needed.

Once the text is broken into separate words, the name recognizer application applies the grammatical rules of the known language to isolate names from the other words of the text. If one or more names are isolated, they are compared against the user's local or remote contact list for matching names. If the isolated names do not match names contained in a contacts list, the words may be compared against a larger database of names including, for example, names particular to the known language. Alternatively, words of the text may be confirmed as names where the analysis of the words based on the grammatical rules of the known language provides a high probability that a given word or words is a name. Once a word is confirmed as a name, by one of these comparisons or analyses, the name is returned by the recognizer application to the host application. The host application may then tag the name and call on the services of one or more action applications for providing helpful actions to the user when the user subsequently focuses her computer cursor or mouse pointer on the tagged name. For example, the user may be provided actions such as adding the name to a contacts list, deleting the name from a contacts list, sending an email message to the name, and the like.

If the language of the text passed to the recognizer application is not known, the text is broken into words as described above, and each word of the text may be compared directly against a contacts list or larger database of names to determine whether any of the words or combination of words comprise a name. If it may be determined that one or more of the words do comprise a name, the name is returned to the host application, as described above, and helpful actions may be provided in association with the name.

These and other features and advantages, which characterize the present invention, will be apparent from a reading of the following detailed description and a review of the associated drawings. It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the invention as claimed.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a block diagram showing the architecture of a personal computer that provides an illustrative operating environment for embodiments of the present invention.

FIG. 2 is a block diagram that shows software architecture for recognizing, labeling, and performing actions on strings of text according to various embodiments of the present invention.

FIG. 3 illustrates a simplified block diagram showing interaction between a host application and a recognizer application and action application for recognizing, labeling, and performing actions on names entered into text according to embodiments of the present invention.

FIG. 4 is a screen diagram showing an exemplary host application text entry screen and showing text entered and recognized as a name according to embodiments of the present invention.

FIGS. 5 and 6 are flow diagrams showing an illustrative routine for recognizing a name in text entered into a computer-generated document and for providing helpful actions associated with the recognized name.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT

As described briefly above, embodiments of the present invention are directed to methods and systems for recognizing names entered according to a variety of different languages and grammatical rules and for providing helpful actions to a user associated with recognized names. In the following detailed description, references are made to the accompanying drawings that form a part hereof, and in which are shown by way of illustrations specific embodiments or examples. These embodiments may be combined, other embodiments may be utilized, and structural changes may be made without departing from the spirit or scope of the present invention. The following detailed description is therefore not to be taken in a limiting sense and the scope of the present invention is defined by the appended claims and their equivalents.

Referring now to the drawings, in which like numerals represent like elements through the several figures, aspects of the present invention and the exemplary operating environment will be described. FIG. 1 and the following discussion are intended to provide a brief, general description of a suitable computing environment in which the invention may be implemented. While the invention will be described in the general context of program modules that execute in conjunction with an application program that runs on an operating system on a personal computer, those skilled in the art will recognize that the invention may also be implemented in combination with other program modules. Additional aspects of an illustrative operating environment and software architecture for implementing the various embodiments of the present invention are described in U.S. patent application Ser. No. 09/588,411, entitled “Method and System for Semantically Labeling Strings and Providing Actions Based on Semantically Labeled Strings”, which is expressly incorporated herein by reference.

Generally, program modules include routines, programs, components, data structures, and other types of structures that perform particular tasks or implement particular abstract data types. Moreover, those skilled in the art will appreciate that the invention may be practiced with other computer system configurations, including hand-held devices, multiprocessor systems, microprocessor-based or programmable consumer electronics, minicomputers, mainframe computers, and the like. The invention may also be practiced in distributed computing environments where tasks are performed by remote processing devices that are linked through a communications network. In a distributed computing environment, program modules may be located in both local and remote memory storage devices.

Turning now to FIG. 1, an illustrative computer architecture for a personal computer 2 for practicing the various embodiments of the invention will be described. The computer architecture shown in FIG. 1 illustrates a conventional personal computer, including a central processing unit 4 (“CPU”), a system memory 6, including a random access memory 8 (“RAM”) and a read-only memory (“ROM”) 10, and a system bus 12 that couples the memory to the CPU 4. A basic input/output system containing the basic routines that help to transfer information between elements within the computer, such as during startup, is stored in the ROM 10. The personal computer 2 further includes a mass storage device 14 for storing an operating system 16, application programs, such as the application program 205, and data.

The mass storage device 14 is connected to the CPU 4 through a mass storage controller (not shown) connected to the bus 12. The mass storage device 14 and its associated computer-readable media, provide non-volatile storage for the personal computer 2. Although the description of computer-readable media contained herein refers to a mass storage device, such as a hard disk or CD-ROM drive, it should be appreciated by those skilled in the art that computer-readable media can be any available media that can be accessed by the personal computer 2.

By way of example, and not limitation, computer-readable media may comprise computer storage media and communication media. Computer storage media includes volatile and non-volatile, removable and non-removable media implemented in any method or technology for storage of information such as computer-readable instructions, data structures, program modules or other data. Computer storage media includes, but is not limited to, RAM, ROM, EPROM, EEPROM, flash memory or other solid state memory technology, CD-ROM, DVD, or other optical storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other medium which can be used to store the desired information and which can be accessed by the computer.

According to various embodiments of the invention, the personal computer 2 may operate in a networked environment using logical connections to remote computers through a TCP/IP network 18, such as the Internet. The personal computer 2 may connect to the TCP/IP network 18 through a network interface unit 20 connected to the bus 12. It should be appreciated that the network interface unit 20 may also be utilized to connect to other types of networks and remote computer systems. The personal computer 2 may also include an input/output controller 22 for receiving and processing input from a number of devices, including a keyboard or mouse (not shown). Similarly, an input/output controller 22 may provide output to a display screen, a printer, or other type of output device.

As mentioned briefly above, a number of program modules and data files may be stored in the mass storage device 14 and RAM 8 of the personal computer 2, including an operating system 16 suitable for controlling the operation of a networked personal computer, such as the WINDOWS XP operating system from MICROSOFT CORPORATION of Redmond, Wash. The mass storage device 14 and RAM 8 may also store one or more application programs. In particular, the mass storage device 14 and RAM 8 may store an application program 205 for creating and editing an electronic document 24. For instance, the application program 205 may comprise a word processing application program a spreadsheet application, a contact application, and the like. Application programs for creating and editing other types of electronic documents may also be used with the various embodiments of the present invention.

Embodiments of the present invention provide program modules for use in conjunction with the application program 205 that recognize names in entered text and provide helpful actions on the recognized names. In particular, embodiments of the invention provide a recognizer plug-in 220 and an action plug-in 225. As will be described in greater detail below, the recognizer plug-in 220 recognizes names in an electronic document 24 and labels the names with semantic information. The name recognizer plug-in 220A then passes this information to the application program 205 for use by the action plug-in 225. The action plug-in 225 performs actions on the recognized names.

According to various embodiments of the present invention, the action plug-in 225 may also generate a list of actions that may be performed on a given name. As a part of this process, the action plug-in 225 may query language settings 26 of the application program 205 or operating system 16. The language settings 26 specify the current user interface language and the currently installed and enabled languages for the application program 205 and the operating system 16. The list of actions may then be customized based on the current user interface language and the installed languages. Additional details regarding the operation of the recognizer plug-in 220 and the action plug-in 225, including the use of the language settings 25 will be described in greater detail below.

Referring now to FIG. 2, an illustrative software architecture for use in conjunction with the various embodiments of the present invention will be described. The architecture shown in FIG. 2 includes an application program 205, such as a word processor application program, a spreadsheet application program, or other type of application program for creating and editing electronic documents. The application program 205 may also comprise a Web browser.

The application program 205 is able to communicate with a recognizer dynamically linked library (“DLL”) 210 and an action DLL 215. As will be described in greater detail below, the recognizer DLL 210 controls one or more recognizer plug-ins 220A-220N and the action DLL 215 controls one or more action plug-ins 225A-225N.

According to one embodiment of the invention, the recognizer plug-ins 220A-220N and the action plug-ins 225A-225N are automation servers. Automation servers are well-known software components that are assembled into programs or add functionality to existing programs running on the WINDOWS XP operating system from MICROSOFT CORPORATION of Redmond, Wash. Automation servers may be written in a variety of computing languages and can be plugged and unplugged at runtime without having to recompile the host program.

The recognizer DLL 210 handles the distribution of text strings from an electronic document being edited by the application program 205 to the individual recognizer plug-ins 220A-220N. The recognizer plug-ins 220A-220N recognizes particular strings in an electronic document, such as a word processing document or a spreadsheet document. The recognizer plug-ins 220A-220N may be packaged with the application program module 205 or they may be written by third parties to recognize particular strings of interest. Typically, the recognizer DLL 210 passes strings to the recognizer plug-ins 220A-220N in single paragraphs or cell value increments. However, strings may be passed to the recognizer plug-ins 220A-220N in other sizes and formats.

As part of recognizing certain strings as including semantic information, the recognizer plug-ins 220A-220N determine which strings are to be labeled and how they are to be labeled. After receiving these results from the various recognizer plug-ins 220, the recognizer DLL 210 sends semantic categories to the application program module 205. According to one actual embodiment of the invention, a name recognizer plug-in 220A is provided for recognizing strings as containing names. Additionally, the recognizer plug-in 220 may return information identifying the location of the name within the text string, including the length of the name.

It should be appreciated that each of the recognizer plug-ins 220A-220N are executed separately. The recognizer DLL 210 is responsible for handling the asynchronicity that results from different recognizer plug-ins 220A-220N returning results at different times. In this manner, various types of data may be recognized within a text string and different actions provided for each semantically labeled string. Additional details regarding the operation of the recognizer plug-in 220 for recognizing numbers will be described below with reference to FIGS. 3-6.

After a string is labeled by a recognizer plug-in 220A-220N, schema information is sent to the application program module 205. A user of the application program module 205 may then execute actions that are associated with the schema information on the recognized string. The action DLL 215 manages the action plug-ins 225A-225N that are executed in order to perform the actions. As with the recognizer plug-ins 220A-22N, the action plug-ins 225A-225N may be packaged with the application program module 205 or written by third parties to perform particular actions that are of interest. The action plug-ins 225A-225N provide possible actions to be presented to the user based upon the schema information, or type label, associated with the string. As will be described in greater detail below, the list of actions provided to the user is dynamically generated for each schema type. This information is then provided to the application program 205 that displays the list of actions to the user when the string is selected.

After an action has been chosen from the list of actions, the action DLL 215 manages the appropriate action plug-in 225A-225N and passes the necessary information between the action plug-in and the application program module 205 so that the action plug-in may execute the desired action. Typically, the application program module 205 sends the action DLL 215 an automation request to invoke the action the user has selected. As will be described in greater detail below, according to one embodiment of the invention, an name action plug-in 225A is provided that provides actions on recognized names. Addition details regarding the operation of the action plug-in 225 will be described in greater detail below with reference to FIGS. 3-6.

FIG. 3 illustrates a simplified block diagram showing interaction between a host application, a recognizer application and an action application for recognizing, labeling, and performing actions on names entered into text according to embodiments of the present invention. According to embodiments of the present invention, and as briefly described above, text entered using the host application 205 is passed to the recognizer DLL 210 that serves as a distribution point for passing text to other recognizer functionality such as the recognizer plug-ins 220A through 220N. According to embodiments of the present invention, the text passed from the host application is directed from the recognizer DLL 210 to a name recognizer 220A. As described above with reference to FIG. 2, the name recognizer 220A may be a plug-in module that is plugged into the recognizer DLL 210 for providing particular functionality, in this case, recognition of names written using a variety of languages.

Referring still to FIG. 3, the name recognizer DLL 220A may compare words in the text received from the host application against a contacts list 330 or against a larger name database 340 to find a matching name. A suitable contacts list database 330 is provided by the Outlook® software application provided by Microsoft Corporation of Redmond, Wash. The name database 340 may include a large database of known names used according to a variety of different languages. Additionally, the name database 340 may also include a list of predictable names associated with particular languages. For example, as is well known to those skilled in the art, certain countries and associated languages have small numbers of names distributed among the populations of those countries. According to embodiments of the present invention, as described in detail below, if the language in which the text is entered is known, that information may be utilized by the name recognizer DLL 220A to compare words against names contained in the database 340 where it is known that certain names associated with the language in which the text is written are common.

Also shown in FIG. 3 is a word breaker application 320. According to embodiments of the present invention, the text received by the name recognizer DLL 220A may be broken into words according to the language in which the text is written. That is, as is well known to those skilled in the art, some languages such as English, Arabic, Hebrew and Hindi use spaces and other delimiters such as punctuation marks to separate words. If text is received by the name recognizer DLL 220A that is already broken into discrete words, the name recognizer 220A may use those words to compare against the contacts list 330 and the name database 340. If the text received by the name recognizer DLL 220A is not broken into discrete words according to the language in which the text has been created, the name recognizer DLL 220A may pass the text to a word breaker application 320 to break the text into discrete words that may be used by the name recognizer DLL 220A for comparison against the contacts list 330 and the name database 340. According to one embodiment of the present invention, the word breaker application 320 may be integrated with the name recognizer DLL 220A. Alternatively, the word breaker application 320 may be a separate application that may be called by the name recognizer application 220A when needed.

According to an embodiment of the present invention, if the language in which the text is created is known, the name recognizer DLL 220A may utilize the grammatical rules and sentence structure rules of the known language to assist the name recognizer DLL 220A in determining which words, if any, in the text received from the host application 205 comprise names. As is known to those skilled in the art, computer operating systems may be configured to allow computers to receive user input and to provide data output according to a variety of different languages. Likewise, host applications 205 often may be configured to receive data input and to provide data output according to a variety of different languages. Accordingly, if the user of the host application 205 configures her computer and the host application 205 to receive data input and to provide data output in a language such as Vietnamese, for example, the host application 205 may pass the designated language to the recognizer DLL 210 along with the text for determining whether any words in the text comprise a name. If the language is known by the name recognizer 220A, the rules of that language may be utilized by the name recognizer 220A to determine whether a word or words comprise a name. For example, if a particular language requires or commonly presents a standard word immediately preceding a name, such as a title noun like “Mr., Ms., Mrs.,” and the like, the name recognizer 220A may utilize that rule in association with the known language to determine that a high probability exists that the word or words immediately following the title noun comprise a name.

Generally, a variety of different grammatical and sentence structure rules exist for many different languages utilized by users of the host application 205. Some languages including English, Arabic, Hebrew and Hindi, utilize word delimiters such as spaces and punctuation marks to separate one word from another. However, these languages don't require or predominately utilize specific grammatical or sentence structure rules relative to names, such as the formal inclusion of a title noun prior to a name, or the inclusion of a province or a location designator after a name. For languages such as these, the name recognizer DLL 220A may know the designated language, but in the absence of specific name oriented rules to the assist the name recognizer DLL, the individual words of text for these languages is compared against the name databases, such as the contacts list 330 and the larger name database 340.

Other languages such as the That language are very formal in nature and typically require or predominately utilize name prefixes or title nouns prior to names, such as Mr. Mrs., Miss, boy, girl, or greeting. For languages such as the That language, the word breaker application 320 may be programmed with a dictionary of the name prefixes or title nouns so that the word breaker application 320 in conjunction with the name recognizer DLL 220A may isolate name prefixes or title nouns in text provided by the host application 205 in order to track a word or words following the name prefix to determine whether those words comprise a name. Other indicators may be utilized by the name recognizer 220A such as the common or maximum numbers of characters, such as vowels and consonants, utilized by a language such as the That language for construction of a name. Inclusion of certain words in some languages may also be used to create an ambiguity by the name recognizer 220A and thus reject a word or words as a name. For example, if a conjunctive word such as “and” or “or” is utilized between two words following a name prefix, for example “Mr. Joe & Sara Smith,” the inclusion of the conjunctive word “and” may be utilized by the name recognizer 220A to determine that the words following the name prefix do not comprise a whole name. Accordingly, nothing will be returned by the name recognizer to the host application 205.

Other languages require or commonly utilize province or location designations immediately following a name. For example, “send this document to Joe Smith of Atlanta” includes a province or location designator of “of Atlanta” immediately following the name. In the case of royal descendents in certain languages, province names such as “Duke of York” or “Prince of Wales” immediately follow names. In either of these cases, the name recognizer 220A may be programmed in conjunction with the word breaker application 320 to recognize province or location designations and then to look to a word or words immediately preceding the province or location designation as having a high probability of comprising a name.

Still other languages, such as the Vietnamese language, typically include family clan names such as “Bui”, or “Phong” immediately preceding a name. Because the number of family clan names is relatively small, the known clan names associated with the language, such as Vietnamese, may be utilized by the word breaker application 320 and the name recognizer 220A for determining whether words immediately following a known clan name comprise a name. In many Far East languages, a relatively small number of common names are held by a majority of the populations originating under those languages. For example, the name “Kim” is a very common name in the Korean population and under the Korean language. Accordingly, common names utilized in such languages may be stored in memory and may be utilized by the word breaker application 320 in conjunction with the name recognizer 220A to quickly compare words of text received from the host application 205 to a list of known common names associated with a known language. In any of the above cases, other general rules may apply. For example, in many languages names are capitalized. Such general rules may be used in conjunction with other more particular rules to assist the name recognizer 220A in confirming that a word of text received from the host application 205 comprises a name.

FIG. 4 is a screen diagram showing an exemplary host application text entry screen and showing text entered and recognized as a name according to embodiments of the present invention. As shown in the exemplary text entry screen 400 of a host application 205, a text string 410 including “please send this document to Joe Smith” is provided. According to embodiments of the present inventions, this text string is passed to the name recognizer 220A via the recognizer DLL 210. According to embodiments of the present invention, the word breaker application 320 is utilized by the name recognizer DLL 220A to parse the text string into individual words. If need be, the word breaker application 320 may parse the text string one character at a time by passing combinations of characters back to the name recognizer DLL 220A for comparing against the databases 330, 340. The word breaker application may also use delimiters such as spaces between the combinations of characters to determine the beginning and ending of individual words. The name recognizer DLL 220A recognizes that the words “Joe Smith” comprise a name and passes those words back to the host application 205 tagged as a name. In response, the words “Joe Smith” in the text string are marked in some manner, such as the underlined marking shown in FIG. 4, to indicate to the user that these words have been associated with some type of additional functionality.

According to an embodiment of the present invention, once the user focuses her computer cursor or mouse pointer over the tagged words, the action DLL 225A associated with names may cause the action window 420 to be opened to provide actions to the user in association with the tagged name. As shown in FIG. 4, the action window 420 includes two actions including “send mail” and “add to contacts.” Accordingly, the user may select one of the provided actions to launch the functionality associated with the action. For example, if the user selects the “add to contacts” action, the user's contacts list provided by the user's calendaring program may be launched to allow the user to add the name “Joe Smith” to the user's contacts list.

Referring still to FIG. 4, a second text string 430 “pleasesendthisdocumenttoJoeSmithofAtlanta” is provided. According to the illustration shown in FIG. 4, this text string has been created according to a language that does not use any type of word delimiters such as spaces or punctuation marks to separate words in the text string. Additionally, the text string 430 includes a province designator “of Atlanta” immediately following the name “Joe Smith”. According to embodiments of the present invention, the word breaker application 320 is utilized by the name recognizer DLL 220A to parse the text string into individual words. If need be, the word breaker application 320 may parse the text string one character at a time by passing combinations of characters back to the name recognizer DLL 220A for comparing against the databases 330, 340. Moreover, as described above with reference to FIG. 3, the name recognizer DLL 220A may have received with the text string an indication of the language in which the text string has been created. The name recognizer DLL 220A then may determine that the language in which the text string is created commonly requires or presents province or location identifiers such as “of Atlanta” immediately following a name. The name recognizer DLL 220A then may use this information to determine that the words “Joe Smith” immediately preceding the province or location identifier “of Atlanta” comprise a name. Because the words “Joe Smith” are passed back to the host application 205 as a name, the action DLL 225A causes the action window 440 to be presented to the user when the user focuses on the marked name “Joe Smith” in the text string 430, as described above. As should be understood, the action items shown in the action windows 420 and 440 are only a small sampling of the actions that may be made available to the user. Other actions include “scheduling and meeting”, “inserting address”, and the like.

FIGS. 5 and 6 are flow diagrams showing an illustrative routine for recognizing a name in text entered into a computer-generated document and for providing helpful actions associated with the recognized name. The method 500 begins at start step 505 and moves to step 510 where a database of names is built for use by the name recognizer 220A in resolving names in text passed to the name recognizer from the host application 205. According to embodiments of the present invention, the database of names may include a contacts list 330 and a separate name database 340, as described above. At step 512, text is input by a user at the host application 205. As described above, the host application 205 may be one of a number of software applications capable of receiving text input from the user. Moreover, the host application 205 may be an application allowing the user to input text according to a variety of languages by selecting an input language using the host application 205 and/or selecting an alternate language user interface via the operating system 16 of the user's computer two.

At step 514, text entered by the user via the host application 205 is passed to the recognizer DLL 210. As should be understood by those skilled in the art, text may be passed to the recognizer DLL in sentences, paragraphs, or other discrete text fractions. Alternatively, text may be passed to the recognizer DLL each time the users goes idle, for example where the user pauses between keystrokes for more than a set time duration.

At step 520, a determination is made as to whether the language of the text passed from the host application 205 is determinable. As described above, if the language of the text passed from the host application 205 has been set by the user via the host application 205 or via the user interface, such as a keyboard, via the user's computer operating system, that information may be passed along with the text selection to the recognizer DLL 210. If the language is determinable, the method proceeds to step 540, and the recognizer DLL passes the text selection and language indicator data to the name recognizer DLL 220A.

At step 540, the text received by the name recognizer 220A is broken into words for the eventual determination as to whether any of the words comprise a name. As described above, according to some languages, the text may already be broken into readily definable words by use of word delimiters such as spaces and punctuation marks. For example, referring back to FIG. 4, the text selection 410 includes a set of words that are separated by spaces. On the other hand, a text selection 430, illustrated in FIG. 4 may be presented to the name recognizer 220A that is created using a language that does not use word delimiters, such as spaces or punctuation marks, where each character is run together in side-by-side orientation. In either case, if necessary, the word breaker application 320 is utilized by the name recognizer 220A for separating the text into words that may be compared against language rules or databases to determine whether any of the words comprise a name. In the case of the text string 430 where the text string is not already broken into definable words, the word breaker 320 may, if necessary, parse the text string one character at a time forming combinations of characters that may be compared against the databases or language rules to determine whether the combinations of characters are words that comprise a name.

At step 542, because the language of the text selection is known, the name recognizer DLL 220A applies the rules of the known language in an attempt to isolate names contained in the text selection passed from the host application 205. For example, referring to the text string 430, illustrated in FIG. 4, if the language of the text string requires or commonly uses a province or location designation immediately after a name, the name recognizer 220A may locate and recognize the phrase “of Atlanta” as a province name or location designator that commonly or by requirement immediately follows a name according to the language of the text selection. Accordingly, the name recognizer 220A may then look to words immediately preceding the phrase “of Atlanta” to determine that a high probability exists that the words immediately preceding the location designator comprise a name.

At step 544, after the name recognizer 220A has applied the rules of the known language to the text selection, a determination is made as to whether the rules comparison allows the name recognizer 220A to resolve any of the words as names. If not, the method may proceed to step 524 where the words of the text selection are compared against the databases 330, 340 in the same manner, as would be words of a text selection where the language of the text selection is not known. If the name recognizer 220A is able to resolve names from the text selection by analyzing the rules of the known language, the method proceeds to step 546. As should be understood by those skilled in the art, the names resolved by the name recognizer 220A by analysis of the rules of the language may not result in an absolute confirmation that a given word or words is a name, but may result in a high probability that a given word or words is a name, and confirmation may be achieved by comparing such words to the user's contact's list 330 or to the other name databases 340. Alternatively, once the name recognizer 220A determines that a sufficient probability exists that a given word or words is a name based on an analysis of the language rules associated with the words, the method may proceed directly to step 534, and the words may be returned to the host application 205 as a name, as will be described in further detail below.

At step 546, the words resolved as a name by the name recognizer by analyzing the language rules associated with the words is compared against the user's contacts list 330. It is useful to compare the words against the user's contacts list 330 because if the words match a name in the user's contact lists 330, actions may ultimately be provided to the user such as sending an email message to the named person. At step 548, FIG. 6, a determination is made as to whether the word or words matches a name contained in the user's contact's list 330. If the words do match a name contained in the user's contacts list 330, the method proceeds to step 534, and the name is returned to the host application 205 as a name, as will be described in detail below. If the words do not match a name contained in the user's contacts list 330, the method proceeds to step 550 and the words are compared against a language-specific name set to determine whether the words match names that are commonly used in the language in which the text string has been created.

At step 552, if the words match names contained in the language-specific set of names, the method proceeds to step 534, and the name is returned to the host application, as described below. If no match is achieved, at step 552, the method proceeds to step 554 and the words are compared against a general database of names 340 where the words are compared against a database containing an exhaustive list of known names. At step 556, if the words match names contained in the general name database, the method proceeds to step 534, and the names are returned to the host application, as described below. If the words do not match any of the databases 330, 340, the method may end at step 595. It should be understood by those skilled in the art that the rules analysis and the comparisons to the databases described above may be done simultaneously or in the order described above. According to an exemplary embodiment of the present invention, the order described above allows for better efficiency in terms of processing time because the words are first compared against databases with the strongest likelihood of matching names.

Referring back to step 520, if the text selection originally passed to the recognizer DLL 210 from the host application 205 does not have an associated known language, the method proceeds to step 520 and the text string is broken into words either using word delimiters such as spaces and/or punctuation marks or by using the word breaker application 320, as described above. As should be understood, a language designation may not have been passed to the recognizer DLL, or the name may be included in a mixed language document. For example, the user may create the document in the English language, but the user may insert Vietnamese based names, for example, throughout the document. In this case, because no particular language is associated with the text passed to the name recognizer 220A, at step 524, each word broken from the text selection is first compared against the user's contacts list 330. At step 526, if any of the words from the text selection match a name or names contained in the user's contacts list 330, the method proceeds to step 534, and the names are passed to the host application 205, as described below. If words broken from the text string do not match names contained in the user's contacts list 330, the method proceeds to step 530, and the words are compared against names contained in a general database 340.

At step 532, FIG. 6, a determination is made as to whether any of the words from the text string passed to the name recognizer 220A match any names contained in the general names database 340. If not, the method may end at step 595. If the words match names contained in the general name database 340, the method proceeds to step 534, and the name is returned to the host application 205.

At step 536, the host application 205 calls the action DLL 215 for actions on the returned name. As illustrated in FIG. 2, according to an embodiment of the present invention, the action DLL 215 may utilize a name action plug-in 225A for providing name-oriented actions on the returned name. At step 538, actions from the action DLL 215 are provided for the returned name. For example, referring to the text string 410, illustrated in FIG. 4, the name “Joe Smith” is marked with an underline or other indicator that the name has been tagged for actions associated with the name. Upon focusing on the tags name by placing the computer cursor or mouse pointer in the tagged name, the action window 420 is made available to the user so that the user can select available actions. As should be understood, the actions made available to the user may be provided dynamically based on the name returned. For example, if the name returned from the name recognizer DLL 220A is a name that matched a name in the user's contacts list 330, an action such as “send mail” may be provided because the electronic mail address associated with the name may be available in the contacts list 330. If the name returned by the name recognizer DLL was not located in the contacts list 330, but was located in a general database 340, an action such as “add to contacts” may be provided to allow the user to add the returned name to the user's contacts list. As should be understood, selection of one of a number of available actions provided to the user may cause some other action, such as the launching of a user interface to allow the user to send an email message, edit a contacts list, prepare a memo, and the like. After actions are provided to the user for the returned name at step 538, the method ends at step 595.

As described herein, methods and systems are provided for recognizing names in a text string entered according to a variety of languages and for providing helpful actions on the recognized name. It will be apparent to those skilled in the art that various modifications or variations may be made in the present invention without departing from the scope or spirit of the invention. Other embodiments of the invention will be apparent to those skilled in the art from consideration of the specification and practice of the invention disclosed herein.

Claims (23)

1. A method of recognizing names from a text string entered according to one of a plurality of spoken languages for providing helpful actions in association with recognized names, the method being implemented at least in part by a computer and comprising:

receiving, by the computer, a previously generated text string;

passing the text string to a name recognizer application;

determining whether a particular spoken language is associated with the text string;

applying a set of name rules of the spoken language associated with the text string to a plurality of individual words comprising the text string, the set of name rules comprising grammatical rules and sentence structure rules in the spoken language;

determining whether any of the plurality of individual words comprise a name according to the set of name rules of the spoken language associated with the text string;

if any of the plurality of individual words comprise a name,

generating a list of user actions that may be performed on the name, wherein generating the list of actions that may be performed on the name comprises,

analyzing the language associated with the text string, and

determining if the name exists in a user contacts database,

associating the list of actions with the name,

returning the name and the list of user actions associated with the name to a host application with which the text string was previously generated for providing the list of user actions associated with the name, and

marking the name in the text string to indicate actions are available in association with the name; and

providing to a user the list of user actions in association with the name.

2. The method of claim 1, prior to passing the text string to the name recognizer application,

passing the text string to a text recognizer application; and

passing the text string from the text recognizer application to the name recognizer application.

3. The method of claim 1, after passing the text string to the name recognizer application, breaking the text string into a plurality of individual words.

4. The method of claim 1, wherein the list of actions in association with the name includes enabling the user to send electronic mail to an electronic mail address associated with the name.

5. The method of claim 1, wherein the list of actions include enabling the user to modify the name in the user contacts database, wherein modify includes any member of the groups comprising: add and delete.

6. The method of claim 1, after determining whether any of the plurality of individual words comprise the name according to the set of name rules of the spoken language associated with the text string, comparing the name to the user contacts database to determine whether the name matches a contact name contained in the user contacts database.

7. The method of claim 6, wherein if the name does not match the contact name contained in the user contacts database, comparing the name to a database of names common to the spoken language associated with the text string.

8. The method of claim 7, wherein if the name does not match a name contained in the database of names common to the spoken language associated with the text string, comparing the name to a general database of names.

9. The method of claim 1, prior to receiving the previously generated text string, building the user contacts database.

10. The method of claim 1, wherein applying the set of name rules of the spoken language associated with the text string to the plurality of individual words comprising the text string, includes determining whether any words in the text string are preceded by a title word.

11. The method of claim 1, wherein applying the set of name rules of the spoken language associated with the text string to the plurality of individual words comprising the text string, includes determining whether any words in the text string are followed by a location designation.

12. The method of claim 1, wherein applying the set of name rules of the spoken language associated with the text string to the plurality of individual words comprising the text string, includes determining whether any words in the text string are preceded by a clan name.

13. A system of recognizing names from a text string entered according to one of a plurality of spoken languages for providing helpful actions in association with recognized names, comprising:

a host application operative

to receive a previously generated text string;

to pass the text string to a name recognizer application;

a name recognizer application operative

to determine whether a particular spoken language is associated with the text string;

to apply a set of name rules of the spoken language associated with the text string to a plurality of individual words comprising the text string, the set of name rules comprising grammatical rules and sentence structure rules of the spoken language;

to determine whether any of the plurality of individual words comprise a name according to the set of name rules of the spoken language associated with the text string;

to generate a list of user actions that may be performed on the name, in response to the determination whether any of the plurality of individual words comprise a name, wherein generating the list of actions that may be performed on the name comprises analyzing the language associated with the text string and determining if the name exists in a user contacts database;

to associate the list of user actions with the name;

to return the name and the list of user actions associated with the name to the host application with which the text string was previously generated for providing the list of user actions associated with the name;

to mark the name in the text string to indicate the list of user actions are available in association with the name, if any of the plurality of individual words comprise a name; and

to provide to a user the list of user actions in association with the name.

14. The system of claim 13, wherein the list of actions associated with the name includes enabling the user to send electronic mail to an electronic mail address associated with the name.

15. The system of claim 13, wherein the list of actions associated with the name include enabling the user to modify the name in the user contacts database, wherein modify includes any member of the groups comprising: add and delete.

16. A computer readable medium containing instructions which when executed by a computer perform the steps of:

receiving a previously generated text string;

passing the text string to a name recognizer application;

determining whether a particular spoken language is associated with the text string;

applying a set of name rules of the spoken language associated with the text string to a plurality of individual words comprising the text string, the set of name rules comprising grammatical rules and sentence structure rules of the spoken language;

determining whether any of the plurality of individual words comprise a name according to the set of name rules of the spoken language associated with the text string;

generating a list of user actions that may be performed on the name, wherein generating the list of actions that may be performed on the name comprises analyzing the language associated with the text string and determining if the name exists in a user contacts database;

associating the list of user actions with the name;

if any of the plurality of individual words comprise a name, returning the name and the list of user actions associated with the name to a host application with which the text string was previously generated for providing the list of user actions associated with the name,

marking the name in the text string to indicate the list of user actions are available in association with the name, and

providing to a user the list of user actions in association with the name.

17. The computer readable medium of claim 16, prior to passing the text string to the name recognizer application, passing the text string to a text recognizer application; and

passing the text string from the text recognizer application to the name recognizer application.

18. The computer readable medium of claim 16, after passing the text string to the name recognizer application, breaking the text string into the plurality of individual words.

19. The computer readable medium of claim 16, after returning the name to the host application with which the text was previously generated, passing the name to an action application for providing actions associated with the name.

20. The computer readable medium of claim 16, further comprising upon selection of the marked name in the text string, providing the list of actions associated with the name.

21. The computer readable medium of claim 20, wherein the list of actions associated with the name includes enabling the user to send electronic mail to an electronic mail address associated with the name.

22. The computer readable medium of claim 20, wherein the list of actions associated with the name include enabling the user to modify the name in the user contacts database, wherein modify includes any member of the groups comprising: add and delete.

23. A method of recognizing names from a text string entered according to one of a plurality of spoken languages for providing helpful actions in association with recognized names, the method being implemented at least in part by a computer and comprising:

receiving, by the computer, a previously generated text string;

passing the text string to a name recognizer application;

determining whether a particular spoken language is associated with the text string;

applying a set of name rules of the spoken language associated with the text string to a plurality of individual words comprising the text string, the set of name rules comprising grammatical rules and sentence structure rules in the spoken language, wherein applying a set of name rules of a spoken language associated with the text string to a plurality of individual words comprising the text string comprises,

determining whether any words in the text string are preceded by a title word,

determining whether any words in the text string are followed by a locating designation, and

determining whether any words in the text string are preceded by a clan name;

determining whether any of the plurality of individual words comprise a name according to the set of name rules of the spoken language associated with the text string;

if any of the plurality of individual words comprise a name,

comparing the name to a user contacts database to determine whether the name matches a contact name contained in the user contacts database,

generating a list of user actions that may be performed on the name, wherein generating the list of user actions that may be performed on the name comprises analyzing the language associated with the text string and determining if the name exists in a user contacts database,

associating the list of user actions with the name,

returning the name and the list of user actions associated with the name to a host application with which the text string was previously generated for providing the list of user actions associated with the name, and

marking the name in the text string to indicate the list of user actions are available in association with the name; and

receiving, by the host application, a selection of the marked name in the text string, and in response to the selection, providing to a user the list of user actions in association with the name.

US10/426,4462003-04-292003-04-29Methods and system for recognizing names in a computer-generated document and for providing helpful actions associated with recognized names
Active2026-03-31US7711550B1
(en)

Method of and system for enabling the access of consumer product related information and the purchase of consumer products at points of consumer presence on the world wide web (www) at which consumer product information request (cpir) enabling servlet tags are embedded within html-encoded documents

Method of and system for enabling the access of consumer product related information and the purchase of consumer products at points of consumer presence on the world wide web (www) at which consumer product information request (cpir) enabling servlet tags are embedded within html-encoded documents

Textual context analysis for information retrieval; Mark A. Stairmand; Proceedings of the 20th annual international ACM SIGIR conference on research and development in information retrieval (1997) p. 140-147.