15 Using Federated Search and Freeze

"Federation" is a term used to describe the process of providing a single point of contact/entry for searching multiple disparate data sources. This is often used during the legal discovery process. For example, by using the Federated functionality with Oracle URM, a legal officer can search all repositories and catalogs for items pertaining to a legal matter. The search results then 'connect' all the items together in one place to perform searches.

Federated search is most effective when used with the Oracle URM Adapters that manage content on remote repositories.

This chapter describes how to use Federated Search to gather information needed for a discovery action and how to use Federated Freeze to freeze those items. It discusses the following topics:

Federated Search functionality is not visible until the RmaNoSecurity right is added to a role. This right is not added by default to any role and must be enabled for the functionality to be accessible. This right should not be treated lightly or granted indiscriminately.

In addition, a system administrator role is needed to use this functionality.

15.1 Federated Searches

Federated Search is available when an external repository (an adapter) is installed.

As part of a discovery process, organizations might search for or freeze content across multiple repositories which are managed by adapters. Oracle URM uses external adapters to search metadata and full text of remote repository items. With this functionality, a user can:

Create searches by sending the search criteria to the adapter. External adapters check periodically to see if there are searches pending, perform the searches, and return the search results. The adapters may perform the search in a delayed timeline, requiring users to wait for the search results to complete.

Freeze the content returned from a completed scheduled search. While scheduled freezes are initiated immediately, Oracle URM performs the freeze in the background.

View detailed information about a scheduled search or freeze.

View search or freeze results.

Delete a scheduled search or freeze.

15.1.1Federated Search Query Builder

To access the Federated Search Query Builder click Search then Global Search in the Top menu. The following options are available:

Central Catalog Search is used for external content already registered with Oracle URM. This is a search of local metadata and is usually a faster search than Remote Repository items.

Note that it is up to the adapter configuration to make adapter content visible to the Oracle URM server. If the adapter has not made its content available, Oracle URM will not find that content in a search.

Remote Repositories Search is used to find items stored on external content systems whether they have been cataloged on the Oracle URM server or not. This is a search of all possible content using adapters to schedule the search. The adapters use the criteria entered for a Remote Repository Search as the criteria used for the search on that remote repository. Searching for content in Remote Repository is not in real time and is dependent on adapters to complete the search. This option provides the most accurate and up-to-date results but it may take a long time to complete.

SES Search is similar to a Remote Repository Search but the search is not scheduled and run by an adapter. Instead, a connection is made to an SES server, which has done a scheduled crawl of content on the adapter(s). Oracle URM connects directly to the SES server, which has been configured ahead of time. If this option is selected and no servers have been configured, an error message is displayed.

The Federated Query Builder Page enables users to build and schedule queries across all repositories. Select the repositories to include in the search from the External Sources list. Multiple sources can be included in the search.

This query builder form is similar to other query builder forms used in Oracle URM and Oracle UCM. Select a field to use as sorting criteria and click Search when done. When performing a remote repository search, a search name must be entered. Users can only search using fields that are mapped to all of the selected external sources. Errors occur if a search is done against a source using a field that is not mapped.

After pressing Save enter a title for the action. The search is scheduled and the Federated Searches Page appears. The list of scheduled searches includes the number of external sources requested in the search, and number of external sources that have completed the search request.

The search is scheduled and waits for the external search adapters to return results.

To return to the Federated Searches Page, click Records then Scheduled then Federated Searches from the Top menu.

15.2 Performing a Search

Follow this procedure to perform a search of a remote repository:

Click Search then Global Search from the Top menu. Choose the type of repository search to perform.

Select the external sources to use in the query from the pull-down list.

Click the Include Content box to retrieve copies of the content that match the search criteria. This option is only available when performing a remote repository search.

Do not click this box unless search results are certain. Returning a copy of the data takes long and uses space. Fine tune the query first and verify what items will be returned before actually retrieving the content. See "About Returned Content" for more information about content retrieved during a search.

Choose the fields to use for searching. The Search Builder pull-down menu is used to select fields for use in the query. Only search using fields that are mapped to all of the selected external sources. Errors occur if a search is done against a source using a field that is not mapped.

After a field is selected for use, additional menus are available to further refine the criteria. Boolean operators can be used to combine fields. Click the insert symbol (a plus sign) to access a menu of Boolean operators. Click the remove symbol (a lowercase 'x') to clear previous selections. Additional wildcard search operators, such as Matches and Substring, enable further flexibility in query building.

Enter a search term for full-text searching. If a search is done across all sources, be aware that some adapters may not be able to perform a full text search. When choosing a search type, make sure to choose types that are valid for the adapters in use. For example, if a user chooses full-text search to use with an adapter that does not allow that option, an error is returned.

Enter a search name. A Federated search is performed on the adapter's schedule, so it may not occur immediately. A search name allows users to check the status of the scheduled Federated search. No uniqueness validation is performed on this field because the unique identifier is an assigned Federated Search ID.

Select the result output criteria by indicating a number of results per page and the sorting criteria used for the results.

Click Search when done. The query is routed to the chosen adapters and is completed according to the adapter configuration.

15.2.1 About Returned Content

Saved content is stored in a zip file and is checked into Oracle URM as internal content. These returned content items can be accessed and treated as standard local items in Oracle URM. Users can set dispositions on the files, establish specific rules for their handling, and so on.

Some adapters may return the content in multiple files because the adapter may be configured to chunk data into manageable units. This behavior is controlled on the adapter side and cannot be modified

15.2.2 Checking Search Progress

Federated searches are performed according to adapter schedules, which may vary according to the different configurations. To check the progress of the search, click Records then Scheduled then Federated Searches from the Top menu. Or click the Federated Searches Link on the Federated Query Builder Page.

The Federated Searches List Page is displayed. This page shows the scheduled searches and their progress. The following options are available on the Action menu for each search:

Show Search Results: displays the Federated Search Results Page for the selected search. If multiple external sources were selected in the search, the Search Results Page organizes the results by external source. The search results for individual external sources can also be displayed.

Show Search Details: displays the details for the selected search. Within the Federated Search Details Page, users can view the search results for individual external sources, freeze the search results, download the files returned for the search, and create a similar search.

Note:

Users can freeze items in the returned search results per external source. If multiple external sources have been defined in the search, but have not all returned results, users can schedule a freeze on the sources that returned results for the scheduled search.

Subscribe to Search: subscribes the user to the search and displays the Content Information Page for the query. See "Subscribing to a Search" for more details.

Create Similar Search: displays the Federated Query Builder Page, pre-populated with search criteria used in the selected search. Users can modify or add criteria to schedule a new search.

Delete Search: delete the selected scheduled search. See Deleting a Search for details.

15.2.3 Subscribing to a Search

When a Federated search is created, a content item is checked into the local repository with details of the search. If a user clicks Subscribe to Search on the Actions menu for an item on the Federated Searches List Page, the user is subscribed to the content item for that query.

As results are returned for the saved search, the content item is updated. For example, if a query is set to use three repositories and results are returned from one, the content item is updated and a notification is triggered to those people who are subscribed to the content item.

15.2.4 Deleting a Search

A Federated search can be deleted at any time. Search results do not have to be returned to delete the search.

To delete a search, click the checkbox for the search on the Federated Searches List Page then click Delete on the Table men. A message is displayed, indicating the search and all returned results will be deleted. Any pending search results will be ignored.

15.3Federated Freeze

Federated Freeze is used in conjunction with Federated search, to freeze search results from a Federated query.

When freezing content on an external repository, first schedule a Federated Search, then run a Federated Freeze on the returned results. If the search result that is selected for freezing has not been registered with Oracle URM yet, an external record is created for it automatically using the metadata returned in the search results. This new external record is then frozen by Oracle URM.

The Frozen Federated Search Content Page is displayed for review or further action. The list of frozen scheduled searches includes the external source of the frozen content, and the status (scheduled, completed or errors) of the freeze.

The following options are available from the Actions menu for a frozen item:

Show Freeze Errors: displays the items with errors during the selected freeze. Freeze errors may occur if the checked-in items from the Federated Search do not have all required fields defined or if the items do not pass validation.

Refreeze Errors: reschedules the freeze for the error items in the selected search task.

Delete Freeze: deletes the selected freeze.

15.3.1 Freezing Search Results

Follow this procedure to freeze search results:

Click Records then Scheduled from the Top menu. Click Federated Searches.