Comparison of Standard and Advanced MLS

Multilingual Search (MLS) for AEM Communities is built for the Solr platform to provide improved search across all supported languages, including English.

MLS for AEM communities is available as either Standard MLS or Advanced MLS. Standard MLS only includes Solr configuration settings, and excludes any plugins or resource files. Advanced MLS is the more comprehensive solution and includes Solr configuration settings as well as plugins and related resources

Standard MLS includes enhancements for content search for the following languages:

English: Improved stemmer for attempting to match word derivations.

Japanese: Improved Japanese tokenization for half-width characters.

Advanced MLS includes enhancements for content search for the following languages:

English: Replaced stemmer with lemmatizer.

German: Added decompounder.

French: Added elision handling.

Chinese (Simplified): Added a smarter tokenizer.

Various languages: Added a stemmer, stop word list, and a normalizer.

In all, the following 33 languages are supported in Advanced MLS.

Arabic

German

Norwegian

Bulgarian

Greek

Polish

Chinese (Simplified)

Haitian Creole

Portuguese

Chinese (Traditional)

Hebrew

Romanian

Czech

Hungarian

Russian

Danish

Indonesian

Slovak

Dutch

Italian

Slovenian

English

Japanese

Spanish

Estonian

Korean

Swedish

Finnish

Latvian

Thai

French

Lithuanian

Turkish

Comparison of AEM 6.1 Solr search, Standard MLS and Advanced MLS

Note
: AEM 6.1 refers to AEM 6.1 Communities FP3 and earlier.

Installing Standard MLS

For the SRP collection (either MSRP or DSRP), to support Standard Multilingual Search (MLS) it is necessary to modify two of Solr's configuration files:

schema.xml

solrconfig.xml

Standard MLS files (schema.xml, solrconfig.xml) for Solr 4.10.

Standard MLS files (schema.xml, solrconfig.xml) for Solr 5.x.

The Standard MLS files are stored in the AEM repository.

Note
: While the Solr files are stored in the msrp/ folder, they are also for DSRP (no changes necessary).

Installing Advanced MLS

For the SRP collection (MSRP or DSRP) to support advanced MLS, new Solr plug-ins are required in addition to a custom schema and Solr configuration. All required items are packaged into a downloadable zip file. In addition, an install script is included for use when Solr is deployed in standalone mode.

To obtain the Advanced MLS package, see
AEM Advanced MLS
in the deploy section of the documentation.

To get started with the install for either SolrCloud or standalone mode:

Download AEM-SOLR-MLS zip archive to server hosting Solr.

Unpack the archive.

SolrCloud Mode - Advanced MLS

Installation instructions - note the few differences for Solr4 and Solr5:

Install and configure Solr in SolrCloud mode.

Extract the contents of the Advanced MLS package to disk. The contents should include:

Standalone Mode - Advanced MLS

An install script is included in the Advanced MLS package.

After the contents of the package have been extracted to the server hosting the standalone Solr server, simply execute the install script in order to install the necessary resources and configuration files.

The install script will back-up schema.xml and solrconfig.xml before installing new versions by appending ".orig"

About solrconfig.xml

The
solrconfig.xml
file controls the auto commit interval and search visibility and will requiring testing and tuning.

<autoCommit>
: By default, the AutoCommit interval, which is a hard commit to stable storage, is set to 15 seconds. The search visibility defaults to using the pre-commit index.

To change search to use an index updated to reflect changes due to the commit, change the contained
openSearcher
to true.

autoSoftCommit
: A 'soft' commit ensures that changes are visible (the index is updated), but does not ensure changes are synced to stable storage (hard commit). The result is an improvement in performance. By default,
autoSoftCommit
is disabled with the contained
maxTime
set to -1.