We are happy to announce the integration of Google Custom Search with the schema.org standard. Schema.org is a structured data markup schema including a shared markup schema vocabulary that is supported by major search providers. This integration enables you to create powerful and expressive topical search engines by simply specifying schema.org types in your Google Custom Search Engine definition.

How would you go about using this new feature? Say you are the webmaster of a site about movies. You might want to create a movie search engine that can search for pages about movies either from your website, your affiliated websites or from the millions of sites that use schema.org. Achieving this functionality is now only a click away thanks to the integration of Google Custom Search with schema.org. All you have to do is add the schema type “Movie” to your Custom Search Engine definition, as shown below, and you’re done! Users of your movie search engine will then only see result pages that have the “Movie” schema annotation.

You can even refine schema.org-based search engines with other advanced search features. For example, you might make an engine for pages that describe http://schema.org/JobPosting, with a country restriction of "France", or a language restriction of "French".

Did you know that a topical search engine can help your users find content from more than a single domain? You can use your expertise to provide a delightful user experience targeting a particular topic on the Web.

There are two main types of engines built with Google Custom Search: site search and topical search. While site search is relatively straightforward - it lets you implement a search for a blog or a company website - topical search is an entirely different story.

Topical search engines focus on a particular topic and therefore usually cover a part of the Web that is larger than a single domain. Because of this topical engines need to be carefully fine-tuned to bring the best results to the users.

Kritikos

A nice example of a topical search engine is Kritikos - a search engine for visual media relevant to higher education developed by the Engineering Department at Liverpool University. Developed in its pilot phase exclusively for Engineering students, Kritikos is now able to add new academic subjects simply by changing one line of code in the API call.

Kritikos is using a mix of Custom Search tuning techniques to find the most relevant results and then matches the results with the data stored in the local node of the Learning Registry. The additional data is displayed as an overlay in the search results page, providing valuable reference for the engine’s users. This method allows Kritikos to also include a social mechanism into their results - e.g. it is able to show users votes or comments about the usefulness of particular resources. Here is what Andrew Green, the Technical Director of Kritikos from the University of Liverpool says about the project.

In developing Kritikos, we wanted to build upon existing search engines, rather than try and build our own. We discovered that, once we found the documentation, the Google Custom Search Engine API was incredibly easy to use. The call to the API, based on the user’s subject of interest, search terms and preferred media type, is constructed in only a dozen lines of code. The resulting JSON data was easily parsed in order to generate the thumbnail images that give Kritikos its visual impact.

This shows the first 3 results for the term query term “fracture”, as seen by an Engineering student. The icons in the top right corners indicate that other students have interacted with these resources in some way.

Here are the results for the same search term (“fracture”), this time as viewed by a Medical student.

Andrew Green

Technical Director, Kritikos

The University of Liverpool

You can read more about their adventures with Custom Search on the project’s blog.

From talking to developers working with Custom Search and looking at different engines out there on the Web, I learned a few trends present in many of the solutions. Here they are - a few things to keep in mind when building a topical search engine.

Choose your index wisely

There is a lot of mess on the Internet. You don’t want to distract your users and make them spend time on random sites. The point of making a topical search engine is to make it focused and targeted.

An index is a list of sites - or url patterns - that your engine is operating on. Choosing what should go into the engine’s index and what should be left out is a matter of expected quality. Sometimes even sites that are on topic can be left out of the index or de-prioritized in order to promote other content, that you - the author of the engine - consider more valuable to your users.

Guess your user intention

The usability rule - Don’t make me think - plays nicely with topical search engines. You build the engine to make your users life easier, finding the information faster and more efficient. Usually your engine is functioning in some particular context - it is included in a topical website, it is addressed to some specific audience etc. You can apply this context to the search process, to make your users more productive and happier with the experience. There are a number of techniques that allow you to add context to your users’ queries - for details check out the Topical CSE article on Google Developers site.

Provide delightful experience with custom rendering

Search does not need to be boring. You can add all sorts of fireworks to your search results - custom design, non-linear browsing experience, user interactions or displaying additional data.

Google Custom Search allows you to change almost any aspect of the presentation layer of the results - as long as it is not misleading to the users.

What is coming

Structured data is gaining more and more momentum on the Web. It is a way of expressing real-world concepts in a machine-readable format - for example information about places, events, businesses etc. It already powers some of Google’s products and features, like Rich snippets, Knowledge Graph panels or Google Now cards.

You can harness the power of structured data in a topical search engine by filtering results by a schema.org types and properties or creating your own custom rich snippets.

Stay tuned, we will post more about the integration of Google Custom Search and schema.org standard soon.

Learn how

In the Advanced Topics section of developer’s documentation, you can find an article about creating a Topical CSE. It describes in more detail the techniques needed to obtain the results discussed in this blog post.

If you have an interesting topical search engine and would like to share it, give us a shout at twitter at @googlecse, we’d love to see what you came up with. Happy coding!

Custom Search provides upto 5000 URL patterns to define a “slice” of the web to search over. However, if you’re creating a Custom Search Engine on a topic, such as “global warming”, finding more than a few good sites for a topic can be hard. We recently launched suggested sites to help suggest more sites for your search engine similar to your included sites.

Today, we’re introducing another tool that is hopefully intuitive as well as interesting : You can discover hundreds of sites to include in your CSE starting just with keywords! For example, for a CSE on “global warming”, adding keywords like [pollution], [global warming] and [greenhouse effect] can lead you to discover global warming related sites within minutes.

This tool attempts to combine Google’s knowledge with the topic expertise you have - Google suggests sites, but you can control the topic expansion, and guide the tool towards your topic in a fine grained way.

Have a CSE to search over your favorite topic (e.g. cars)? Here is a new feature to help you expand your CSE’s definition. This feature recommends more url patterns relevant to the ones you already have in your search engine. We also provide a set of sample pages for each of the recommended patterns.

We’re excited to announce a new, modern design for the control panel in keeping with prior user experience changes to Custom Search. You’ll also find a more intuitive layout to the various controls and configuration options. While configuring a Custom Search Engine, you can immediately view and test your work within the control panel.

Simplicity and speed are two principles we love when it comes to design at Google. Today, we’re excited to announce the new CSE layout that displays results in an overlay, on top of any content on your page.

What this means for developers:

Takes seconds to create. We simplified the creation interface to get you going faster.

One snippet for search box and results. Place it where you want your search box to appear.

Powerful features now come by default: autocomplete, image thumbnails and results sorting.

What this means for your users:

Uninterrupted browsing experience.

Faster, more simple search means more chances for your users to discover great content from your site.

You may visit W3Schools to see the new layout in action or use the CSE below which searches our blog.

Try out the new layout by creating a new search engine. It takes less than a minute. Once you have your search engine snippet ready, simply paste it on your website.

Custom Search Engine (CSE) allows you to incorporate rich search functionality into your website. You do this by adding specific HTML markup - known as the Custom Search element - to web pages on your site. The Custom Search element renders a search experience (search boxes and results pages) on your site’s pages. By controlling the placement of the Custom Search element on your pages and configuring your CSE settings, you can create customized layouts that are tuned for the look-and-feel of your website.

We’re happy to announce today a new, improved version of the Custom Search element. Here are some of the key highlights and improvements of what we call Custom Search element v2.

Search UI is rendered based on the settings stored on the Google CSE servers. This means that any configuration changes you make in the CSE control panel will automatically be reflected on your web pages the next time they reload. You no longer need to copy-and-paste new element code into your website when you modify your CSE using the control panel.

Client-side customization allows you to overwrite global CSE settings on a per-page basis. For example, you can enable search history, disable auto search on page load, configure different Google Analytics parameters, and more. Customization is done through an easy-to-use HTML syntax which does not require any Javascript knowledge.

To start using Custom Search element v2 on your website, go to the “Get code” section of the CSE control panel and follow the instructions shown there.

We’ll continue to support older versions of the Custom Search element for the time being but encourage you to update your CSE implementation to take advantage of the improvements.