What is Neural Search?

What is Neural Search and how to get started with it without prior experience in Machine Learning

TL;DR: Neural Search is a new approach to retrieving information using neural networks. Traditional techniques to search typically meant writing rules to “understand” the data being searched and return the best results. But with neural search, developers don’t need to wrack their brains for these rules; The system learns the rules by itself and gets better as it goes along. Even developers who don’t know machine learning can quickly build a search engine using open-source frameworks such as Jina.

Table of contents

• What is Neural Search?
• Evolution of search methods
• Rules vs Neural Networks
• Applications Of Neural Search
• Get started with Neural Search

What is Neural Search?

There is a massive amount of data on the web; how can we effectively search through it for relevant information? And it’s not just the web where we need it: Our computers store terabytes of company and personal data that we need to work with; we need effective search to get our day-to-day job done. And what do I mean by effective search

• Can we go beyond just matching keywords?
• Can we search using natural language, just like we would write or speak?
• Can we make the search smart enough to forgive our minor mistakes?
• Can we search for things that aren’t an exact match but are “close enough”?

We can answer all those questions with one word: Yes. To understand how, we need to enter the world of Natural Language Processing. NLP is a field of computer science that deals with analyzing natural language data, like the conversations people have every day.

NLP is the foundation of intelligent search, and we have seen three different approaches in this field as follows.

Evolution of search methods

1. Rules (1950–1990s) Complex handwritten rules that emulate Natural Language Understanding. Drawbacks: Handwritten rules can only be made more accurate by increasing their complexity, which is a much more difficult task that becomes unmanageable over time.
2. Statistics (1990s — 2010s) Probabilistic decisions based on weights, machine learning and feature engineering. Creating and managing rules was solved with machine learning, where the system automatically learns rules by analysing large real-world texts. Drawbacks: These statistical methods require elaborate feature engineering.
3. Neural Networks (Present) Advanced machine learning methods such as deep neural networks and representation learning. Since 2015, statistical methods have been largely abandoned, and there has been a shift to neural networks in machine learning. Popular techniques using this method make it a more accurate and a scalable alternative. It involves
   • Use of word embeddings to capture semantic properties of words
   • Focus on end-to-end learning of higher-level tasks (e.g., question answering)

When you use Neural Networks to make your search smarter, we call this a Neural Search System. And as you will see, it addresses some of the critical shortcomings of other methods.

Note that the applications of Neural Search are not just limited to text. It goes well beyond what NLP covers. With neural search, we get additional capabilities to search images, audio, video, etc.

Let’s look at a comparison of the extreme ends of search methods — “Rules” vs “Neural Networks”:

Rules (Symbolic Search) vs Neural Networks (Neural Search)

While the Neural Search method has become more widespread since 2015, and should be the primary focus area of any new search system, we shouldn’t completely rule out Symbolic (rule-based) Search methods. In fact, using a combination of Neural Search and Symbolic Search may result in optimized results.

Let’s look at some of the powerful applications of Neural Search

Applications Of Neural Search

Semantic search

🔍 addidsa trosers

(misspelled brand and category, still returns relevant results similar to query “adidas trousers”)

Search between data types

With Neural Search, you can use one kind of data to search another kind of data, for example using text to search for images, or audio to search for video.

Search with multiple data types

With Neural Search, you can build queries with multiple query data types e.g. search images with text+image

Get started with Neural Search

For rule-based searches, Apache Solr, Elasticsearch, and Lucene are the de-facto solutions. On the other hand, Neural Search is relatively new on the scene, there aren’t so many off-the-shelf packages. Not to mention, training the neural network for such a system requires quite a bit of data. These challenges can be solved using Jina, an open-source neural search framework. To get started with building your own Neural Search system using Jina:

• Learn basic concepts of Jina
• Start playing around with Jina
• Build your first Jina app

---

References

• Neural Search term is less academic form of the term Neural Information Retrieval which first appeared during a research workshop in 2016
• Learning to rank
• Natural Language Processing
• Neural Network
• Building cross-lingual product search using Tensorflow
• What is neural search and why should you care
• Information Retrieval
• Related to Information Retrieval
• Search Engine Technology
• Introduction to neural Information Retrieval
• Content based image retrieval
• An anatomy for Neural Search engine
• How google search works, and a more in-depth video