Full-text Search Using Database Index

Full-text Search Using Database Index

Database management systems usually allow partial text lookups using LIKE clauses and Regular Expressions. However, LIKE clauses and regular Expressions tend to underperform on larger datasets. They lack in performance as databases need to check the table to find whether there is the same word patte...

Full description

Saved in:
Bibliographic Details
Published in:2019 5th International Conference On Computing, Communication, Control And Automation (ICCUBEA) pp. 1 - 5
Main Authors: Chaitanya, B. Sri Sai Krishna, Reddy, D. Ajay Kumar, Chandra, B. Pavan Sai Eshwar, Krishna, A. Bala, Menon, Remya R. K.
Format: Conference Proceeding
Language:English
Published: IEEE 01-09-2019
Subjects:
FTS
NLTK
Semantics
SQL
SYNC
WWW
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Database management systems usually allow partial text lookups using LIKE clauses and Regular Expressions. However, LIKE clauses and regular Expressions tend to underperform on larger datasets. They lack in performance as databases need to check the table to find whether there is the same word pattern as in regular expressions or as in LIKE statement. But it is difficult to have an efficient search query if we use regular expressions or LIKE Statements. If we use LIKE operator on the un-indexed column it would be extremely difficult to find out the matches because it needs to fully scan the columns. If the column is indexed then matching can be better than fully scan as matching can be performed against index keys. In worst case LIKE operator may have leading wildcards that require every index to be checked. Due to these limitations we have, we need to use another method which is efficient and flexible and there comes the full-text search where indexes are formed by words(from the words in the columns where the full-text search is enabled). Full-text search can be extended by incorporating semantics. By incorporating operators which support semantics [7], the search can be made more fruitful. Our proposed work will incorporate semantics-related operators in full-text search in PostgreSQL.
DOI:10.1109/ICCUBEA47591.2019.9128683