Icon View Thread

The following is the text of the current message along with any replies.
Messages 1 to 3 of 3 total
Thread Text Indexes and Text Filters
Wed, Jan 20 2021 7:58 AMPermanent Link

Adam Brett

Orixa Systems

I have some tables with large amounts of text in a CLOB column.

When users search these data-tables EDB is slow to return results.

I believe that adding Text Indexes should help in this. Adding a Text Index seems pretty trivial.

However in the Help there is a mention of "Text Filters"

CREATE TEXT FILTER "HTML"
TYPE 'HTML'
MODULE "HTMLFilter"
DESCRIPTION 'Filters HTML'

Which allows EDB to be much more efficient in how it uses Text Indexes, by isolating or removing tags from text prior to indexing.

I would like to add some Text Filters, but I can't see how to.

My Configuration.TextFilters table is empty. I don't know how to find or generate the TextFilters system tables.
Wed, Jan 20 2021 9:40 AMPermanent Link

Roy Lambert

NLH Associates

Team Elevate Team Elevate

Adam


Text filters & word generators aren't that difficult - basically external dlls in a specified format - I uploaded mine to the extensions newsgroups yonks ago. Tim has templates in ElevateDB\templates for them if you want to start writing your own.

Naturally you're welcome to use mine (that's why they're in the extensions ng) but if you want to ask questions about them you'll have to give me time to remember just what I was doing.

You install them on a session by session basis using SQL eg

CREATE MODULE "wgPreFiltered"
PATH 'wgPreFiltered.dll'  <<< word generator


and

CREATE MODULE "StripRTF"
PATH 'StripRTF.dll' <<< text filter


mine have been working pretty well for a long time and I haven't even looked at them for ages.

Roy Lambert
Wed, Jan 20 2021 12:28 PMPermanent Link

Adam Brett

Orixa Systems

Thanks Roy,

I'll review this code. If I extend it or add to it I'll post the extensions on the NG too.
Image