How to use pgroonga for the arabic dictionary? about pgroonga.github.io

[askdkc]

This is probably too late to answer your question but you can use pgroonga_query_expand function to achieve that.

Here is an example:

CREATE EXTENSION pgroonga;

-- create synonyms table
CREATE TABLE synonym_groups (
  synonyms text[]
);

-- Add PGroonga Index
CREATE INDEX synonym_groups_synonyms
          ON synonym_groups
       USING pgroonga (synonyms pgroonga_text_array_term_search_ops_v2);

-- Insert synonyms words into table
INSERT INTO synonym_groups
  VALUES (ARRAY['أحمد', 'احمد']);

-- Create sample data to try synonyms search
CREATE TABLE sample_texts (
  sample text
);

-- Add PGroonga index
CREATE INDEX sample_texts_index     
          ON sample_texts   
       USING pgroonga (sample pgroonga_text_full_text_search_ops_v2);


-- I'm not familiar with Arabic Language so if something wrong with sample text down below, my apologies.
INSERT INTO sample_texts  
  VALUES ('أحمد عبدالواحد');
INSERT INTO sample_texts  
  VALUES (' لمعانٍ أخرى، طالع أحمد (توضيح).');


-- Now you can search either 'أحمد'OR  'احمد' and get both results back.
SELECT * FROM sample_texts 
     WHERE sample &@~ pgroonga_query_expand('synonym_groups', 'synonyms', 'synonyms', 'احمد');
--             sample              
---------------------------------
-- أحمد عبدالواحد
  -- لمعانٍ أخرى، طالع أحمد (توضيح).
-- (2 rows)


SELECT * FROM sample_texts 
     WHERE sample &@~ pgroonga_query_expand('synonym_groups', 'synonyms', 'synonyms', 'أحمد');
--             sample              
---------------------------------
-- أحمد عبدالواحد
  -- لمعانٍ أخرى، طالع أحمد (توضيح).
-- (2 rows)

Hope this will help you.

[salmagomaa]

Thank you @askdkc , I will give it a try.

[kou]

You can use NormalizerMySQLUnicode900 normalizer:

CREATE INDEX pgroonga_content_index
          ON memos
       USING pgroonga (content)
        WITH (plugins='normalizers/mysql',
              normalizers='NormalizerMySQLUnicode900');

Note that you need to install groonga-normalizer-mysql package for this.

See also:

• https://github.com/groonga/groonga-normalizer-mysql
• https://pgroonga.github.io/reference/create-index-using-pgroonga.html#custom-normalizer