mirror of https://github.com/go-gitea/gitea.git
f64fbd9b74
This PR improves the accuracy of Gitea's code search.
Currently, Gitea does not consider statements such as
`onsole.log("hello")` as hits when the user searches for `log`. The
culprit is how both ES and Bleve are tokenizing the file contents (in
both cases, `console.log` is a whole token).
In ES' case, we changed the tokenizer to
[simple_pattern_split](https://www.elastic.co/guide/en/elasticsearch/reference/current/analysis-simplepatternsplit-tokenizer.html#:~:text=The%20simple_pattern_split%20tokenizer%20uses%20a,the%20tokenization%20is%20generally%20faster.).
In such a case, tokens are words formed by digits and letters. In
Bleve's case, it employs a
[letter](https://blevesearch.com/docs/Tokenizers/) tokenizer.
Resolves #32220
---------
Signed-off-by: Bruno Sofiato <bruno.sofiato@gmail.com>
|
||
|---|---|---|
| .. | ||
| limited_org | ||
| migration/lfs-test.git | ||
| org3 | ||
| org26 | ||
| org41/repo61.git | ||
| org42/search-by-path.git | ||
| privated_org | ||
| user2 | ||
| user5/repo4.git | ||
| user12/repo10.git | ||
| user13/repo11.git | ||
| user27 | ||
| user30 | ||
| user40/repo60.git | ||