Index | index by Group | index by Distribution | index by Vendor | index by creation date | index by Name | Mirrors | Help | Search |
Name: perl-Search-Tokenizer | Distribution: Mageia |
Version: 1.10.0 | Vendor: Mageia.Org |
Release: 4.mga8 | Build date: Thu Feb 13 06:42:14 2020 |
Group: Development/Perl | Build host: localhost |
Size: 20469 | Source RPM: perl-Search-Tokenizer-1.10.0-4.mga8.src.rpm |
Packager: tv <tv> | |
Url: http://metacpan.org/release/Search-Tokenizer | |
Summary: Decompose a string into tokens (words) |
This module builds an iterator function that will progressively extract terms from a given input string. Terms are defined by a regular expression (for example '\w+'). Term matching relies on the builtin "global match" operator of Perl (the 'g' flag), and therefore is quite efficient. Before being returned to the caller, terms may be filtered by an auxiliary function, for performing tasks such as stemming or stopword elimination. A tokenizer returned from the /"new" method is a code reference, _not_ a regular Perl object. To use the tokenizer, just call it with a string to parse : this will return another code reference, which works as an iterator. Each call to the iterator will return the next term from the string, until the string is exhausted.
GPLv1+ or Artistic
* Wed Feb 12 2020 umeabot <umeabot> 1.10.0-4.mga8 + Revision: 1497161 - Mageia 8 Mass Rebuild * Wed Sep 19 2018 umeabot <umeabot> 1.10.0-3.mga7 + Revision: 1271093 - Mageia 7 Mass Rebuild
/usr/share/doc/perl-Search-Tokenizer /usr/share/doc/perl-Search-Tokenizer/Changes /usr/share/doc/perl-Search-Tokenizer/META.json /usr/share/doc/perl-Search-Tokenizer/META.yml /usr/share/doc/perl-Search-Tokenizer/README /usr/share/man/man3/Search::Tokenizer.3pm.xz /usr/share/perl5/vendor_perl/Search /usr/share/perl5/vendor_perl/Search/Tokenizer.pm
Generated by rpm2html 1.8.1
Fabrice Bellet, Sun Mar 9 11:42:30 2025