Re: replace() with hit information

Martin Stjernholm, Roxen IS @ Pike developers forum wrote:

Sounds to me like you should do proper tokenization instead, perhaps with a helper function written in C if it gets too slow otherwise.

The bindings specs as specified for the current Sql interface don't require a tokeniser, that'd be overkill. However, when checking the "magic" behind replace(), I find that it is doing a lot of convoluted things, and doesn't seem to be using Boyer-Moore or anything related.

It might make sense to revamp that logic to use a faster search algorithm anyway, possibly even augmented with a regexp engine of mine that outperforms PCRE. I'll revisit this some other time.