rexcrawler search not working

Hi Matt

Which version of rexCrawler are you running? And could you give me an example of a search-string that’s causing you trouble?

Best regards
Lars

Version 1.0.15

I’m not sure what you mean by search string. But I can describe what I’ve done. I setup a group of about 15 websites called energy websites. I put the link for each page as the same as the crawl url. Here is an example: https://www.energy.ca.gov/

And then my search pattern has one keyword search per line, such as “energy”. I have about 1000 keywords to search in each search pattern. When I run the search, this is what comes up for each one:

Result

Warning: preg_match_all() [function.preg-match-all]: Delimiter must not be alphanumeric or backslash in /home2/sparkyco/public_html/sunniparedes/wp-content/plugins/rexcrawler/admin_regex_test.php on line 173

I have no idea what that means or what I can do to change it. Maybe it would help to delete rexcrawler then re-install it. But maybe it’s how I input things too. Thanks for helping!

Hello again!

I think I misunderstood your problem the first time, sorry about that ??

Could you show me an example of one of your search patterns, and with an associated page (Like https://www.energy.ca.gov/)? Also, what kind of output are you hoping for?

For example, using the following search pattern:
/Download Version ([^<]+)<\/a>/i

Along with the Crawl URL https://www.ads-software.com/extend/plugins/rexcrawler/

rexCrawler will (at the moment) get the following result output:
1.0.15

Since the current version you’re able to download is 1.0.15.

Another thing:
Using rexCrawler, the search-patterns you define must start with a slash (/) and end with a slash aswell (It’s possible to append some regex options, like case insensitive search (i) as you can see in my search-pattern).
I might have forgot to actually write this in the documentation actually; I’ll look into it and include an update in the next release ??

And It’s a pleasure to help ?? I want to make rexCrawler to be the best crawler available, and as simple to use as possible!

Best regards
Lars