Viewing 1 replies (of 1 total)
  • Moderator bcworkz

    (@bcworkz)

    I’m unfamiliar with this plugin, but “get argument” appears to be simply the URL of the page you want to scrape. Why “get argument”? When you enter an URL in your browser address bar, it results in a GET request to the server referenced in the URL. Argument is programmer speak for information passed along to something to be used in doing some task.

    There’s a number of ways to dynamically get a server to return a series of pages based on differing URL parameters like symbol=CSCO.O. The lazy programmer way would be to hardcode an array with all the desired symbols, then loop through each symbol and generate a corresponding GET request, something like this:

    $symbols = array('CSCO.0', /*add all needed symbols*/);
    foreach($symbols as $symbol){
       do_get_request("https://www.reuters.com/finance/stocks/overview?symbol=$symbol");
    }
    function do_get_request($url) {
       /*insert actual code to get and process data from $url here*/
    }

Viewing 1 replies (of 1 total)
  • The topic ‘Trying to get WP plugin WP Web Scraper working with dynamic data’ is closed to new replies.