How to capture & publish 'data' from other sources?

  • Hey!

    Is it possible (via plugin, or even c++ coding (program on my computer, perhaps)) to have something that captures data from other websites, (example stocks, blogs, etc) and publish it via WP, and have this ‘thing’ source where it got its data from?

    Just wanting to know if anyone has done anything like this, or knows how it can be done via ANY method.

    Let me know if I should be more specific.

    Thanks!

Viewing 7 replies - 1 through 7 (of 7 total)

  • RSS feeds?

    Moderator Ipstenu (Mika Epstein)

    (@ipstenu)

    ?????? Advisor and Activist

    APIs can do this too, but it all depends on the source of the data. You have to know what format your data is coming in from before you can answer the question ?? Like if you want to pull in an XML file and parse it, that’s different than the aforementioned RSS feeds ??

    Thread Starter Jam

    (@pimaniii)

    The type of data I am speaking of is articles, such as a newspaper article.

    I have tried using RSS feeds, but it doesn’t really do the job. With RSS feeds, I just got a few links to the articles. I want the actual content of the articles. I am willing to write a C++ program to do this (I have looked up stuff such as https://www.cplusplus.com/forum/general/6546/

    Any ideas?

    Moderator Ipstenu (Mika Epstein)

    (@ipstenu)

    ?????? Advisor and Activist

    The type of data I am speaking of is articles, such as a newspaper article.

    That’s not a data type. That’s just content ?? We’re not talking about that.

    Data Type is what format the content is pushed from. If all they put up is static HTML, well, that’s what you get.

    I want the actual content of the articles.

    That’s Web Scraping. https://en.wikipedia.org/wiki/Web_scraping

    Generally … don’t. The articles are usually copywritten and you’re stealing. Links and excerpts are better.

    Thread Starter Jam

    (@pimaniii)

    I don’t want the entire articles. I do just want a few lines, or an ‘excerpt’ followed by a link to that website.

    I cant find RSS feeds that provide this. But I do want a fraction of the actual content.

    How can I do this?

    Moderator Ipstenu (Mika Epstein)

    (@ipstenu)

    ?????? Advisor and Activist

    Again, it totally depends on the article source and what methods THEY provide for data extraction.

    Thread Starter Jam

    (@pimaniii)

    Does this do the job? https://premium.wpmudev.org/project/autoblog

Viewing 7 replies - 1 through 7 (of 7 total)
  • The topic ‘How to capture & publish 'data' from other sources?’ is closed to new replies.