Welcome to the new platform of Programmers Heaven! We apologize for the inconvenience caused, if you visited us from a broken link of the previous version. The main reason to move to a new platform is to provide more effective and collaborative experience to you all. Please feel free to experience the new platform and use it's exciting features. Contact us for any issue that you need to get clarified. We are more than happy to help you.
Automatically fill database with info from external websites?
I'm wondering if there are spiders or bots that can search websites to find specific information then put that information in a database.
For example, if I want to search the web for anyone selling Widgets. I want to pull the price of their Widget and fill a database with all the companies selling Widgets and their prices.
More specifically, if such a thing is possible, how would I go about implamenting such a thing.