spiders/bots/web crawlers(not sure on correct term) - Programmers Heaven

Howdy, Stranger!

It looks like you're new here. If you want to get involved, click one of these buttons!

Categories

spiders/bots/web crawlers(not sure on correct term)

michaelwkeithmichaelwkeith Posts: 2Member
Does anybody know of any good books on spiders/bots/web crawlers. I'm wanting to write a program that will go to the internet and look at companies stock information and then make a decision to purchase or not. I have found very few books on the subject. Also, what is the best programming language for this type of task? Any suggestions would be very apprciated....Thanks

Comments

  • tsagldtsagld Posts: 621Member
    : Does anybody know of any good books on spiders/bots/web crawlers. I'm wanting to write a program that will go to the internet and look at companies stock information and then make a decision to purchase or not. I have found very few books on the subject. Also, what is the best programming language for this type of task? Any suggestions would be very apprciated....Thanks
    :
    You can use a http reader class to read a page's html-content. It probably exists in MFC but I am sure that it exists in C#.
    You have to parse the html yourself ofcourse.
    For your purpose, stock values usually come in with a delay (15 minutes usually). A site that presents values real time pays for that information. It is probably illegal for you to get content from such a site.

    Greets,
    Eric Goldstein
    http://www.gvh-maatwerk.nl


Sign In or Register to comment.