Auto Fill Dynamic(Ajax) Web Page & Scrape The Result!

2 min read
Large scale web scraping is always a big deal. However a simple crawl or filling web form & scraping the result is much easier than you think. While scraping a static page is a cat walk, it is little tricky to scrape dynamic web pages!

I wrote a simple script to fill a dynamic page ( ) & scrape the result  using Python, Mechanize & BeautifulSoup.

Check our the code on github. Its just a few lines of code and its self explanatory.

Clone the repo.
 git clone

Lest calculate howmany miles will be rewarded for travelling from Delhi(DEL) to New York(JFK).
 python DEL JFK

Here is the sample output of the script.

I am Chillar Anand. I daydream a lot and write about the things that interest me here. You can read more about this blog here.

See all articles

RSS Feed for the blog

Edit this page


Comments powered by Disqus