Auto Fill Dynamic(Ajax) Web Page & Scrape The Result!


Large scale web scraping is always a big deal. However a simple crawl or filling web form & scraping the result is much easier than you think. While scraping a static page is a cat walk, it is little tricky to scrape dynamic web pages!


I wrote a simple script to fill a dynamic page ( http://www.emirates.com/account/english/miles-calculator/miles-calculator.aspx ) & scrape the result  using Python, Mechanize & BeautifulSoup.


Check our the code on github. Its just a few lines of code and its self explanatory.

Clone the repo.
 git clone https://github.com/ChillarAnand/Emirates-Miles-Calculator.git

Lest calculate howmany miles will be rewarded for travelling from Delhi(DEL) to New York(JFK).
 python emirates.py DEL JFK

Here is the sample output of the script.





I am Chillar Anand. I daydream a lot and write about the things that interest me here. You can read more about this blog here.

See all articles

Feeds

Edit this page