use proxy and cookie together in Python

Here is an example code in Python that fetches an URL and writes the content to a text file. The purpose of publishing the code is to demonstrate how to use Proxy and Cookie together in an opener.

import urllib2
import cookielib

# create cookiejar to store cookie
cj = cookielib.CookieJar()

# IP:PORT
proxy_address = '66.98.208.8:3128' # change the IP:PORT, this one is for example

# create the proxy handler
proxy_handler = urllib2.ProxyHandler({'http': proxy_address})

# create opener
opener = urllib2.build_opener(proxy_handler, urllib2.HTTPCookieProcessor(cj))

# install the opener
urllib2.install_opener(opener)

# url to browse / visit
url = "http://www....com/" # change the url

req=urllib2.Request(url)

data=urllib2.urlopen(req).read()

print data

# now write the data to a text file

# create file handler
fh = open('page.txt', 'w')

data = "".join(data)

# write to file
fh.write(data)

# close the file handler
fh.close()

Hope you will find the code useful.