I recently managed to install scrapy on a Window 7 64-bit dev machine. It wasn't straight forward so I've
documented the process. Here are the binary install files you need for the install:
python-2.7.3.amd64.msi
lxml-2.3.4-py2.7-win-amd64.egg
pyOpenSSL-0.11.winxp32-py2.7.msi
Install Python using python-2.7.3.amd64.msi
Do not install for 'All users', instead select 'Just for me' otherwise you'll encounter this problem:
http://stackoverflow.com/questions/3008509/python-version-2-6-required-which-was-not-found-in-the-registry
Set an environment variable for
Variable: PYTHONPATH
Value: %PYTHONPATH%;C:\Python27\
Add C:\Python27\Scripts to PATH
Check Python's working from a command line:
Python
Ctrl+D to exit
Install easy_install
Go to http://pypi.python.org/pypi/setuptools#files
Right-click and download ez_setup.py from http://peak.telecommunity.com/dist/ez_setup.py
Now at this stage you could try and install Scrapy
easy_install -U Scrapy
but it fails:
** make sure the development packages of libxml2 and libxslt are installed **
The trick is not to do what it's telling you. Install the binaries, not the sources.
http://stackoverflow.com/questions/4598229/installing-lxml-module-in-python
http://lxml.de/installation.html
Download the binary file
http://www.lfd.uci.edu/~gohlke/pythonlibs/#lxml
Install lxml binary
easy_install lxml-2.3.4-py2.7-win-amd64.egg
Now at this stage, again your could try and install Scrapy
easy_install -U Scrapy
but it fails on pyOpenSSL. Download and install the binary pyOpenSSL-0.11.winxp32-py2.7.msi. Again select
"Just for me".
Finally easy_install scrapy and it works
easy_install -U Scrapy
scrapy
Scrapy 0.14.3 - no active project
Usage:
scrapy [options] [args]
Available commands:
fetch Fetch a URL using the Scrapy downloader
runspider Run a self-contained spider (without creating a project)
settings Get settings values
shell Interactive scraping console
startproject Create new project
version Print Scrapy version
view Open URL in browser, as seen by Scrapy
Use "scrapy -h" to see more info about a command
