1
He installs ipython shell
pip install ipython
Then go into scrapy.cfg and add
shell = ipython
under [settings]
2
Now run scrapy shell
scrapy shell
the commands are listed when shell starts
3
Use the fetch() command in shell to start selecting html elements from site,
fetch('https://books.toscrape.com/')
We get a 200 response if it works
and it places the html page into a response
variable , we use css selectors on response to get data,
(see nxt lesson)