Skip to content

scrapy/scrapy-lint

 
 

Repository files navigation

scrapy-flake8

A Flake8 plugin to catch common issues on Scrapy spiders.

Issue types

Code Meaning
SCP01 There are URLs in start_urls whose netloc is not in allowed_domains
SCP02 There are URLs in allowed_domains
SCP03 Usage of urljoin(response.url, '/foo') instead of response.urljoin('/foo')
SCP04 Usage of Selector(response) in callback

This is a work in progress, so new issues will be added to this list.

Contributors 4

  •  
  •  
  •  
  •  

Languages