Merge branch 'master' of https://github.com/REMitchell/python-scraping

Author: remitchell

README.md

@@ -1,9 +1,9 @@
 # Web Scraping with Python Code Samples
 
-These code samples are for the book <a href="http://shop.oreilly.com/product/0636920078067.do">Web Scraping with Python</a>
+These code samples are for the book <a href="http://shop.oreilly.com/product/0636920078067.do">Web Scraping with Python 2nd Edition</a>
 
 If you're looking for the first edition code files, they can be found in the <a href="https://github.com/REMitchell/python-scraping/tree/master/v1">v1</a> directory.
 
 Most code for the second edition is contained in <a href="https://jupyter.org/install.html">Jupyter notebooks</a>. Although these files can be viewed directly in your browser in Github, some formatting changes and oddities may occur. I recommend that you clone the repository, install Jupyter, and view them locally for the best experience.
 
-The web changes, libraries update, and I not infrequently make mistakes or typos. If you think you've spotted an error, please feel free to make a pull request against this repository.
+The web changes, libraries update, and make mistakes and typos more frequently than I'd like to admit! If you think you've spotted an error, please feel free to make a pull request against this repository.

chapter16/multiprocess_queue.py

@@ -21,6 +21,8 @@ def task_delegator(taskQueue, foundUrlsQueue):
             for link in links:
                 #Add new link to the taskQueue
                 taskQueue.put(link)
+                #Add new link to the visited list
+                visited.append(link)
 
 def get_links(bsObj):
     links = bsObj.find('div', {'id':'bodyContent'}).find_all('a', href=re.compile('^(/wiki/)((?!:).)*$'))
@@ -51,4 +53,4 @@ def scrape_article(taskQueue, foundUrlsQueue):
 processes.append(Process(target=scrape_article, args=(taskQueue, foundUrlsQueue,)))
 
 for p in processes:
-    p.start()
+    p.start()