Not Your Average Web Crawler

  • Home

Python Module Index

n
 
n
- nyawc
    nyawc.Crawler
    nyawc.CrawlerActions
    nyawc.CrawlerThread
    nyawc.helpers
    nyawc.helpers.HTTPRequestHelper
    nyawc.helpers.RandomInputHelper
    nyawc.helpers.URLHelper
    nyawc.http
    nyawc.http.Handler
    nyawc.http.Request
    nyawc.http.Response
    nyawc.Options
    nyawc.Queue
    nyawc.QueueItem
    nyawc.scrapers
    nyawc.scrapers.CSSRegexLinkScraper
    nyawc.scrapers.HTMLSoupFormScraper
    nyawc.scrapers.HTMLSoupLinkScraper
    nyawc.scrapers.JSONRegexLinkScraper
    nyawc.scrapers.XMLRegexLinkScraper

Introduction

  • Home
  • Installation
  • Getting started
  • Kitchen sink

Options

  • Callbacks
  • Crawling scope
  • Crawling identity
  • Performance

API

  • Code API
  • Source (GitHub)

Search

N.Y.A.W.C v1.5.0 is open-sourced software licensed under the MIT license.