PJS-PS

Contents:

  • Scraping with Scrapy
  • Stepstone Scraper
  • Scrapy Spiders
  • Indeed Scraper
  • Main Function
PJS-PS
  • Index

Index

C | E | F | G | I | L | M | P | R | S | W

C

  • closed() (stepstonesearch.spiders.sitespider.sitespiderSpider method)

E

  • extract_items() (stepstonesearch.spiders.Links.LinksSpider method)
  • extract_job_id() (stepstonesearch.spiders.sitespider.sitespiderSpider method)

F

  • fetch_job_titles_from_mongodb() (in module run_scrapers_parallel)

G

  • get_latest_output_file() (in module stepstone_scraper)

I

  • indeed_scraper
    • module

L

  • LinksSpider (class in stepstonesearch.spiders.Links)
  • load_items() (stepstonesearch.spiders.sitespider.sitespiderSpider method)

M

  • main() (in module run_scrapers_parallel)
  • module
    • indeed_scraper
    • run_scrapers_parallel
    • stepstone_scraper
    • stepstonesearch.spiders.Links
    • stepstonesearch.spiders.sitespider

P

  • parse() (stepstonesearch.spiders.Links.LinksSpider method)
    • (stepstonesearch.spiders.sitespider.sitespiderSpider method)

R

  • run_scrapers_parallel
    • module
  • run_spiders() (in module stepstone_scraper)

S

  • save_to_mongo() (in module stepstone_scraper)
  • scrape_indeed_for_title() (in module indeed_scraper)
  • sitespiderSpider (class in stepstonesearch.spiders.sitespider)
  • start_requests() (stepstonesearch.spiders.sitespider.sitespiderSpider method)
  • stepstone_scraper
    • module
  • stepstonesearch.spiders.Links
    • module
  • stepstonesearch.spiders.sitespider
    • module

W

  • wait_for_file() (in module stepstone_scraper)

© Copyright 2025, Philipp Spall.

Built with Sphinx using a theme provided by Read the Docs.