Skip to content

Fix job scraping and add bulk job collection CLI#293

Open
m-elhabib-dev wants to merge 1 commit into
joeyism:masterfrom
m-elhabib-dev:master
Open

Fix job scraping and add bulk job collection CLI#293
m-elhabib-dev wants to merge 1 commit into
joeyism:masterfrom
m-elhabib-dev:master

Conversation

@m-elhabib-dev

Copy link
Copy Markdown

New Features

  • Added collect_jobs.py CLI utility
  • Supports bulk collection across multiple keyword/location pairs
  • Supports JSONL, JSON and CSV exports
  • Deduplicates job URLs across searches
  • Incremental JSONL saving for crash recovery
  • Session reuse via linkedin_session.json
  • Configurable rate limiting delays

python collect_jobs.py
--keywords "Python Developer"
--locations "Remote"
--limit 100

python collect_jobs.py
--keywords "Python Developer,Data Scientist"
--locations "Remote,New York"
--format csv

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant