- Install required packages:
pip install requests pandas numpy matplotlib seaborn scikit-learn networkx openpyxl- Configure your PubMed API Key (optional but recommended):
- Go to: https://www.ncbi.nlm.nih.gov/account/
- Sign in or create an account
- Go to API Key Management
- Generate your API key
- Edit
config.pyand replaceYOUR_PUBMED_API_KEY_HEREwith your actual key
python sclc_complete_search.pypython sclc_complete_search.py --pubmed-key YOUR_KEY_HEREpython sclc_complete_search.py --pubmed-key YOUR_KEY --max-per-query 50 --top-papers 200-
Phase 1: Mechanism-Based Search
- Searches 64 carefully crafted queries across 8 mechanism categories
- Uses PubMed, Europe PMC, and Semantic Scholar simultaneously
- Focuses on SCLC-specific vulnerabilities identified by Gemini
-
Phase 2: Deduplication
- Removes duplicate papers found across multiple searches
- Preserves the version with most complete information
-
Phase 3: Relevance Scoring
- Calculates multi-factor relevance scores considering:
- Mechanism novelty (SCLC-specific mechanisms scored higher)
- Query specificity (more specific searches ranked higher)
- Citation impact and influence
- Recency and open access availability
- Calculates multi-factor relevance scores considering:
-
Phase 4: Analysis Report
- Generates comprehensive JSON report with:
- Coverage by mechanism category
- Top cited papers in each category
- Research gaps identified
- Search effectiveness metrics
- Generates comprehensive JSON report with:
-
Phase 5: Reading List
- Creates prioritized reading list (CSV and Excel)
- Ensures diversity across mechanism categories
- Marks papers as High/Medium/Low priority
All results are saved in a timestamped directory:
sclc_search_results_YYYYMMDD_HHMMSS/
├── sclc_raw_results_*.csv # All search results
├── sclc_dedup_results_*.csv # Deduplicated results
├── sclc_analysis_report_*.json # Comprehensive analysis
├── sclc_reading_list_*.csv # Prioritized papers (CSV)
├── sclc_reading_list_*.xlsx # Prioritized papers (Excel)
└── sclc_search.log # Detailed execution log
- Direct Receptors - CB1/2, TRP channels, PPARs, orphan GPCRs
- Cell Death - Apoptosis, autophagy, ferroptosis, necroptosis
- SCLC Vulnerabilities - Neuroendocrine features, transcriptional subtypes, DLL3
- Signaling Pathways - PI3K/AKT/mTOR, NF-κB, MAPK, JAK/STAT
- Metabolic - Mitochondria, glycolysis, oxidative stress
- Tumor Microenvironment - Angiogenesis, immune modulation, CAFs
- Drug Resistance - ABC transporters, cancer stem cells, EMT
- Novel Mechanisms - ER stress, ion channels, epigenetics
- 80-100: Highly relevant, novel mechanisms, SCLC-specific
- 60-79: Good relevance, established pathways
- 40-59: Moderate relevance, may be tangential
- 0-39: Lower relevance, broad searches
- High: Read immediately - most likely to reveal new insights
- Medium: Important supporting literature
- Low: Background reading, established knowledge
-
Review the analysis report (
sclc_analysis_report_*.json)- Check coverage gaps
- Identify high-potential mechanisms
-
Start with High priority papers in reading list
- Focus on SCLC vulnerabilities and novel mechanisms
- Look for papers that bridge cannabinoid effects with SCLC biology
-
Track promising mechanisms for experimental validation
- Note specific assays mentioned in papers
- Identify druggable targets
-
Consider follow-up searches for:
- Specific compounds mentioned (e.g., WIN 55,212-2)
- Mechanism combinations showing promise
- Authors frequently appearing in results
Rate limit errors:
- The script includes delays between searches
- If you hit limits, wait 5 minutes and restart
No results for some queries:
- This is expected for novel mechanism combinations
- These represent research opportunities!
Memory issues with large searches:
- Reduce
--max-per-queryparameter - Process in batches by mechanism category
- Start with SCLC vulnerabilities - Highest novelty potential
- Look for convergent mechanisms - Multiple papers pointing to same pathway
- Note experimental methods - Build a toolkit for validation
- Track citation networks - Use Semantic Scholar links to find related work
- Identify combination opportunities - Mechanisms that could synergize
For questions or to report issues:
- Check the log file for detailed error messages
- Ensure all APIs are accessible from your network
- PubMed API key significantly improves reliability
Good luck with your research!