EasyScrape

Getting Started

  • Quick Start
    • Installation
    • Your First Scrape
    • Extract Data
    • Built-in Helpers
    • JSON APIs
    • Next Steps
  • EasyScrape Tutorial
    • Table of Contents
    • 1. Introduction
      • What is Web Scraping?
      • Why EasyScrape?
      • Prerequisites
    • 2. Installation & Setup
      • Basic Installation
      • Verify Installation
      • Optional Dependencies
    • 3. Your First Scraper
      • Step 1: Import and Fetch
      • Step 2: Check the Response
      • Step 3: View the Content
      • Step 4: Extract Data
      • Complete Example
    • 4. CSS Selectors Deep Dive
      • Basic Selectors
      • Combinators
      • Pseudo-Selectors (EasyScrape Extensions)
      • Practical Examples
      • Finding the Right Selector
    • 5. Structured Data Extraction
      • Single Item Extraction
      • Multiple Items Extraction
      • Nested Extraction
    • 6. Configuration & Customisation
      • Creating a Configuration
      • Common Configuration Patterns
        • Development Mode
        • Production Mode
        • Stealth Mode
      • Custom Headers
      • Using Proxies
    • 7. Handling Pagination
      • Method 1: Follow “Next” Links
      • Method 2: Parameter-Based Pagination
      • Method 3: Offset-Based Pagination
      • Method 4: Manual Control
    • 8. JavaScript-Rendered Pages
      • Installation
      • Basic Usage
      • Wait for Content
      • Advanced Browser Control
    • 9. Asynchronous Scraping
      • Why Async?
      • Basic Async
      • Scraping Many Pages
      • With Progress Tracking
    • 10. Sessions & Authentication
      • Maintaining Cookies
      • Login Flow
    • 11. Error Handling
      • The Exception Hierarchy
      • Basic Error Handling
      • Specific Error Handling
    • 12. Data Export
      • Export to CSV
      • Export to JSON
      • Export to Excel
      • Export to DataFrame
    • 13. Best Practices
      • 1. Rate Limiting
      • 2. Respect robots.txt
      • 3. Identify Yourself
      • 4. Handle Errors
      • 5. Cache During Development
      • 6. Use Async for Large Jobs
    • 14. Real-World Project
    • Conclusion
      • Next Steps

User Guide

  • Configuration
    • Basic Configuration
    • Config Object
    • Available Options
    • Headers
    • Proxies
    • Rate Limiting
    • Environment Variables
  • Async Scraping
    • Basic Async
    • Concurrent Requests
    • Rate-Limited Concurrency
    • Error Handling
    • With Async Config
    • Best Practices
  • Browser Mode
    • When to Use
    • Basic Usage
    • Wait for Content
    • JavaScript Execution
    • Screenshots
    • Browser Options
    • Async Browser
    • Performance Tips
    • Limitations
  • Cookbook
    • Scrape a List of URLs
    • Extract Table Data
    • Handle Pagination
    • Save Results to JSON
    • Save Results to CSV
    • Retry with Backoff
    • Check robots.txt
    • Session Persistence
    • Download Files
    • Extract Metadata

Reference

  • API Reference
    • Core Functions
      • scrape()
      • async_scrape()
    • ScrapeResult
      • Properties
      • Methods
        • css(selector: str) -> str | None
        • css_all(selector: str) -> list[str]
        • json() -> dict | list
        • title() -> str | None
        • main_text() -> str
        • safe_links() -> list[str]
    • Configuration
      • Config
  • Changelog
    • [0.1.0] - 2025
      • Added
      • Documentation
EasyScrape
  • Search

© Copyright 2026, EasyScrape Contributors.

Built with Sphinx using a theme provided by Read the Docs.