Skip to content

Latest commit

 

History

4 Commits

Folders and files

Repository files navigation

🕸️ Web Scraper App

🚀 Live Demo:
https://web-scraper-app-7c4t.onrender.com

A lightweight web application built with Flask that allows users to enter any website URL, scrape its content using BeautifulSoup, and download the structured data in multiple formats — PDF, Word (DOCX), and Excel (XLSX).


🚀 Features

  • 🌐 Enter any valid webpage URL
  • 🧠 Extract content using BeautifulSoup
  • 📁 Outputs saved in:
    • PDF (output.pdf)
    • DOCX (output.docx)
    • XLSX (output.xlsx)
  • 🗂️ Keeps only the latest 5 output folders (auto deletes old ones)
  • 🔁 UI auto-refreshes after scraping
  • 🐳 Dockerized for one-command deployment

📦 Technologies Used

  • Python 3.10
  • Flask
  • BeautifulSoup
  • python-docx, pandas, fpdf, openpyxl
  • Docker & Docker Compose

🧪 Local Development

1. Clone the repository

```bash git clone https://github.com/ankulmaurya/web-scraper-app.git cd web-scraper-app ```

2. Run with Docker Compose

```bash docker-compose up --build ```

🧭 Open: http://localhost:5000


🐳 Run via Docker (Standalone)

```bash docker pull ankulmaurya/web-scraper-app:latest docker run -p 5000:5000 ankulmaurya/web-scraper-app ```


📂 Output Folder Structure

Each scrape creates a folder like:

``` Backend/ └── based_output/ └── output_YYYYMMDD_xxxxxx/ ├── output.pdf ├── output.docx └── output.xlsx ```

🔒 Only 5 folders are kept — oldest ones are deleted.


📷 UI Preview

Add this image in docs/screenshot.png and update link below

``` Web Scraper UI ```


📄 License

MIT © Ankul Maurya EOF

Releases

Packages

Contributors

Languages