All projects03 / 03
GreyLockGreen
Client project
- Type
- Client project
- Built with
- Python
- Source
- Private repository
preview
Project Overview
- A scalable Django-based platform with advanced scraping, reporting, and user management features.
Core Features
- User-friendly dashboard built with Django.
- Custom report generation with email delivery.
- Password recovery and multi-user support.
- AI-powered product query responses.
- Bulk upload, sold-out alerts, and new product tracking.
- Geographic filtering (city, state, zip).
Scraping Infrastructure
- High-capacity scrapers (thousands of requests/day).
- Regional deployment (West, Central, East).
- Centralized data storage.
- Database & Performance:
- Migrated to PostgreSQL with master-slave replication.
- TimescaleDB (optional), parallel query tuning.
- PgBouncer for efficient connection pooling.
- Regular VACUUM/ANALYZE and S3 backups.
DevOps & Deployment
- Dockerized app with permanent subdomain.
- Mail server for notifications and reports.
- Full logging and contact page.
Frameworks, tools & libraries
The stack behind it
Built with
- Python
- Django
- Selenium
- Beautifulsoup
- Pandas
- SQL-Alchemy
- Linux
- SQL
- PostgreSQL
- React
- NGINX
Screens
More screens
Next project
MSS Water Purifier
Client project