RSS Document Downloader
Automated document downloading from RSS feeds for real-time regulatory content acquisition.
- Role: Developer
- Timeline: February 2024
- Team: Solo Project
- Technologies: Python, RSS, PDF Processing, Streamlit
- Link: https://rss-feed-reader-and-pdf-downloader.streamlit.app/
Problem
Compliance teams need to monitor multiple regulatory RSS feeds (SEBI, RBI, AMFI) daily and download new circulars. Manual monitoring is tedious and risks missing critical updates.
Solution
Built an automated tool that monitors multiple RSS feeds, detects new documents, downloads PDFs automatically, organizes them by source/date, and provides a searchable interface for the document library.
Impact
- Monitoring 10+ regulatory RSS feeds
- Automatic download of new documents
- Zero missed circulars
- Searchable document archive
Key features
- Multi-feed RSS monitoring
- Automatic PDF download
- Duplicate detection
- Date-based organization
- Full-text search in documents
- Download history tracking
- Email notifications for new docs
- Scheduled monitoring jobs
Tech stack
- Frontend: Streamlit
- Backend: Python, feedparser, requests, PyPDF2
- Storage: Local filesystem, SQLite
- Deployment: Streamlit Cloud
What K Laxman learned
- Parsing various RSS feed formats reliably
- Handling network failures with retries
- Building incremental sync mechanisms
- Creating user-friendly document management UIs
Explore more
- Home — overview, skills and a built-in AI assistant
- Experience — roles at Think360 AI (CAMS), CAMS Mutual Funds and IIT Delhi
- Projects — GenAI, LLM, RAG and full-stack builds
- Education — IIT Delhi, M.Tech & B.Tech Computer Science
- GitHub Activity — open-source contributions
- Contact / Hire me