{"repo":"KenMwaura1/nse-stock-scraper","free":true,"listed":false,"github":"https://github.com/KenMwaura1/nse-stock-scraper","clone":"git clone https://github.com/KenMwaura1/nse-stock-scraper.git","description":"This is Web Scraper utilizing Scrapy Framework, MongoDB and AfricasTalking to get stock prices for companies listed on the Nairobi Stock Exchange. This project will store ticker name and price as well notify via SMS once properly setup via AfricasTalking.","language":"Python","stars":22,"topics":["africastalking","github-actions","mongodb","pymongo","python3","scrapy"],"license":"MIT","category":"scrapers-browser-automation","readme_excerpt":"Daily Stock Price Scraper 📚 View Full Documentation 🚀 Quick Start 🐳 Docker Guide 📋 Project Structure Badges Overview A web scraper built with Scrapy that extracts live stock prices from the Nairobi Stock Exchange (NSE). The scraped prices are stored in a MongoDB Atlas database using PyMongo, and Atlas Charts is used to visualize the data. The accompanying article can be found here. Screenshots The actual platform we are scraping is afx website. Getting Started Prerequisites - Python 3.11 or higher (tested with 3.11, 3.12, 3.13) and pip - An Africa's Talking account - API Key and username from your account. Create an app and note the API key - A MongoDB Atlas account (free tier available) - Create a cluster and note the connection string Installation Clone the repository: Create and activate a virtual environment: Alternatively, if you're using pyenv: Install the required dependencies: Configuration Create an environment file for your credentials: Add your credentials (API keys, MongoDB connection string, etc.) to the .env file. You can reference the example file for the required variables. Alternatively, copy the example environment file: Then edit .env with your credentials. Required Environment Variables - MONGODB URI - MongoDB Atlas connection string (with credentials) - MONGODB DATABASE - MongoDB database name (default: nse data ) - at username - Africa's Talking account username - at api key - Africa's Talking API key - mobile number - Phone number for notifications ","default_branch":null,"files":null,"tree":[],"storefront":"/r/KenMwaura1","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/KenMwaura1/nse-stock-scraper/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}