process of data engineering, analytics engineering, web scraping, data preparation, data analysis for retail database organization and insights
data visualization in mobile app
data visualization in web app
data analysis for retail web scraped data
retail data extracted from web scraping service and saved in MongoDB database
process of web scraping in API service

From web scraping to data analysis

Description

✨ The current project is a basic process pipeline of extrating, transforming, loading, analysing and presenting. All of that was made by using suitable tools of web scraping, data analysis/presentation and databases.

✨ There is a high correlation between likes and dislikes. The most sold products are televisions and frigdes. MongoDB help us to extract more than 30000 offers, and optimize the data storage.

Made with: Python, Scrapy, MongoDB, Pandas, NumPy, Matplotlib, and Seaborn.