Connecticut Fishing Data Analysis
Objective
The main goal of this project is to uncover new fishing spots and insights into local fishing trends. The project is divided into three key stages: Data Collection, Data Cleaning, and Data Visualization.
Step 1: Data Collection
During the Data Collection phase, publicly available data is gathered using a web scraper, which accesses and downloads all town-level data in Connecticut. The web scraper saves all the towns listed on the website to a list. It then iterates through the list via a for loop, searching for each town in the search bar. The downloaded data file is renamed and moved from the Windows download directory to the current working directory.
Step 2: Data Cleaning
In the Data Cleaning stage, all the collected data is combined into a single dataframe. The data undergoes wrangling and cleaning processes to ensure its accuracy and consistency. Any blank/NA rows are removed. To manage the large volume of data, it is filtered to include only the first 36 fish species out of the 90. A snippet of the distribution of all species found within the data can be seen below.
Step 3: Data Visualization
Finally, in the Visualization stage, the cleaned data is transformed into a dynamic dashboard, enabling users to observe local fishing trends effectively. The entire process is designed for reusability, facilitating the retrieval and analysis of future fish data.