In this project I performed data cleaning & preprocessing, feature extraction, extensive geospatial and time series analysis of the Pulsepoint Emergency Data as well as apply some clustering and dimensionality reduction techniques.
Please check Project Wiki for an in depth overview
PulsePoint offers a web client at web.pulsepoint.org that allows users to view the same data that appears in PulsePoint Respond with a browser.
The dataset was collected via web scraping using python libraries (selenium, postgreSQL). The logs were collected from 2021-05-02 to 2021-12-31.
NB: As per the copyright policy held by https://web.pulsepoint.org see more - https://www.pulsepoint.org/eula "The PulsePoint app and its data are available to users for their own personal use and cannot be redistributed", Hence I am not intending to publish the dataset
With this data, it is possible to assess the impact of local emergencies over the period as well as the regions where they were concentrated.
The project answers questions which could be inferred from this dataset, such as:
Location-based:
- What are the major incidents in terms of numbers?
- What are the major states and cities in terms of the number of incidents?
- Which regions have the highest number of incidents?
Time-based:
- Which dates have a higher number of incidents occurred?
- Which days of the week have a higher number of incidents occurred?
- Which time of the day has a higher number of incidents occurred?
Analysis:
- Find geolocations of the major locations
- Visualize major locations taking the number of incidents that occurred at those regions into account
- Cluster cities based on the time, duration, and the number of incidents that occurred at those places
tqdm==4.62.3
wordcloud==1.5.0
geopy==1.17.0
plotly==4.4.1
folium==0.8.3
geopandas==0.10.2
pdpipe==0.0.70
yellowbrick==1.3.post1
scikit-learn==0.22.2.post1