10 Python Examples for City Analytics In 10 minutes. Lorraine Barry

Transcription

1 10 Python Examples for City Analytics In 10 minutes Lorraine Barry Queen s University Belfast Department for barry

2 1. Tweepy 2. Pandas and Geopandas 3. SQLalchemy 4. Missingno 5. PySAL 6. NetworkX 7. OSMNx 8. Matplotlib 9. Plotly 10. Bokeh Import Cleaning Query Analysis Visualisation

3 Anaconda

4 A web-based interactive computing interface and platform that combines code, equations, text and visualisations.evolved from JUlia, PYThon, and R Jupyter

5 Tweepy Stream tweets from the Twitter API. Filter out the tweets that aren t relevant. Process the tweets to figure out what emotions they express about each candidate. Store the tweets for additional analysis. Map the geolocated tweets

6

7

8 Pandas & Geopandas Pandas - Python Data Analysis Library high-performance, easy-to-use data structures and data analysis tools for the Python

9 Pandas Road Surface Defects, Open Data NI Query Eastern Division

10 SQLalchemy SQLite: An self-contained, server-less database that's easy to set-up and query from Pandas. single file and easy to configure, SQLite is very fast

11 SQLite Import SQLalchemy package module Read first 2 rows of 311 CSV file 1.26GB Create Engine and Query

12 missingno Dealing with missing data is a pain. missingno allows you to quickly gauge the completeness of a dataset with a visual summary, instead of trudging through a table. You can filter and sort data based on completion or spot correlations with a heatmap or a dendrogram.

13 Missingno Belfast City Trees Database

14 PySAL Python Spatial Analysis Library

15 PySAL Create Regions & Model Census Ward Flow Data 582 origins and destinations with the flows of commuters. 582 X 582 potential flows = 338,724 pairs with values Super Output Area level 890 x 890 = 792,100 pairs with values

16 PySAL Create Regions & Model From 582 to 24 regions mapped on distance decay values

17 Networkx NetworkX is a Python package for the creation, manipulation, and study of the structure, dynamics, and functions of complex networks.

18 X, Y to Route and Length Create graph of edges and nodes from shapefile road network Read list of origin and destination points Snap to closest network node and find shortest path Sum path length

19 X, Y to Route and Length

20 OSMnx Retrieve, construct, analyze, and visualize street networks from OpenStreetMap

21 Belfast Open Street Map Network import osmnx as ox from IPython.display import Image %matplotlib inline ox.config(log_console=true, use_cache=true) # configure the inline image display img_folder = 'images' extension = 'png' size = 480 G = ox.graph_from_address('belfast, UK', distance=3000, network_type='drive ) G_proj = ox.project_graph(g) fig, ax = ox.plot_graph(g_proj, bgcolor='#000000', edge_color='#ffffff', node_size=0, save=true, show=false, close=true, filename='belfast_streets', dpi=100) Image('{}/{}.{}'.format(img_folder, 'belfast_streets', extension), height=size, width=size)

22 Matplotlib Matplotlib is a Python 2D plotting library

23 Matplotlib maps, graphs, charts

24 Plotly Modern Visualization for the Data Era Data Visualisation via the Web

25 Plotly 311 calls Noise Complaints Per Hour

26 Plotly 311 calls Noise Complaints Per Hour

27 Bokeh Bokeh is an interactive data visualization library for Python (and other languages!) that targets modern web browsers for presentation. It can create versatile, data-driven graphics, and connect the full power of the entire Python data-science stack to rich, interactive visualizations.

28

29 Counts by Mode of Travel into Belfast from Local Government Districts 2011 Data from UK Census Data Service SWS

30 2011 Train Travel into Belfast

31 10 Python Examples for City Analytics In 10 minutes Lorraine Barry Queen s University Belfast Department for barry