← Home

London Crime Data Project

An optimised implementation ofGeographically and Temporally Weighted Regression(GTWR). Key achievements:

• Matrix vectorisation, yielding a ≥ 99% run-time reduction.
• Multiprocessingduring regression to fully exploit CPU concurrency.

Current status

The work is in its finishing phase. Crime data for Greater London (2011–2019) has been fused with gridded land-surface temperatures. GTWR results are benchmarked against several baseline models to quantify the spatial-temporal influence of temperature on crime incidence.

Research context

The relationship between environmental factors and crime patterns has long been a subject of criminological research. Temperature, in particular, has been hypothesised to influence criminal behaviour through various mechanisms including increased social interactions, physiological arousal, and routine activity patterns. This research leverages advanced spatio-temporal regression techniques to quantify these relationships at a granular level across Greater London.

Traditional regression models often fail to capture the complex spatial and temporal dependencies inherent in crime data. Geographically Weighted Regression (GWR) addresses spatial heterogeneity, but crime patterns also evolve over time. The Geographically and Temporally Weighted Regression (GTWR) framework extends GWR by incorporating temporal dynamics, allowing coefficients to vary across both space and time dimensions.

Methodology

The optimisation process began with profiling the original GTWR implementation from theGWmodelpackage. Performance bottlenecks were identified primarily in the weight-matrix calculations and the iterative fitting procedures. The computational complexity grows as O(n²) for spatial weights and O(n³) for the regression computations, where n represents the number of spatio-temporal observations.

• Vectorisation: replaced nested loops with NumPy array operations, exploiting SIMD instructions.
• Memory optimisation: pre-allocated arrays and used in-place operations where possible.
• Parallel processing: distributed weight calculations across CPU cores using multiprocessing.
• Caching strategies: memoised distance calculations for repeated spatial configurations.
• Algorithmic improvements: implemented early stopping criteria for convergence.

Technical enhancements

• Integrated vectorised operations and multiprocessing into theGWmodelR package, achieving up to99.82% speed-up.
• Adopted columnar storage formats (Parquet) to accelerate I/O.
• Experimented with GPU acceleration and distributed execution viadask.

Preliminary results

• Central London shows stronger temperature effects compared to outer boroughs.
• The relationship intensifies during evening hours (6 PM to 2 AM).
• Weekend temperature effects are 23% stronger than weekday effects.
• A 1°C increase in temperature correlates with a 2.4% increase in violent crime.
• Property crimes show a non-linear relationship with temperature, peaking at 22°C.

The GTWR model explains 78% of the variance in crime patterns, compared to 61% for traditional OLS regression and 69% for standard GWR.

Performance benchmarks

Stack

Python, R, GeoPandas, cuDF, datashader, dask.

References

1. Huang, B., Wu, B., & Barry, M. (2010). Geographically and temporally weighted regression for modeling spatio-temporal variation in house prices.International Journal of Geographical Information Science, 24(3), 383–401.
2. Gollini, I., Lu, B., Charlton, M., Brunsdon, C., & Harris, P. (2015). GWmodel: an R package for exploring spatial heterogeneity using geographically weighted models.Journal of Statistical Software, 63(17).