Description
If you have ever worked with Census Data, you may be recalling nightmares of hours spent staring at data and finding it impossible to download, store, or convert to a sensible format to begin your analysis. And Census data is not even unstructured data!
Geospatial Data comes in various formats - GeoJSON, Parquet, Shapefiles, GeoTIFF, etc. But what are the most efficient ways to convert the data into formats that are easy to understand, work with, transfer, and ultimately analyze? Then throw in petabytes worth of data and you hit the challenge of wrangling geospatial data at scale.
This talk will walk through some of the best ways to handle geospatial data at scale, with a focus on:
- The xarray-spatial library (https://xarray-spatial.org/) for raster-based spatial analysis.
- The RTXpy (https://github.com/makepath/rtxpy) for GPU-powered spatial analysis.
- Microsoft Planetary Computer (https://planetarycomputer.microsoft.com/) examples of geospatial data processing.