I’ve been really wanting to use the Shapely+Fiona Duo and finally had the chance to put it to work. Using a bit of python magic, I quickly turned the 1.1 million Uber taxi gps points into point geometries and made these images. I’ve set the transparency between 93% and 97% (depending on zoom level).
Next thing that I’d like to do is to perhaps map where in the city the locational accuracy begins to break down due to the building heights and narrow urban canyons. You can see in the downtown/financial district area where the points begin looking a bit foggy or ghostly. Stay tuned for the next maps.
I’m really interested in pervasive sensing and technologies, especially for environmental monitoring applications. Given technological improvements, the development of cheaper solutions (e.g. arduino + raspberry pi), and growing opensource communities, sensing, collecting, and visualizing data/information is becoming more possible than ever before.
These days, environmental sensing is moving forward in many exciting ways, one of which is mobile sensing. Here I just drafted a quick animation using Unfolding for Processing which might suggest what mobile monitoring of some environmental variable might look like (e.g. air quality - see: OpenSense from the brains over at ETH in Switzerland)
In 2008, more than half of the world’s population could be found living in towns or cities; urbanization intensifying in the world’s mega-cities and extensifying in smaller ones. Here, I imagined the world as a Richter scale with lines being drawn from west to east, mapping the density of cities across lines of latitude (5 degree intervals). The lines connect the centroid of each city or town.
In the United States, the 3-1-1 telephone number allows city residents at the municipal level to phone in their various maintenance requests. From broken street lights to pot holes, citizens become the “eyes and ears of their neighborhoods” are able to file their complaints and document the problems that they would like to see resovled in their city. This maps shows all of the 3-1-1 calls from Boston, MA, from 2011, collected from the Citizen Connect Mobile Application.
Imagine swimming across Los Angeles as if pool-by-pool they form a river through the city; 43123 oases stitched together in a desert of hyper-urban reality. You float unabashed down your unmapped highway of water, but are confronted very quickly by the fact that you are not welcome in this realm of kidney and clover bowls, Olympic-sized parallelograms, and hot tubs. Threatened by an unforgiving obstacle course of disgruntled homeowners and an impending court order you continue from pool to pool, your reconciliation awaiting you in the next chlorinated ecosystem.
The LA Swimmer is based on the dataset of “The Big Atlas of LA Pools” and inspired by Frank Perry’s 1963 film, “The Swimmer”. We imagined that through the LA Swimmer, we might be able to make an allusion to the vision of a “river of pools”. However instead of a journey of self-discovery, we rather invite you to leap-frog from pool-to-pool and to see LA through the Google Car’s perfectly tall street view camera.
The “Big Atlas of LA Pools” is about the process of mapping and map-making in the contemporary age of big data, open data, crowdsourcing, and citizen science. The project attempts to highlight on one hand the emerging and powerful role of non-domain experts in the discovery of scientifically and socially relevant information, and on the other hand seeks to emphasize the darker, creepier, and more contentious issues surrounding data processing and exploration. As a “two-person army”, Benedikt Groß (DE) and Joseph K. Lee (US) located and traced the contours of over 43000 pools and other manmade water boundaries — features which computer vision could not adequately demarcate. Throughout their project, the two exploited the idea of “crowdsourcing” to process the aerial ortho-imagery of their study area in Los Angeles County and to validate their dataset using commercial online third-party services, namely clipping farms in India and Amazon Mechanical Turk. In addition, they mashed then together additional layers of contextual information that might suggest surprising, or intriguing, or sinister spatial relationships within LA’s social and physical landscapes.
The Atlas of LA Pools is a processed-based exploration of data and an experiment in data processing methods, analysis, and resourcing. While the final visualizations and text are intended to stand alone as visual and scientific contributions, they are limited in describing the journey through which the authors arrived at these maps.
The authors started with 39 georeferenced orthoimages of their study area in Los Angeles county. Two sets of images — one true color composite (red, green and blue wavelengths) and one false color composite (near infrared, red, and green wavelengths) — were sent to clipping factory farms to delineate the pool and manmade water boundaries as vectors. Clipping factory farms are services in India normally used to prepare product placement photos for onlineshops , they “clip” the product out and place it on a white background. The authors performed a quality check of the initial dataset, deleting falsely drawn pool and water boundaries and marking additional features from the source aerial footage which had been overlooked. The images were then resubmitted to the clipping factory to be reprocessed and were again reviewed by the authors. After passing this rigorous inspection, the geopositions (latitude and longitude) of each pool were viewed against higher resolution (~1 ft) Bing maps as provided by Microsoft. The authors then submitted these high-res images to Amazon Mechanical Turk and asked the workers to visually check whether a feature might be a pool (blue water) or not (blue roof); this was done twice to ensure that the geolocated features were accurately classified. At last, the authors manually resolved any of the conflicts in the dataset. The result: “The Big Atlas of LA Pools”
NAIP Orthoimagery The National Agriculture Imagery Program (NAIP) acquires aerial imagery during the agricultural growing seasons throughout the continental U.S. This data was used to find and trace the pools. The dataset is also used for the aerial imagery overview pages.
Bing Maps Bing Maps by Microsoft were used to show higher resolution images of the pool locations. This data was used to help validate the pools on through Amazon Mechanical Turk. Furthermore the images are also used to catalog the individual pools throughout these books.
Google Geocoder Google provides a service for geo-coding and reverse geocoding addresses (by translating latitude/longitude to addresses). This service was used to give each pool an address.
Eight Maps Eight Maps is a map mash-up of the people in the State of California who were actively opposed to passing same-sex marriage and made monetary contributions towards passing the proposition which would prevent it. Proposition 8 changed the California State constitution to prohibit same-sex marriage.
Megan’s Law Sex Offender List Megan’s Law is the informal term for the United States’ Sex Offender Act of 1994. This allows law enforcement agencies to make public the addresses and crimes of the registered sex offenders living in the United States.
Los Angeles Crime Dataset The Los Angeles Sheriff’s Department provides an extensive crime dataset which includes information regarding the geoposition, date, and type of crimes that have occurred in Los Angeles County. We used a yearly data file for 2011.
Land Use and Parcel Boundaries The Los Angeles County Office of the Assessor provides data regarding the land lot parcel boundaries and their specific land uses, property value, year built, and much more.
LA Neighborhood Definition The LA neighborhood boundaries were taken from the Los Angeles Times neighborhood definition dataset from June 2010.
"The Big Atlas of LA Pools" is a presentation of the data derived from satellite and aerial imagery, sourced from various governmental and non-governmental organizations, and processed by the authors. The information expressed in this collection is neither conclusive nor tested for statistical significance. The "swimming pool" dataset is enriched through spatial autocorre- lation, or in other terms by incorporating Tobler’s 1st Law of Geography: "Everything is related to everything else, but near things are more related than distant things." The data is therefore provided merely to suggest certain relationships and curiosities, not to define them.
74 Books, ca. 6000 pages
Covers show all shapes of the swimming pools overlaid
Aerial Imagery of the study area of the specific book, here all of LA
Process and workflow
LA’s neighborhoods with pool count
Each page shows all pool shapes of the particular neighborhood overlaid = neighborhood pool shape fingerprint
The map shows all sex offenders in LA and whether they have pools or not
Neighborhood maps and pool locations
Aerial Imagery of the study area of the specific book, here Downey
Pool catalog page, all pools are orderer according to their post address
Pool features e.g. area, dimensions, water evaporation, parcel price, crime …
All posters are based on the dataset of “The Big Atlas of LA Pools”.
Satellite Overview RGB (from the Big Atlas of LA Pools)
Satellite overview of the analyzed area 35 km by 49 km, from Beverly Hills to Long Beach (1716 km²).
Lambda Print, 100 cm x 145 cm
LA Sorted (from the Big Atlas of LA Pools)
Each pixel of the source satellite imagery classified into four categories (top to bottom): Sea, Developed Areas (streets, houses etc.), Pools and Vegetation + Soil. Within the categories each pixel is sorted to its greyscale value. A pixel represents the size of 2m x 2m, the image shows 428.955.900 pixels (17450 x 24582).
Lambda Print, 100 cm x 145 cm
Pool Shapes (from the Big Atlas of LA Pools)
The poster shows each pool’s shape overlaid one onto the other. The orientation (compass directions) of the pools has been normalized according to the longest axis and the centre points. The average pool size of all pools in Los Angeles is 4.99 m × 10.13 m.
Lambda Print, 100 cm x 145 cm
43123 (from the Big Atlas of LA Pools)
The map shows all 43123 pools of Los Angeles. Each pool has been hand-traced and quality checked via commercial online crowdsourcing services.
Lambda Print, 100 cm x 145 cm
Selected works coming soon! See blog.jk-lee.com for works in progress and experiments. image: Landsat ETM+ False Color Composite of Singapore, the “little red dot”.