Tackling urban problems with Big Data

April 24, 2014 by Kathleen Maclay
Paul Waddell hopes to improve life in San Francisco and to contribute to the growing knowledge about how Big Data can affect significant social change through the city's Entrepreneurs in Residence program. Credit: iStock

Paul Waddell, a city planning professor at the University of California, Berkeley, with a penchant for conducting research with what he calls his "big urban data," is putting his work to a real-world test in San Francisco.

His high-tech startup "Synthicity" has been chosen from a field of nearly 200 applicants as one of San Francisco's six new Entrepreneurs in Residence, a program that is bringing together the private sector and departments to explore innovative solutions to civic challenges.

Waddell said he hopes to improve life in San Francisco and to contribute to the growing knowledge about how Big Data can affect significant social change, a subject that he said is of increasing concern in academia and beyond, as reflected on campus by the new Berkeley Institute for Data Science and related initiatives.

He said he launched Synthicity as a Berkeley startup in late 2012 to bring research ideas in urban planning, analysis and visualization to scale by developing new technologies to translate massive amounts of data into practical solutions to a range of urban problems.

San Francisco Mayor Ed Lee recently announced the entrepreneurship winners, who will spend sixteen weeks collaborating with City departments to test innovative solutions to some of the city's most pressing problems.

"San Francisco is home to the world's greatest entrepreneurs, the ones who have 'disrupted' numerous industries, and we are bringing those same disruptive technologies to improve delivery of City services for our residents," said Mayor Lee. "The Entrepreneurship-in-Residence program brings together government and startups to explore ways we can use technology to make government more accountable, efficient and responsive."

Synthicity will work with the San Francisco Planning Department on new simulation, planning and urban development tools and technologies.

Testing ground

The Synthicity team—which includes a UC Berkeley Ph.D. student in the city and program and two alumni from the Masters in City Planning program, among others—integrate and analyze data on urban parcels, buildings, businesses, households and transportation, and conduct statistical analyses on that integrated data to assess city planning problems.

Waddell said Synthicity staff hope to hone their insights into the challenges of a large, complex city like San Francisco, then refine and improve Synthicity's software modeling platforms to help find solutions.

"If we succeed in improving the productivity and effectiveness of planners in an iconic city like San Francisco—with its well-known active citizenry and development challenges—we think that will show that we can do it just about anywhere," said Waddell.

Like SimCity, but real

Waddell said that Synthicity first formed as a consultancy to support planning agencies with the technical know-how to use UrbanSim, a software-based urban modeling platform that he designed to simulate real estate markets, demands for new housing and other land uses, as well as land prices, rents, development decisions and how changing land use policies impacts alternative transportation investments.

"It's a bit like SimCity," said Waddell, referencing the popular city-building video game. "But UrbanSim is for informing actual decisions, in real communities."

UrbanSim has been used by planning agencies in regions as diverse as Denver, Detroit, Salt Lake City, Seattle and Paris, to assess potential impacts of major urban landscape and market changes due to proposed projects or policy changes.

So far, Bay Area regional planning agencies have used UrbanSim to coordinate land use and transportation plans to meet new state laws reducing greenhouse gas emissions. Planning agencies in France are also using it to evaluate how the Grand Paris Express, a massive new regional metro system, will affect regional development patterns in Greater Paris.

Mike Reilly, a UC Berkeley graduate, is a planner with the Association of Bay Area Governments based in nearby Oakland. He has used UrbanSim modeling for five years to examine alternate configurations for future housing and employment development. Reilly said UrbanSim is a great tool for analyzing the economic forces that shape cities and simulating how well public policies can meet regional goals.

Visualizing solutions

Waddell said that for faster data visualization and analysis, some projects need even more tools than contained in UrbanSim. So under the umbrella of Synthicity, he teamed up with specialists in 3D computer graphics and students in city and regional planning to go even further. The result is UrbanCanvas, a new platform for designing and visualizing alternative development projects and zoning policies, in conjunction with a 3D visualization platform called GeoCanvas that interprets massive urban datasets quickly and interactively.

"Overall, Synthicity excels by combining powerful analytics for urban planning with intuitive visualizations of the city," Reilly said.

Waddell is including a free public beta version test of GeoCanvas in his San Francisco entrepreneurship program, while also offering an early test drive to data scientists, planners, real estate analysts, market researchers and others who need to visualize large spatial datasets and do it fast. He said he wants to refine GeoCanvas and its carefully curated set of tools that eliminates much of the complexity inherent in traditional GIS systems for a final streamlined, intuitive user interface.

"We have an exciting opportunity to work in San Francisco on real-world urban problems and bring exciting new tools into practice for cities struggling to address huge issues like affordable housing and accommodating population growth for very diverse populations, while empowering residents to participate more directly," said Waddell.

Explore further: Google pledges $6.8M for San Francisco program

Related Stories

LinkedIn to anchor new San Francisco high-rise

April 23, 2014

San Francisco Mayor Ed Lee says the professional networking site LinkedIn will expand its presence in the city by anchoring a high-rise office building under construction.

Google's trial ferry service in SF Bay ends

February 9, 2014

Google has ended a trial run of transporting workers to the company's Silicon Valley campus by water, and it's unclear whether the tech giant will continue the ferry service.

Recommended for you

When words, structured data are placed on single canvas

October 22, 2017

If "ugh" is your favorite word to describe entering, amending and correcting data on the rows and columns on spreadsheets you are not alone. Coda, a new name in the document business, feels it's time for a change. This is ...

Enhancing solar power with diatoms

October 20, 2017

Diatoms, a kind of algae that reproduces prodigiously, have been called "the jewels of the sea" for their ability to manipulate light. Now, researchers hope to harness that property to boost solar technology.


Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.