The processed data is publicly available in this
BigQuery table . You can find some interesting queries to run against this data in
this gist .
Though NYC taxi cab journeys may not seem to amount to much, they actually that conceal a ton of information, which Google Cloud Dataflow, as a powerful big data tool, helped reveal by making big data processing easy and affordable. Maybe I'll try
London's black cabs next.
- Posted by Thorsten Schaeff, Sales Engineer Intern
experimenting with it by applying for the alpha program or learn more with yesterday's update .NYC neighbourhood tabulation areas into single-part polygons. You can find the processed data in this public BigQuery table . (In order to access BigQuery you need to have at least one project listed in your Google Developers Console . After creating a project you can access the table by following this link .)Thematic map showing the distribution of taxi pick-up locations in NYC in 2013. Midtown South is New Yorkers’ favourite area to get a cab with almost 28 million trips starting there, which is roughly 1 trip per second. You can find an interactive map here .
beautiful visualizations . By utilizing the power of Google Cloud Platform's tools, I’ve been able to spatially aggregate the data using Cloud Dataflow , and then do ad hoc querying on the results using BigQuery , to gain fast and comprehensive insight into this immense dataset.Google Developers Blog .API I built on App Engine which exposes a list of geofences stored in Datastore. Using the Java Topology Suite I created a spatial index maintained in a class variable in the memory of each instance for fast querying access.The interactive Cloud Dataflow graph of your Pipeline, helping you to monitor and debug your Pipeline in your Google Developer Console in the browser.
*As cash tips aren’t reported, only 52% of trips have a tip noted, therefore the values regarding tips could be inaccurate. Here's an interactive map visualizing where people went to, what they paid on average and how they tipped at and some other visualizations of of how people tip from where:
BigQuery table . You can find some interesting queries to run against this data in this gist .London's black cabs next.
No comments :
Post a Comment