Getting Started w/ Python, Spark, and Databricks: Difference between revisions

No edit summary
Line 7: Line 7:
=== Reading Parquet ===
=== Reading Parquet ===


<pre>df = spark.read.parquet ( "/mnt/training/cimr-data-2016/Crime-Data-Boston" )</pre>
<pre>df = spark.read.parquet ( "/mnt/training/cimr-data-2016/Crime-Data-Boston-2016.parquet" )</pre>

Revision as of 19:10, 2 August 2019

Loading Data

Viewing Contents of a Parquet Folder

%fs ls /mnt/training/crime-data-20016

Reading Parquet

df = spark.read.parquet ( "/mnt/training/cimr-data-2016/Crime-Data-Boston-2016.parquet" )