Getting Started w/ Python, Spark, and Databricks

Page Discussion

Revision as of 19:10, 2 August 2019 by Bpopp (talk | contribs) (→‎Reading Parquet)

(diff) ← Older revision | Latest revision (diff) | Newer revision → (diff)

Loading Data

Viewing Contents of a Parquet Folder

%fs ls /mnt/training/crime-data-20016

Reading Parquet

df = spark.read.parquet ( "/mnt/training/cimr-data-2016/Crime-Data-Boston-2016.parquet" )

Retrieved from "http://wiki.bpopp.net/index.php?title=Getting_Started_w/_Python,_Spark,_and_Databricks&oldid=802"