Getting Started w/ Python, Spark, and Databricks: Difference between revisions
No edit summary |
|||
Line 7: | Line 7: | ||
=== Reading Parquet === | === Reading Parquet === | ||
<pre>df = spark.read.parquet ( "/mnt/training/cimr-data-2016/Crime-Data-Boston" )</pre> | <pre>df = spark.read.parquet ( "/mnt/training/cimr-data-2016/Crime-Data-Boston-2016.parquet" )</pre> |
Revision as of 19:10, 2 August 2019
Loading Data
Viewing Contents of a Parquet Folder
%fs ls /mnt/training/crime-data-20016
Reading Parquet
df = spark.read.parquet ( "/mnt/training/cimr-data-2016/Crime-Data-Boston-2016.parquet" )