Getting Started w/ Python, Spark, and Databricks: Difference between revisions

(Created page with "=== Viewing Contents of a Parquet Folder === <pre>%fs ls /mnt/training/crime-data-20016</pre>")
 
No edit summary
Line 1: Line 1:
== Loading Data ==
=== Viewing Contents of a Parquet Folder ===
=== Viewing Contents of a Parquet Folder ===


<pre>%fs ls /mnt/training/crime-data-20016</pre>
<pre>%fs ls /mnt/training/crime-data-20016</pre>
=== Reading Parquet ===
<pre>df = spark.read.parquet ( "/mnt/training/cimr-data-2016/Crime-Data-Boston" )</pre>

Revision as of 19:10, 2 August 2019

Loading Data

Viewing Contents of a Parquet Folder

%fs ls /mnt/training/crime-data-20016

Reading Parquet

df = spark.read.parquet ( "/mnt/training/cimr-data-2016/Crime-Data-Boston" )