Getting Started w/ Python, Spark, and Databricks: Difference between revisions
No edit summary |
|||
| Line 8: | Line 8: | ||
<pre>df = spark.read.parquet ( "/mnt/training/cimr-data-2016/Crime-Data-Boston-2016.parquet" )</pre> | <pre>df = spark.read.parquet ( "/mnt/training/cimr-data-2016/Crime-Data-Boston-2016.parquet" )</pre> | ||
== Viewing Results == | |||
=== Text Based (Generic) === | |||
<pre>show(df)</pre> | |||
=== Databricks Native Viewer === | |||
<pre>display(df)</pre> | |||
Revision as of 19:12, 2 August 2019
Loading Data
Viewing Contents of a Parquet Folder
%fs ls /mnt/training/crime-data-20016
Reading Parquet
df = spark.read.parquet ( "/mnt/training/cimr-data-2016/Crime-Data-Boston-2016.parquet" )
Viewing Results
Text Based (Generic)
show(df)
Databricks Native Viewer
display(df)