Apache Spark Databricks Tutorial Zero to Hero(AWS, GCP, Azure) Series! - Session 1
This spark databricks tutorial for beginners video covers everything from basics to:
What is Databricks?
Installing Databricks Free Version From Scratch
Create Apache Spark(PySpark) Cluster
Create Databricks Notebook
Importing CSV File
Creating Parquet Table
Reading CSV File using PySpark(Apache Spark)
Running SQL Queries
Hope this video will help you understand what Databricks is and how it is used in collaboration with Microsoft Azure, Google Cloud Platform(GCP), and Amazon Web Services(AWS) for data engineering and data science solutions. This video also explains Apache Spark(Pyspark) as we create a data bricks notebook.
Overview
00:00- Introduction
00:33- Accessing Databricks
00:46- What is Databricks
01:45- Creating Account/Installation
03:14- Databricks Services Overview
03:58- Creating New Cluster'
06:19- Importing CVS File
06:28- Creating Table
06:24- Reading CVS File in Databricks
09:01- Creating New Notebook
11:20- Conclusion
I also show you how to create a parquet table(and what a parquet table is) and use PySpark to read the CSV files and running SQL queries. Hope this serves as an apache spark databricks tutorial for beginners who want to learn more about aws, gcp, and ms azure!
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Please SUBSCRIBE, LIKE, & SHARE:⤵⤵⤵⤵⤵⤵⤵
:https://www.youtube.com/c/CloudDataSc...
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
#databricks #azure #aws #gcp #spark #pyspark #DatabricksHeroToZero
Databricks Zero to Hero! - Session 1 | What is Databricks? | Reading CSV File