SERGE AURUBIN

DATA SCIENTIST

Welcome to my blog for everything having to do with data science and analysis. I am always looking for new opportunities to drive business insight using data analysis.

Data & Analytics

Data Analysis
Power BI
Excel
Data Pipelines
Matillion

Engineering

Software Developer
Python
PHP
ReactJS
Flutter
Front End Dev
Back End Dev

Databases

MySQL Dev/DBA
Oracle DBA

Cloud & AI

Amazon Web Services
Docker
Kubernetes
Git
Artificial Intelligence
Claude
OpenAI

Back to Videos

PySpark Crash Course - Distributed Data Processing in Python

NeuralNine

July 31, 2026 1

0 Watch on YouTube

????️ Need some help with a project or some consulting? Contact me here: https://www.neuralnine.com/services

???? The Python Bible Book: https://www.neuralnine.com/books/
???? The Algorithm Bible Book: https://www.neuralnine.com/books/

(0:00) Intro
(1:54) Apache Spark Theory
(6:09) Environment Setup
(10:06) DataFrame API Basics
(23:21) ETL Pipeline with AWS S3
(36:42) DataFrame API VS RDD API
(47:29) Streaming Data Example
(51:28) Distributed Machine Learning
(57:19) Outro

0 Comments

No comments yet. Be the first to weigh in.