Delivered online or onsite, these instructor-led PySpark training courses utilize hands-on exercises to demonstrate how to integrate Python and Spark for big data analysis.
PySpark instruction is offered as either "online live training" or "onsite live training". Online live training, also referred to as "remote live training," is conducted via an interactive remote desktop. Onsite live training can be hosted at client premises in Durban or within NobleProg’s corporate training facilities in Durban.
NobleProg -- Your Local Training Provider
Garden Court South Beach
Durban, South Africa
Way to get there
From Durban city centre: follow the beachfront/Marine Parade south toward South Beach.
By car/taxi: give the driver the address 73 O.R. Tambo Parade, South Beach, Durban 4001.
From King Shaka International Airport: the hotel is roughly 30 km ;from the airport.
This live, instructor-led training in Durban delves into the Stratio platform, with a specific focus on the Rocket and Intelligence modules enhanced by PySpark. Participants will gain mastery over data ingestion, transformation, and advanced analytics, while developing practical skills in loops, UDFs, and enterprise-grade data workflows.
In this live, instructor-led training in Durban, participants will learn how to combine Python and Spark to analyze big data, supported by practical hands-on exercises.
By the end of this training, participants will be able to:
Analyze big data effectively by utilizing Spark alongside Python.
Apply their skills through exercises that reflect real-world scenarios.
Leverage various tools and techniques for big data analysis using PySpark.
This instructor-led, live training (online or onsite) is aimed at data engineers, data analysts, and data professionals who wish to use Databricks and PySpark to build scalable data pipelines and migrate existing SQL workflows.
This course offers a hands-on introduction to developing scalable data processing and Machine Learning workflows using PySpark. Participants will gain insight into how Apache Spark functions within contemporary Big Data ecosystems and how to efficiently manage large datasets by applying distributed computing principles.
This three-day practical course is dedicated to constructing and refining high-efficiency data-processing workloads by leveraging PySpark, Pandas and Polars within Kubernetes-based environments.
Attendees will gain a hands-on grasp of how Spark applications operate on Kubernetes and how choices made at the application level directly impact performance, scalability, resource usage and overall cost. The curriculum addresses critical optimisation domains, including executor sizing, memory allocation, dynamic allocation, partitioning strategies, shuffle dynamics, the small-file issue and efficient Parquet handling.
Furthermore, the course tackles common obstacles encountered when using Pandas, such as memory constraints and out-of-memory errors, and presents Polars as a high-performance alternative for specific data-processing tasks. Through practical exercises, participants will learn to diagnose performance and memory bottlenecks, evaluate various configuration strategies and apply optimisation techniques to realistic ETL and machine learning use cases.
The core focus of the course remains on practical decision-making: learning to identify bottlenecks, choose the right tools, configure Spark effectively and strike a balance between performance, infrastructure resource consumption and cost.
Read more...
Last Updated:
Testimonials (2)
Showing different ways to optimize our PySpark queries.
Ivan Abrashev - UBB + DZI (KBC GROUP)
Course - Efficient Data Processing on Kubernetes with PySpark, Pandas & Polars
I liked that it was practical. Loved to apply the theoretical knowledge with practical examples.
Online PySpark training in Durban, PySpark training courses in Durban, Weekend PySpark courses in Durban, Evening PySpark training in Durban, PySpark instructor-led in Durban, Online PySpark training in Durban, Weekend PySpark training in Durban, PySpark classes in Durban, PySpark coaching in Durban, PySpark private courses in Durban, Evening PySpark courses in Durban, PySpark boot camp in Durban, PySpark trainer in Durban, PySpark instructor in Durban, PySpark instructor-led in Durban, PySpark on-site in Durban, PySpark one on one training in Durban