Thank you for sending your enquiry! One of our team members will contact you shortly.
Thank you for sending your booking! One of our team members will contact you shortly.
Duration 21 hours
Course Outline
Enterprise Architecture and Pipeline Design
- Multi-tier ETL architectures
- Creating modular and reusable components
- Cross-system hybrid methodologies
Advanced Performance Engineering
- Optimisation at the step level
- Strategies for parallelism and threading
- Surveillance of high-load pipelines
Automation, Scripting, and Custom Extensions
- Embedding scripts within transformations
- Building custom plugins
- Expanding PDI capabilities using Java and JavaScript
Complex Data Processing and Integrations
- Real-time and streaming integrations
- Interfacing with big data platforms
- Sophisticated file and API handling
Data Governance, Security, and Compliance
- Protecting transformations and credentials
- Data lineage and traceability
- Regulatory and compliance requirements
Enterprise Orchestration and Scheduling
- Overseeing large job networks
- Designing error recovery and failover mechanisms
- Orchestration at the environment level
Repository, Version Control, and CI/CD
- Strategies for enterprise repositories
- Connecting PDI with Git
- Continuous deployment workflows
Deployment, Monitoring, and Production Operations
- Transitioning solutions between environments
- Operational tools and dashboards
- End-to-end production readiness
Summary and Next Steps
Requirements
- A foundational grasp of ETL pipelines and data modelling
- Practical experience with intermediate-level PDI transformations
- Strong proficiency in SQL and scripting
Target Audience
- Senior data engineers
- ETL architects
- Professionals overseeing complex data integration tasks
Testimonials (1)
It's a hands-on session.
