Thank you for sending your enquiry! One of our team members will contact you shortly.
Thank you for sending your booking! One of our team members will contact you shortly.
Duration 21 hours
Course Outline
Enterprise Architecture and Pipeline Strategy
- Multi-layer ETL architectural patterns
- Crafting modular, reusable components
- Hybrid integration methodologies across systems
Advanced Performance Engineering
- Step-level performance tuning
- Strategies for parallelism and threading
- Observability for high-load pipelines
Automation, Scripting, and Custom Extensions
- Embedding scripts within transformations
- Creation of custom plugins
- Enhancing PDI functionality using Java and JavaScript
Complex Data Processing and Integrations
- Real-time and streaming data integration
- Interoperability with big data platforms
- Advanced handling of files and APIs
Data Governance, Security, and Compliance
- Protecting transformations and managing credentials
- Establishing data lineage and traceability
- Adhering to regulatory and compliance standards
Enterprise Orchestration and Scheduling
- Oversight of extensive job networks
- Designing error recovery and failover mechanisms
- Orchestration at the environment level
Repository, Version Control, and CI/CD
- Strategies for enterprise repositories
- Synchronizing PDI with Git
- Implementing continuous deployment patterns
Deployment, Monitoring, and Production Operations
- Transitioning solutions across environments
- Leveraging operational tools and dashboards
- Achieving full end-to-end production readiness
Summary and Next Steps
Requirements
- Foundational grasp of ETL pipelines and data modeling concepts
- Proficiency with intermediate-level PDI transformations
- Strong competencies in SQL and scripting
Target Audience
- Senior data engineers
- ETL architects
- Specialists overseeing complex data integration operations
Testimonials (1)
It's a hands-on session.
