Thank you for sending your enquiry! One of our team members will contact you shortly.
Thank you for sending your booking! One of our team members will contact you shortly.
Course Outline
Enterprise Architecture and Pipeline Design
- Multi-layered ETL architectural patterns.
- Creating modular, reusable components.
- Adopting hybrid approaches across different systems.
Advanced Performance Engineering
- Optimization at the step level.
- Strategies for parallelism and threading.
- Monitoring pipelines under high load.
Automation, Scripting, and Custom Extensions
- Writing scripts within transformations.
- Building custom plugins.
- Expanding PDI functionality using Java and JavaScript.
Complex Data Processing and Integrations
- Implementing real-time and streaming integrations.
- Interacting with big data platforms.
- Advanced handling of files and APIs.
Data Governance, Security, and Compliance
- Securing transformations and managing credentials.
- Tracking data lineage and traceability.
- Addressing regulatory and compliance requirements.
Enterprise Orchestration and Scheduling
- Managing extensive job networks.
- Designing error recovery and failover mechanisms.
- Executing orchestration at the environment level.
Repository, Version Control, and CI/CD
- Strategies for enterprise repositories.
- Integrating PDI with Git for version control.
- Implementing continuous deployment patterns.
Deployment, Monitoring, and Production Operations
- Promoting solutions between various environments.
- Utilizing operational tools and dashboards.
- Achieving end-to-end production readiness.
Summary and Next Steps
Requirements
- A solid grasp of ETL pipelines and data modeling concepts.
- Practical experience with intermediate-level PDI transformations.
- Strong command of SQL and scripting languages.
Target Audience
- Senior data engineers.
- ETL architects.
- Professionals responsible for managing complex data integration tasks.
21 Hours
Testimonials (1)
It's a hands-on session.
