Get in Touch
 Duration 14 hours

Course Outline

Python Fundamentals for Data Workflows

  • Installing Python and configuring the development environment.
  • Core language concepts: variables, data types, and control structures.
  • Writing and executing simple Python scripts.

File Handling: CSV and Excel

  • Reading and writing CSV files using the csv module and Pandas.
  • Working with Excel files using openpyxl/xlrd and Pandas.
  • Practical exercises focused on automating file conversions.

Getting Started with Pandas

  • Essential DataFrame operations: creation, indexing, selection, and filtering.
  • Performing aggregation and grouping operations.
  • Common cleaning tasks: handling missing values, duplicates, and type conversions.

Getting Started with Polars

  • Understanding Polars concepts and its performance characteristics compared to Pandas.
  • Executing basic DataFrame operations in Polars.
  • Use-case analysis: determining when to prefer Polars over Pandas.

Advanced Data Transformation (Intermediate Level)

  • Executing complex joins, window functions, and pivot operations in Pandas.
  • Implementing efficient data processing patterns with Polars.
  • Chaining operations and optimizing memory usage.

Process Automation with Python

  • Developing scripts to automate repetitive data tasks and ETL steps.
  • Scheduling scripts using OS schedulers or task schedulers.
  • Implementing logging, error handling, and notification systems.

Script Packaging and Best Practices

  • Creating executables using PyInstaller or similar tools.
  • Structuring projects, managing virtual environments, and handling dependencies.
  • Fundamentals of version control and documenting workflows.

Hands-on Mini-Project

  • End-to-end workflow: reading raw files, cleaning and transforming data, and generating outputs.
  • Automating the workflow and packaging it as a runnable script or executable.
  • Reviewing and refining solutions based on peer feedback.

Summary and Next Steps

Requirements

  • Basic familiarity with programming concepts or a strong willingness to learn.
  • Confidence in using the command-line or terminal for installing packages.
  • Experience working with spreadsheets (CSV/Excel).

Target Audience

  • Data analysts and operations staff looking to automate data tasks.
  • Analytical engineers seeking lightweight ETL scripting capabilities.
  • Professionals interested in establishing practical Python-based data workflows.

Number of participants


Price per participant

Testimonials (2)

Upcoming Courses

Related Categories