Get in Touch

Course Outline

Python Essentials for Data Operations

  • Setting up the development environment and installing Python
  • Fundamental language concepts: variables, data types, and control structures
  • Writing and executing basic Python scripts

File Management: CSV and Excel

  • Reading and writing CSV files utilizing the csv module and Pandas
  • Handling Excel files with openpyxl/xlrd and Pandas
  • Practical exercises: automating file conversion tasks

Getting Started with Pandas

  • DataFrame fundamentals: creation, indexing, selection, and filtering
  • Operations involving grouping and aggregation
  • Standard cleaning techniques: handling missing values, duplicates, and type conversions

Introduction to Polars

  • Core concepts of Polars and its performance benefits compared to Pandas
  • Essential DataFrame operations within Polars
  • Use-case scenarios: determining when to select Polars over Pandas

Advanced Data Transformation (Intermediate Level)

  • Complex joins, window functions, and pivot operations in Pandas
  • Efficient data processing patterns using Polars
  • Chaining operations and optimizing memory utilization

Process Automation with Python

  • Developing scripts to automate repetitive data tasks and ETL processes
  • Scheduling scripts using OS schedulers or task scheduler tools
  • Implementing logging, error handling, and notification systems

Script Packaging and Best Practices

  • Creating executables using PyInstaller or similar utilities
  • Project structuring, managing virtual environments, and dependency management
  • Fundamentals of version control and documenting workflows

Hands-on Mini-Project

  • End-to-end task: ingesting raw files, cleaning and transforming data, and generating outputs
  • Automating the workflow and packaging it as a runnable script or executable
  • Reviewing results and implementing improvements based on peer feedback

Summary and Future Steps

Requirements

  • Basic understanding of programming concepts or a strong willingness to learn
  • Proficiency in using the command line or terminal for package installation
  • Experience working with spreadsheet files (CSV/Excel)

Target Audience

  • Data analysts and operations personnel looking to automate data tasks
  • Analytical engineers aiming for lightweight ETL scripting solutions
  • Professionals seeking practical, Python-driven data workflows
 14 Hours

Number of participants


Price per participant

Testimonials (2)

Upcoming Courses

Related Categories