Python ETL Developer

Teamware Solutions

4 - 5 years

5 - 8 Lacs

Bengaluru Karnataka India

Posted:2 weeks ago| Platform: Foundit logo

Apply

Skills Required

ETL workflows Airflow Luigi

Work Mode

On-site

Job Type

Full Time

Job Description

Key Responsibilities:

Design, develop, and maintain ETL workflows and pipelines using
Python
Extract data from various sources (databases, APIs, flat files) and perform data transformations to meet business requirements
Load processed data into target systems such as data warehouses, data lakes, or databases
Optimize ETL processes for performance, scalability, and reliability
Collaborate with data architects and analysts to understand data requirements and design solutions
Implement data validation and error-handling mechanisms to ensure data quality
Automate routine ETL tasks and monitoring using scripting and workflow tools
Document ETL processes, data mappings, and technical specifications
Troubleshoot and resolve issues in ETL workflows promptly
Follow data governance, security policies, and compliance standards

Required Skills:

4 to 5 years of hands-on experience in
Python programming
for ETL development
Strong knowledge of ETL concepts and data integration best practices
Experience with ETL frameworks/libraries such as
Airflow, Luigi, Apache NiFi, Pandas
, or similar
Proficiency in SQL and working with relational databases (Oracle, MySQL, SQL Server, etc.)
Familiarity with data formats like JSON, XML, CSV, Parquet
Experience in cloud platforms and tools such as AWS Glue, Azure Data Factory, or GCP Dataflow is a plus
Understanding of data warehousing concepts and architectures (star schema, snowflake schema)
Experience with version control tools such as Git
Knowledge of containerization (Docker) and CI/CD pipelines is desirable

Preferred Qualifications:

Experience working with big data technologies such as Hadoop, Spark, or Kafka
Familiarity with NoSQL databases (MongoDB, Cassandra)
Experience with data visualization and reporting tools
Certification in Python or Data Engineering tools
Knowledge of Agile methodologies and working in collaborative teams

Soft Skills:

Strong analytical and problem-solving skills
Excellent communication and collaboration abilities
Detail-oriented and committed to delivering high-quality work
Ability to manage multiple tasks and meet deadlines
Proactive and eager to learn new technologies and tools

Mock Interview

Practice Video Interview with JobPe AI

Start Job-Specific Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.