Job
Description
As an experienced Python ETL Developer, you will be responsible for designing, developing, and optimizing data pipelines using Python, PySpark, Airflow, and other data processing frameworks. You should have the ability to work independently and communicate effectively in English. Key Responsibilities: - Develop and maintain ETL pipelines using Python, NumPy, Pandas, PySpark, and Apache Airflow. - Work on large-scale data processing and transformation workflows. - Optimize and enhance ETL performance and scalability. - Collaborate with data engineers and business teams to ensure efficient data flow. - Troubleshoot and debug ETL-related issues to maintain data integrity and reliability. Qualifications & Skills: - 8+ years of Python experience, with a focus on Python ETL development for at least 5 years. - Proficiency in PySpark, Apache Airflow, NumPy, and Pandas. - Experience with SQLAlchemy and FastAPI is an added advantage. - Strong problem-solving skills and the ability to work independently. - Good English communication skills to collaborate effectively with global teams. Preferred Qualifications: - Experience in cloud-based ETL solutions such as AWS, GCP, or Azure. - Knowledge of big data technologies like Hadoop, Spark, or Kafka. Please note that the additional details of the company were not provided in the job description. As an experienced Python ETL Developer, you will be responsible for designing, developing, and optimizing data pipelines using Python, PySpark, Airflow, and other data processing frameworks. You should have the ability to work independently and communicate effectively in English. Key Responsibilities: - Develop and maintain ETL pipelines using Python, NumPy, Pandas, PySpark, and Apache Airflow. - Work on large-scale data processing and transformation workflows. - Optimize and enhance ETL performance and scalability. - Collaborate with data engineers and business teams to ensure efficient data flow. - Troubleshoot and debug ETL-related issues to maintain data integrity and reliability. Qualifications & Skills: - 8+ years of Python experience, with a focus on Python ETL development for at least 5 years. - Proficiency in PySpark, Apache Airflow, NumPy, and Pandas. - Experience with SQLAlchemy and FastAPI is an added advantage. - Strong problem-solving skills and the ability to work independently. - Good English communication skills to collaborate effectively with global teams. Preferred Qualifications: - Experience in cloud-based ETL solutions such as AWS, GCP, or Azure. - Knowledge of big data technologies like Hadoop, Spark, or Kafka. Please note that the additional details of the company were not provided in the job description.
