3.0 - 7.0 years

0 Lacs

chennai, tamil nadu

On-site

As a Big Data Engineer at the company, you will be responsible for implementing Big Data solutions in Cloud environments. Your technical skill set should include: - 3-5 years of experience in implementing Big Data solutions in Cloud environments - Hands-on experience with Airflow DAG, Spark, Python, Hive, Trino, S3 Bucket, etc - Experience with Cloud Data platforms like SnowFlake and Databricks is a plus - Knowledge of the Financial domain, especially the Credit Card industry, is beneficial Your responsibilities will include: - Creating ELT Data pipelines using Python scripts and Airflow DAG - Optimizing Data pipelines by configuring Spark system resources - Debugging existing Microsoft BI E...

Posted 17 hours ago

AI Match Score

Apply

Apache Airflow SME Pixelcode Technologies India

5.0 - 10.0 years

5 - 15 Lacs

Hyderabad, Pune, Bengaluru

Work from Office

We are seeking an experienced Apache Airflow Subject Matter Expert (SME), (Contract , Remote - India ) to join our Data Engineering team . You will be responsible for optimizing Airflow environments, building scalable orchestration frameworks, and supporting enterprise-scale data pipelines, while collaborating with cross-functional teams. Skills: Optimize and fine-tune existing Apache Airflow environments, addressing performance and reliability. Design and develop scalable, modular, and reusable Airflow DAGs for complex data workflows. Integrate Airflow with cloud-native services such as data factories, compute platforms, storage, and analytics . Develop and maintain CI/CD pipelines for DAG ...

Posted 2 months ago

AI Match Score

Apply

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.