19344 Airflow Jobs - Page 8

Required Skills: Strong expertise in SQL and PL/SQL. Hands-on experience with DBT (not just theoretical knowledge). Ability to reverse engineer Oracle code and convert to DBT models. Familiarity with high-volume data processing. Optional: Experience with Java (plus, not mandatory) & Knowledge of Airflow (plus, not mandatory). Suggest performance improvements (e.g., clustering, merge optimization). Work independently without hand-holding. Collaborate with existing frameworks and standards. Strong expertise inSQLandPL/SQL. Strong hands-on experience withDBT(not just theoretical knowledge). Ability toreverse engineer Oracle codeand convert to DBT models. Familiarity withhigh-volume data process...

Responsibilities Team Leadership & Delivery: Lead the planning, execution, and delivery of data platform features,taking ownership of your team's sprints and roadmap commitments Hands-On Development: Act as the most senior developer on the team, writing clean, maintainable,and well-tested code for critical components, particularly within the Apache Spark and Kubernetesecosystem Code Quality & Best Practices: Uphold a high standard of engineering excellence by conductingthorough code reviews, establishing best practices for testing and deployment, and championing cleancode principles Mentorship & Coaching: Mentor and develop the engineers on your team, helping them grow theirtechnical skills ...

As the global leader in high-speed connectivity, Ciena is committed to a people-first approach. Our teams enjoy a culture focused on prioritizing a flexible work environment that empowers individual growth, well-being, and belonging. We’re a technology company that leads with our humanity—driving our business priorities alongside meaningful social, community, and societal impact. At Ciena’s Blue Planet division, you will join an agile, innovative team advancing the automation of the world’s most complex networks. You will have the opportunity to work with leading-edge AI technologies, cloud-native architecture, and large-scale automation systems that power global communications. How You Will...

As the global leader in high-speed connectivity, Ciena is committed to a people-first approach. Our teams enjoy a culture focused on prioritizing a flexible work environment that empowers individual growth, well-being, and belonging. We’re a technology company that leads with our humanity—driving our business priorities alongside meaningful social, community, and societal impact. At Ciena’s Blue Planet division, you will join an agile, innovative team advancing the automation of the world’s most complex networks. You will have the opportunity to work with leading-edge AI technologies, cloud-native architecture, and large-scale automation systems that power global communications. How You Will...

Role: Data Engineer Experience: 8+ Years Location: Chennai | Pune | Coimbatore (CBE) | Bangalore Job Summary We are looking for an experienced Data Engineer with strong expertise in Google Cloud Platform (GCP) to design, build, and maintain scalable data pipelines. The ideal candidate should have hands-on experience with BigQuery, Airflow, and strong programming skills in Java or Python. Key Responsibilities · Design and develop scalable data pipelines on GCP · Build and optimize datasets using BigQuery · Implement workflow orchestration using Airflow / Cloud Composer · Write efficient, production-ready code using Java or Python · Optimize BigQuery queries for performance and cost · Work clo...

Lead Data Scientist Our Client: Founded in 2020, our client is an industry-leading, first-of-its-kind in India, digital healthcare data platform and exchange, infused with AI/ML capabilities, delivering solutions to stakeholders in all segments of the healthcare sector. Job Title: Lead Data Scientist Education: Btech (Degree in Data Science Plus) Experience: 8 - 10 Years Location: Bangalore About the Role: We are developing the next-generation automated health insurance claims processing platform, leveraging AI/ML, deep learning, NLP, OCR, and LLM-powered intelligence. As a Lead Data Scientist, you will drive the design, development, deployment, and optimisation of AI models that power large...

Project Role : Custom Software Engineer Project Role Description : Develop and configure software systems either end-to-end or for a specific stage of product lifecycle. Apply knowledge of technologies, applications, methodologies, processes and tools to support a client, project or entity. Must have skills : Machine Learning Good to have skills : NA Minimum 7.5 Year(s) Of Experience Is Required Educational Qualification : 15 years full time education Summary: As a Senior Machine Learning Engineer, you will be responsible for overseeing the engineering team involved in the advanced technical support for production-level AI models, addressing bug fixes, complex issues, feature additions, mode...

Location : tvm, Kochi, Chennai, pune, blr Exp : 2 to 4 years Skill : Java, Spring Boot, Microservices, Angular (v17+), and Google Cloud Platform (GCP)/AWS We are seeking a Junior Cloud Developer with a strong foundation in Java (17+) and hands-on experience with Google Cloud Platform (GCP) . The ideal candidate will design, develop, and maintain data processing and orchestration pipelines leveraging modern cloud technologies such as Apache Beam , Cloud Dataflow , and Airflow/Composer . Key Responsibilities Design, develop, test, and deploy highly scalable and reliable data processing pipelines using Java 17+ and the Apache Beam SDK, executed on GCP Cloud Dataflow. Build and manage data orche...

Reporting to: Director of Data Science About ELSA ELSA is a global leader in AI-powered English communication training, dedicated to transforming how people learn and speak English with confidence. Founded in 2016 and headquartered in San Francisco, we operate across the U.S., Vietnam, Portugal, Indonesia, Brazil and Japan. Powered by proprietary speech-recognition technology and generative AI, ELSA delivers real-time, hyper-personalized feedback to help learners improve pronunciation, fluency, and overall communication effectiveness. With over 50 million learners and 1 billion hours of anonymized speech data, ELSAs depth of language training intelligence is unmatched in the industry. Our B2...

Role Description: As Sr. Associate V&A Transformation Initiatives, you will be at the forefront of solving the US Value & Access teams biggest challenges using cutting edge technology. The AIN Transformation team will be viewed as an innovation engine, constantly testing and refining analytics solutions to address customer needs and opportunities alongside business partners. As an Associate Data Scientist, you will be responsible for developing and deploying advanced machine learning, operational research, semantic analysis, and statistical methods to uncover structure in large data sets. This role involves creating analytics solutions to address customer needs and opportunities. Roles & Res...

Our Client: Founded in 2020, our client is an industry-leading, first-of-its-kind in India, digital healthcare data platform and exchange, infused with AI/ML capabilities, delivering solutions to stakeholders in all segments of the healthcare sector. Job Title: Lead Data Scientist Education: B.Tech (Degree in Data Science Plus) Experience: 8 - 10 Years Location: Bangalore About the Role: We are developing the next-generation automated health insurance claims processing platform, leveraging AI/ML, deep learning, NLP, OCR, and LLM-powered intelligence. As a Lead Data Scientist, you will drive the design, development, deployment, and optimisation of AI models that power large-scale claims decis...

Job Overview As a Data Scientist, you will play a key role in delivering end-to-end data science solutions across pharmaceutical and healthcare engagements. The role demands a blend of technical depth, business acumen, and scientific curiosity. You will translate complex business problems into analytical frameworks, develop scalable machine learning and statistical solutions, and generate actionable insights that drive commercial, clinical, and operational impact for clients and patients worldwide. Beyond technical execution, you are expected to think strategically, framing business challenges, designing analytical approaches, and guiding clients toward the most effective data-driven decisio...

Job Overview As a Data Scientist, you will play a key role in delivering end-to-end data science solutions across pharmaceutical and healthcare engagements. The role demands a blend of technical depth, business acumen, and scientific curiosity. You will translate complex business problems into analytical frameworks, develop scalable machine learning and statistical solutions, and generate actionable insights that drive commercial, clinical, and operational impact for clients and patients worldwide. Beyond technical execution, you are expected to think strategically, framing business challenges, designing analytical approaches, and guiding clients toward the most effective data-driven decisio...

Primary Title: Data Engineer About The Opportunity A specialist talent and HR solutions firm serving enterprise technology, fintech, and retail clients is hiring an on-site Data Engineer in India. This role sits within high-growth data platform programs focused on building scalable, reliable ETL pipelines and analytics-ready data sets for business stakeholders and downstream ML consumers. Role & Responsibilities Design, build and operate robust ETL/ELT data pipelines to ingest, transform and deliver large-scale datasets for analytics and ML. Author PySpark jobs and SQL-based transformations to implement reusable, performant data models and tables. Orchestrate workflows using Apache Airflow; ...

Job Title: Data Analyst Location : Hybrid (Kolkata) Working Hours: Flexible hours (minimum 40 hours per week), as per UK shift timings Experience: 3–5 years Salary: Up to ₹12 LPA (based on experience and skills) Language: Excellent English (written & verbal) Job Overview We are looking for an experienced Data Analyst who can transform raw data into meaningful insights that drive business decisions. In this role, you will work closely with data engineers, analytics engineers, and business stakeholders to build reliable data models, maintain analytics-ready datasets, and deliver insights through dashboards and reports. The ideal candidate has strong SQL skills, hands-on experience with cloud d...

Primary Title: Data Engineer About The Opportunity A specialist talent and HR solutions firm serving enterprise technology, fintech, and retail clients is hiring an on-site Data Engineer in India. This role sits within high-growth data platform programs focused on building scalable, reliable ETL pipelines and analytics-ready data sets for business stakeholders and downstream ML consumers. Role & Responsibilities Design, build and operate robust ETL/ELT data pipelines to ingest, transform and deliver large-scale datasets for analytics and ML. Author PySpark jobs and SQL-based transformations to implement reusable, performant data models and tables. Orchestrate workflows using Apache Airflow; ...

Primary Title: Data Engineer About The Opportunity A specialist talent and HR solutions firm serving enterprise technology, fintech, and retail clients is hiring an on-site Data Engineer in India. This role sits within high-growth data platform programs focused on building scalable, reliable ETL pipelines and analytics-ready data sets for business stakeholders and downstream ML consumers. Role & Responsibilities Design, build and operate robust ETL/ELT data pipelines to ingest, transform and deliver large-scale datasets for analytics and ML. Author PySpark jobs and SQL-based transformations to implement reusable, performant data models and tables. Orchestrate workflows using Apache Airflow; ...

Job Role: Data Engineer / Migration Consultant Experience: 6+ Years Location: Pune, Bangalore, Ahmedabad, Noida Role Proficiency: Proficient in designing, developing, testing, and maintaining data pipelines for ingesting, wrangling, transforming, and joining data from multiple sources. Strong hands-on experience with ETL tools such as Informatica, AWS Glue, Databricks, DataProc, Apache Airflow, Talend, Azure ADF , and coding skills in Python, PySpark, and SQL . Solid understanding of SCD concepts, data warehousing principles, and data schemas . Works independently with strong domain understanding. Key Responsibilities Data Engineering Design, develop, and maintain scalable data pipelines Imp...

Primary Title: Data Engineer About The Opportunity A specialist talent and HR solutions firm serving enterprise technology, fintech, and retail clients is hiring an on-site Data Engineer in India. This role sits within high-growth data platform programs focused on building scalable, reliable ETL pipelines and analytics-ready data sets for business stakeholders and downstream ML consumers. Role & Responsibilities Design, build and operate robust ETL/ELT data pipelines to ingest, transform and deliver large-scale datasets for analytics and ML. Author PySpark jobs and SQL-based transformations to implement reusable, performant data models and tables. Orchestrate workflows using Apache Airflow; ...

AI and Data ETL Architect If you are available for a Face to face interview on 10th Jan Saturday In Pune . Then please share your CV to monica_sharma@hcl-software.com with the below details: Total Experience- Current CTC- Expected CTC- Notice period- If shortlisted you will be invited for a F2F interview Role Context Own ETL architecture patterns, reusable frameworks, and standardization for multi-source data integration. Ensures scalability, maintainability, and governance across ETL delivery, aligning to product roadmap and data model strategy. Key Responsibilities Define reference architecture for ETL/ELT pipelines: ingestion → transform → serving layers. Establish standards for metadata/...

Primary Title: Data Engineer About The Opportunity A specialist talent and HR solutions firm serving enterprise technology, fintech, and retail clients is hiring an on-site Data Engineer in India. This role sits within high-growth data platform programs focused on building scalable, reliable ETL pipelines and analytics-ready data sets for business stakeholders and downstream ML consumers. Role & Responsibilities Design, build and operate robust ETL/ELT data pipelines to ingest, transform and deliver large-scale datasets for analytics and ML. Author PySpark jobs and SQL-based transformations to implement reusable, performant data models and tables. Orchestrate workflows using Apache Airflow; ...

Primary Title: Data Engineer About The Opportunity A specialist talent and HR solutions firm serving enterprise technology, fintech, and retail clients is hiring an on-site Data Engineer in India. This role sits within high-growth data platform programs focused on building scalable, reliable ETL pipelines and analytics-ready data sets for business stakeholders and downstream ML consumers. Role & Responsibilities Design, build and operate robust ETL/ELT data pipelines to ingest, transform and deliver large-scale datasets for analytics and ML. Author PySpark jobs and SQL-based transformations to implement reusable, performant data models and tables. Orchestrate workflows using Apache Airflow; ...

Opkey | Series B Funded | Noida, India (In-Office) | Full-Time The Opportunity Opkey, a Series B funded enterprise application lifecycle management platform, is looking for a Senior Data Engineer to join our team in Noida. We need someone who can build and scale the data infrastructure—pipelines, storage systems, and processing engines—that powers our platform. We're not pitching a vision—we're scaling a reality. Our systems already process hundreds of gigabytes of enterprise data. Now we need an engineer who can make that infrastructure handle 10x more, 10x faster, with bulletproof reliability. This is your chance to be part of building something that will define a category. About Us Opkey ...

Primary Title: Data Engineer About The Opportunity A specialist talent and HR solutions firm serving enterprise technology, fintech, and retail clients is hiring an on-site Data Engineer in India. This role sits within high-growth data platform programs focused on building scalable, reliable ETL pipelines and analytics-ready data sets for business stakeholders and downstream ML consumers. Role & Responsibilities Design, build and operate robust ETL/ELT data pipelines to ingest, transform and deliver large-scale datasets for analytics and ML. Author PySpark jobs and SQL-based transformations to implement reusable, performant data models and tables. Orchestrate workflows using Apache Airflow; ...

About the job Job Description Hiring: Data Engineer | Remote | Full-Time | Immediate Joiner Company: Natlov Technologies Pvt. Ltd Experience: 1–2 years CTC: ₹3.6 LPA– ₹4.8 LPA Natlov Technologies Pvt. Ltd is looking for a Data Engineer with strong AWS expertise and working experience in Azure. In this role, you will design, build, and optimize scalable data pipelines across multi-cloud environments using tools like Airflow, AWS Glue, Azure Data Factory, Databricks, BigQuery, and Redshift. If you enjoy architecting reliable data systems and solving complex cloud data challenges, this opportunity is for you. Key Skills Cloud Platforms: AWS, Azure Programming & Data Processing: Python (Strong) ...