15348 Airflow Jobs - Page 41

About the Role: We’re seeking an AI/ML Engineer to build, train, and deploy machine learning and generative AI models. You’ll work across data, engineering, and product teams to create scalable AI solutions using the latest tools and frameworks. Responsibilities: Develop and deploy ML, DL, and GenAI models (LLMs, NLP, Computer Vision). Build end-to-end ML pipelines — data prep, training, testing, and deployment. Integrate models with APIs and cloud platforms . Implement MLOps for automation, CI/CD, and monitoring. Optimize models for accuracy, scalability, and performance . Stay current with AI/ML and LLM advancements . Skills & Tools: Languages: Python, SQL, R, Java/Scala Frameworks: Tensor...

What you will do In this vital role we seek a skilled Data Engineer to build and optimize our data infrastructure. As a key contributor, you will collaborate closely with cross-functional teams to design and implement robust data pipelines that efficiently extract, transform, and load data into our AWS-based data lake and data warehouse. Your expertise will be instrumental in empowering data-driven decision making through advanced analytics and predictive modeling. Roles & Responsibilities: Building and optimizing data pipelines, data warehouses, and data lakes on the AWS and Databricks platforms. Managing and maintaining the AWS and Databricks environments. Ensuring data integrity, accuracy...

What you will do In this vital role you will be responsible for development and maintenance of software in support of target/biomarker discovery at Amgen. This role requires proficiency in cloud computing technologies (AWS, Azure etc.), knowledge of CI/CD processes, docker containers, IAM, DevOps, and deploying automated pipelines. Additionally, the ability to work with cross functional teams and experience in agile practices is desired. Roles & Responsibilities: Develop data processing pipelines for large datasets in the cloud (e.g. Nextflow); integrate with other data sources where applicable Collaborate with the other engineering team members to ensure all infrastructure, applications, an...

Overview We are seeking a highly skilled DevOps Engineer with strong MLOps expertise to join our team. The ideal candidate will have a solid foundation in DevOps practices—infrastructure automation, CI/CD, container orchestration, networking, monitoring, Linux system administration, and security compliance—and extend this expertise into operationalizing ML/AI workloads. You will collaborate with data scientists, ML engineers, and software teams to ensure reliable, secure, and scalable deployments of applications and ML models. Website: https://coreops.ai Key Responsibilities DevOps Design, build, and maintain CI/CD pipelines for applications and AI/ML workloads. Implement Infrastructure as C...

SentientGeeks is Looking for an AI/ML Backend Engineer (2–3 Years Experience) Location: Onsite Experience: 2-3 years Employment Type: Full-time About the Role SentientGeeks is seeking a passionate and skilled AI/ML Backend Engineer to join our growing Artificial Intelligence team. The ideal candidate should have a strong foundation in Deep Learning, NLP, Python, Machine Learning, and database management, with hands-on experience in building and integrating backend systems for AI-driven applications. Must-Have (Mandatory Skills) Deep Learning & NLP: Practical experience in building, fine-tuning, and deploying deep learning models for NLP tasks such as embeddings, classification, and retrieval...

Qualification: 10 or 12th Pass ITI (Fitter or related trade) Experience: Minimum 2 years of experience in HVAC / AHU operation and maintenance Job Responsibilities: Operation & Maintenance: Operate, inspect, and maintain Air Handling Units (AHUs), FCUs, and associated HVAC equipment. Perform routine checks on filters, coils, motors, and belts. Ensure proper airflow, temperature, and humidity control. Preventive Maintenance: Conduct scheduled preventive maintenance as per company procedures. Replace air filters, lubricate moving parts, and clean cooling/heating coils. Record maintenance activities in log sheets. Troubleshooting: Identify and repair mechanical faults in fans, motors, bearings,...

We’re hiring a Senior QA Engineer who can own test automation across data/ETL pipelines, APIs, and web frontends. You’ll design robust QA strategies, build CI/CD-native test suites, drive performance/load testing, and turn system requirements into executable, measurable test plans. What will you do: ETL/Data Quality Automation Design and automate tests for ingestion, transformation, and loading (schema checks, constraints, null/dup checks, reconciliation, row/column-level validation, business rule assertions). Implement data contract and data lineage test coverage; ensure CDC/merge logic and dedup rules are verified. Add data checks to orchestration (e.g., Airflow/Prefect/Cloud Composer) and...

Job Title: Senior Data Engineer Experience: 6 - 8 years Location: Hybrid Employment Type: Full-time Mandatory skills: AWS, Python, SQL, Databricks About The Role We are looking for a highly skilled Senior Data Engineer who is passionate about building robust, scalable, and high-performance data systems. The ideal candidate will have deep expertise in SQL, Python, AWS, and Databricks , with a proven track record of designing and implementing modern data pipelines and analytical frameworks. Key Responsibilities Design, develop, and maintain scalable data pipelines and ETL processes for data ingestion, transformation, and storage. Work with cross-functional teams to define and deliver data solu...

Job Title: Senior Data Engineer Experience: 5 - 8 Years Work Location: Hybrid Employment Type: Full-Time About The Role We are seeking a highly skilled Senior Data Engineer to design, develop, and optimize our data systems and pipelines. The ideal candidate will have strong expertise in SQL, Python, AWS, and Tableau , and a passion for transforming raw data into actionable insights that drive business decisions. Key Responsibilities Design, build, and maintain scalable ETL / ELT data pipelines for ingestion, transformation, and storage. Work with business stakeholders to identify data requirements and translate them into effective data solutions. Develop and optimize SQL queries, stored proc...

Job Summary: We are seeking a motivated and enthusiastic Junior AI Developer to join our technology team in Kochi. In this role, you will work on developing Medium-scale AI-powered applications, automation agents, and intelligent workflows using modern AI frameworks and tools. Key Responsibilities: Design, develop, and deploy medium-scale AI and ML-based applications. Build and maintain automation agents using modern AI and scripting tools. Collaborate with cross-functional teams to integrate AI components into products or internal workflows. Work with datasets to train, fine-tune, and evaluate machine learning models. Apply prompt engineering and LLM-based tools (e.g., OpenAI, LangChain) to...

Greetings, We have immediate opportunity for Data Engineer – 3-7 Years Synechron– Mumbai Job Role: Data Engineer Job Location: Mumbai About Synechron We began life in 2001 as a small, self-funded team of technology specialists. Since then, we’ve grown our organization to 14,500+ people, across 58 offices, in 21 countries, in key global markets. Innovative tech solutions for business We're now a leading global digital consulting firm, providing innovative technology solutions for business. As a trusted partner, we're always at the forefront of change as we lead digital optimization and modernization journeys for our clients. Customized end-to-end solutions Our expertise in AI, Consulting, Dat...

Work Location: Chennai (Work From Office) Department Overview The Decision Support Systems (DSS) function enables data-driven decision-making across Matrimony.com by delivering high-quality data pipelines, analytical platforms, and intelligent planning tools. The team partners with business leaders, product teams, and product engineering teams to convert raw data into actionable insights that power strategic, operational, and commercial decisions across the organization. Role Overview: We are seeking a Data Engineering Lead to drive the development and optimization of our enterprise data pipelines, analytical data models, and decision-support infrastructure at Matrimony.com. In this role, yo...

Hungry, Humble, Honest, with Heart. The Opportunity Nutanix is a global leader in cloud software and Hyper converged infrastructure solutions, making infrastructure invisible so that IT can focus on the applications and services that power their business. Companies around the world use Nutanix Enterprise Cloud OS software to bring one-click application management and mobility across public, private and distributed edge clouds so they can run any application at any scale with a dramatically lower total cost of ownership. The result is organizations that can rapidly deliver a high-performance IT environment on demand, giving application owners a true cloud-like experience. About The Team Do yo...

Job Summary: We are seeking an experienced Data Engineer with strong expertise in AWS cloud services and Databricks to design and implement scalable, high-performance data pipelines. Key Responsibilities: Design, develop, and maintain data pipelines and workflows using AWS (S3, Redshift, Glue, EMR, Lambda, Kinesis, Athena) and Databricks . Leverage Databricks for data engineering, advanced analytics, and machine learning workloads. Collaborate with data scientists, analysts, and stakeholders to deliver reliable and scalable data solutions. Implement data governance, quality checks, and monitoring frameworks . Ensure high availability, scalability, and cost-effectiveness of data solutions. Re...

Experience : 4-7 Years Key Responsibilities: ● Design, develop, and maintain data pipelines and ETL tool ( Informatica ) workflows using GCP-native tools and services. ● Build and optimize data warehouses using BigQuery or other DWHs (e.g., Snowflake on GCP, Redshift on GCP). ● Write complex and efficient SQL queries for data transformation, analysis, and reporting. ● Collaborate with analysts, data scientists, and business stakeholders to understand data needs and deliver reliable solutions. ● Implement data governance, security, and monitoring best practices across GCP projects. ● Tune queries and optimize performance of large-scale datasets. ● Automate workflows using Cloud Composer (Airf...

About Position: We’re looking for an AWS Data Platform Engineer to help automate and scale our cloud-based analytics environment. You’ll work with our BI and Data Engineering teams to build secure, automated, and reusable AWS infrastructure that supports data pipelines, Redshift environments, and business intelligence integrations. Role: AWS Data Platform Engineer Location: All Persistent Location Experience: 9+years Job Type: Full Time Employment What You'll Do: Design and maintain CI/CD pipelines for data platform and analytics workloads. Build and manage containerized applications using Docker, ECS, and ECR. Develop Infrastructure as Code (Terraform or AWS CDK) for Redshift, Lambda, and o...

About The Role We’re looking for a highly skilled Data Engineer with deep expertise in Azure , Databricks , and relational database systems . The ideal candidate is passionate about designing, building, and optimizing large-scale data pipelines, and thrives in an environment that values problem-solving, collaboration, and continuous improvement. Key Responsibilities Design, develop, and optimize scalable data pipelines and ETL workflows using Databricks (PySpark/Python/SQL). Build and orchestrate complex data workflows using Azure Data Factory (ADF) to integrate data from diverse sources. Perform data transformations and data integrations using REST APIs, Kafka, and other streaming or batch ...

Project Role : Application Developer Project Role Description : Design, build and configure applications to meet business process and application requirements. Must have skills : Databricks Unified Data Analytics Platform Good to have skills : Python (Programming Language), Apache Airflow Minimum 5 Year(s) Of Experience Is Required Educational Qualification : 15 years full time education Summary: As an Application Developer, you will engage in the design, construction, and configuration of applications tailored to fulfill specific business processes and application requirements. Your typical day will involve collaborating with various stakeholders to gather requirements, developing applicati...

Modern Data Engineer is responsible for designing, implementing, and maintaining scalable data architectures using cloud technologies, primarily on AWS, to support our next evolutionary stage of the Investment Process. They build robust data pipelines, optimize data storage, and access patterns, and ensure data quality while collaborating across engineering teams to deliver high-value data products Key Responsibilities • Implement and maintain data pipelines for ingestion, transformation, and delivery • Ensure data quality through validation and monitoring processes • Collaborate with senior engineers to design scalable data solutions • Work with business analysts to understand and implement...

Job Summary We are seeking an experienced GCP Data Engineer with strong expertise in designing, building, and managing scalable data pipelines and analytical solutions on Google Cloud Platform (GCP). The ideal candidate will have a solid background in big data technologies, data warehousing, and cloud-based data architecture, with hands-on experience using GCP-native tools. Key Responsibilities Design, develop, and maintain data pipelines and ETL processes on GCP using services like Dataflow, Dataproc, Pub/Sub, Cloud Functions, and Composer (Airflow). Build and optimize data warehouses and data lakes using BigQuery, Cloud Storage, and Cloud SQL. Collaborate with data analysts, data scientist...

Employment Type: Contract Shift: UK Shift (if applicable) Job Summary We are looking for a highly skilled Python Lead Developer with strong expertise in Python, SQL, AWS, and Apache Airflow. The ideal candidate will lead a team of developers to build scalable data pipelines, backend systems, and cloud-based solutions, ensuring high performance, maintainability, and adherence to best practices. Key Responsibilities Lead and mentor a team of Python developers, ensuring delivery of high-quality software solutions. Design, develop, and optimize data pipelines and backend systems using Python and Airflow. Work with AWS services (S3, Lambda, EC2, Glue, Redshift, RDS, etc.) for deployment, data sto...

Who We Are Escalent is an award-winning data analytics and advisory firm that helps clients understand human and market behaviors to navigate disruption. As catalysts of progress for more than 40 years, our strategies guide the world’s leading brands. We accelerate growth by creating a seamless flow between primary, secondary, syndicated, and internal business data, providing consulting and advisory services from insights through implementation. Based on a profound understanding of what drives human beings and markets, we identify actions that build brands, enhance customer experiences, inspire product innovation and boost business productivity. We listen, learn, question, discover, innovate...

Overview We are seeking a highly skilled DevOps Engineer with strong MLOps expertise to join our team. The ideal candidate will have a solid foundation in DevOps practices—infrastructure automation, CI/CD, container orchestration, networking, monitoring, Linux system administration, and security compliance—and extend this expertise into operationalizing ML/AI workloads. You will collaborate with data scientists, ML engineers, and software teams to ensure reliable, secure, and scalable deployments of applications and ML models. Website: https://coreops.ai Key Responsibilities DevOps Design, build, and maintain CI/CD pipelines for applications and AI/ML workloads. Implement Infrastructure as C...

About BeGig BeGig is the leading tech freelancing marketplace. We empower innovative, early-stage, non-tech founders to bring their visions to life by connecting them with top-tier freelance talent. By joining BeGig, you’re not just taking on one role—you’re signing up for a platform that will continuously match you with high-impact opportunities tailored to your expertise. Your Opportunity Join BeGig as a DataOps Engineer and help businesses automate and streamline their data pipelines. You’ll ensure that data flows seamlessly across systems, from data ingestion to analytics, enabling data-driven decision-making at scale. Role Overview As a DataOps Engineer, you will: Design, implement, and...

Data Scientist (4–5 Years Experience) 📍 Location: Pune / Hyderabad / Bangalore 🏢 Type: Full-time | Work From Office (WFO) 💰 Compensation: ₹1.7 LPA – ₹2 LPA 🎓 Qualification: Bachelor’s or Master’s in Data Science, Computer Science, Statistics, Mathematics, or related field About the Role We are seeking a highly skilled Data Scientist with 4–5 years of relevant industry experience to join our growing analytics team. The ideal candidate will have a strong foundation in statistical modeling, machine learning, and data engineering, with the ability to turn data into actionable insights that drive business impact. Key Responsibilities Analyze large, complex datasets to uncover insights and trends ...