19533 Airflow Jobs - Page 9

About MBRDI: Mercedes-Benz Research and Development India (MBRDI), headquartered in Bengaluru with a satellite office in Pune, is the largest R&D center for Mercedes-Benz Group AG outside of Germany. Our mission is to drive innovation and excellence in automotive engineering, digitalization, and sustainable mobility solutions, shaping the future of mobility. About the Role We are looking for a Data Scientist who is highly skilled in Python, Large Language Models (LLMs), Orchestrator Frameworks, and Multi-Agent Systems to build scalable, enterprise-grade AI solutions. The ideal candidate is hands-on, can convert real-world business problems into AI-driven workflows, and is comfortable working...

Locations - Indore / Noida / Bengaluru / Pune /Gurgaon Job Description 2–5 years of hands-on experience as a Data Engineer Strong experience with Databricks and Apache Spark Proficiency in Python for data engineering and ETL development Experience building and managing ETL pipelines Experience with cloud platforms ( AWS / Azure / GCP ) – at least one Familiarity with Delta Lake and optimized data storage formats Understanding of Generative AI fundamentals (LLMs, embeddings, RAG concepts) Good to Have Hands-on experience with GenAI frameworks (Lang Chain, Lang graph, etc.) Experience working with vector databases (PGVector, Pinecone, Chroma, etc.) Knowledge of data orchestration tools (Airflo...

Work Location: Hyderabad Experience: 15+ Years Notice: Immedaite- 15 Days About SIDGS: SIDGS is a premium global systems integrator and global implementation partner of Google corporation, providing Digital Solutions & Services to Fortune 500 companies. Our Digital solutions go across following domains: User Experience, CMS, API Management, Microservices, DevOps, Cloud, Service Mesh, Artificial Intelligence, RPA domains. We create innovative solutions in Digital, API Management, Cloud and DevOps space in partnership with Google. We understand that every business has a unique set of challenges and opportunities, and we leverage our unique industry insights, honed through decades of combined e...

Optum is a global organization that delivers care, aided by technology to help millions of people live healthier lives. The work you do with our team will directly improve health outcomes by connecting people with the care, pharmacy benefits, data and resources they need to feel their best. Here, you will find a culture guided by inclusion, talented peers, comprehensive benefits and career development opportunities. Come make an impact on the communities we serve as you help us advance health optimization on a global scale. Join us to start Caring. Connecting. Growing together. Primary Responsibilities Develop high-quality software design and architecture Prioritize and execute tasks in the ...

Skills and Experience Required: 5+ years of Python experience. Core Python expertise along with a strong understanding of design patterns. Familiarity with data analysis tools such as Numpy, Pandas, Polars, and Dask. Experience with Rest API frameworks like FastAPI, Flask, and Pydantic. Data pipeline frameworks knowledge (e.g., Airflow, Beam, Luigi) is a plus. SQL knowledge for advanced queries and understanding of RDBMS concepts is beneficial. Professionalism, a focus on client needs, and an eagerness to learn new skills. A solid understanding of Agile development practices.

Note: Please apply directly through LinkedIn for this position. We kindly request that candidates refrain from contacting company officials via email or messages regarding this role. About the Company We are an AI and Data Consulting Startup transforming how businesses leverage technology through four core service lines: Consulting Services: AI Strategy, Automation, and Digital Transformation for enterprises. SaaS Platform Development: Building a business application suite similar to Odoo and Zoho that is AI-native and user friendly. Data Lakehouse Solutions: Unified data pipelines for aggregation, cleaning, governance, and advanced analytics. Government Contracting: Developing secure, compl...

We are seeking a highly skilled and experienced Intermediate Level Automation Engineer to join our team. The ideal candidate will specialize in designing, developing, and maintaining robust automation solutions, with a strong emphasis on cloud-native orchestration tools like Cloud Composer/Airflow. This role requires deep proficiency in Python for complex scripting, solid expertise in SQL for data integration, and a comprehensive understanding of cloud automation techniques to streamline our data pipelines and infrastructure management across cloud environments. Qualified individuals must be able to embrace, learn and use home grown tools and open source software to support daily development...

Role: Data Engineer Location: Hyderabad ( Hybrid) Job Description: Hands-on experience with Databricks (Spark), the GCP ecosystem including (BigQuery, DataProc, Dataflow, Pub/Sub, Cloud Storage), ETL/ELT pipeline development, data modeling, data warehousing, plus understanding of AI/ML integration and DevOps practices for building scalable, secure, and efficient data solutions on Google Cloud. Proficient in Python, SQL, and Shell scripting, with knowledge of Docker containerization and Cloud data processing technologies Understanding cloud architecture, security, and best practices Using a variety of open-source technologies (Python, Spark, Airflow), build data pipelines to extract, cleanse,...

Important Note (Please Read Before Applying) 🚫 Do NOT apply if: You have less than 10 years or more than 12 years of total IT experience You do not have hands-on experience with Python and GCP Data Engineering projects You lack real-world experience in building and deploying ETL/ELT pipelines using GCP services (Dataflow, BigQuery, Composer, etc.) You have no exposure to Apache Spark, Kafka, or Airflow You are on a notice period longer than 30 days You are looking for a purely remote role (onsite/client engagement required) You come from a non-data background (e.g., testing, support, or non-engineering roles) ✅ Apply ONLY if you meet ALL mandatory skills and criteria above. Job Title: Lead D...

DE COE: DE COE Designation Senior Analyst Experience: 2 to 5 years Location: Chennai, Tamil Nadu, India (CHN) Job Description: We are seeking a highly motivated Senior Analyst – Data Engineer with strong expertise in Snowflake to design, build, and optimize modern data solutions. The candidate will play a key role in data modelling, performance optimization, and implementation of scalable pipelines, while also supporting solution design and mentoring junior team members. This role offers the opportunity to work in a collaborative, cloud-native data environment and grow into advanced architectural and leadership responsibilities Responsibilities: 1. Solution Architecture & Design Assist in th...

Job Title: Design Head – Cleanroom Industry: Cleanroom (Pharma / Healthcare / Electronics / Semiconductor) Department: Design & Engineering Experience: 8–15 Years Location: Vadodara Reporting To: Director / Management Job Overview The Design Head – Cleanroom will be responsible for leading and managing the complete design activities of cleanroom projects, ensuring compliance with international cleanroom standards, client specifications, and project timelines. The role requires strong technical expertise in cleanroom HVAC, layouts, and regulatory compliance. Key ResponsibilitiesCleanroom Design & Engineering Lead design of cleanroom systems , including: Cleanroom layouts & zoning HVAC system ...

About the Role We are looking for a highly skilled Data Engineer to design, build, and maintain robust data pipelines and scalable data infrastructure. You will work closely with analytics, product, and engineering teams to enable high-quality data availability for business insights, machine learning, and operational processes. This role is ideal for an engineer who enjoys solving complex data problems, optimizing systems, and ensuring clean, reliable data flows. Key Responsibilities Design, develop, and maintain scalable ETL/ELT pipelines using modern data engineering tools. Build and optimize data lakes, data warehouses, and streaming architectures . Work with large and complex datasets to...

As a SQL and PL/SQL Expert, your role will involve the following key responsibilities: - Hands-on experience with DBT, ensuring practical application rather than just theoretical knowledge. - Ability to reverse engineer Oracle code and convert it into DBT models. - Familiarity with high-volume data processing to handle large datasets efficiently. - Optional experience with Java (preferred but not mandatory) and knowledge of Airflow (preferred but not mandatory). - Suggesting performance improvements such as clustering and merge optimization. - Working independently with minimal supervision. - Collaborating with existing frameworks and standards to ensure seamless integration. No additional d...

As an experienced AI/ML Architect, you will be responsible for architecting and deploying enterprise-scale AI/ML platforms. Your role will involve working in agile, cross-functional teams to deliver measurable impact. With a Masters or PhD in Computer Science, Artificial Intelligence, Machine Learning, or a related quantitative field, you should have 8+ years of experience in this domain. Your key responsibilities will include: - Designing, implementing, and scaling AI infrastructure using technologies such as Databricks, Azure AI, Snowflake, Spark, and Airflow. - Hands-on experience with model selection, fine-tuning, evaluation, and responsible AI governance. - Strong programming skills in ...

You will be responsible for transforming Data Science prototypes into production-ready applications, building scalable MLOps pipelines, and maintaining deployed models. This role requires a strong background in software engineering, cloud infrastructure, and practical experience with the full ML lifecycle. - Refactor and optimise Data Science prototypes for performance and efficiency. - Containerise models using Docker and deploy them onto a scalable infrastructure, such as Kubernetes. - Design and build low-latency APIs to serve model predictions in real-time. - Implement CI/CD/CT pipelines to automate model training, testing, and deployment processes. - Utilise orchestration tools like Air...

Role Overview: As a Lead Programmer Analyst specializing in GCP Data Engineering, you will be responsible for utilizing your extensive experience and skills in data engineering to lead and drive projects related to Google Cloud Platform (GCP). Your primary focus will be on developing solutions using GCP services such as BigQuery, DataProc, Dataflow, and Dataform. Additionally, you will be required to have a strong command over SQL, Python, and Pyspark to effectively fulfill your responsibilities. Key Responsibilities: - Utilize your 5 to 7 years of data engineering experience to design and implement solutions using GCP services. - Develop and maintain data pipelines using tools like BigQuery...

As a Data / AI / ML Engineer at our company, you will play a crucial role in designing, developing, and deploying data-driven solutions that power intelligent systems across various business domains. You will collaborate closely with data scientists, software engineers, and product managers to build robust data pipelines, optimize machine learning models, and ensure scalable, efficient, and reliable AI/ML solutions in production environments. Key Responsibilities: - Design, build, and maintain scalable data pipelines and ETL processes. - Support the development and deployment of machine learning models into production. - Collaborate with cross-functional teams to understand data requirements...

As a Data Services ETL Developer at Zeta, you will specialize in data transformations and integration projects using proprietary tools, 3rd Party software, and coding. Your role will involve implementing data processing across multiple technologies to ensure accurate and on-time delivery for marketing operations. Responsibilities: - Manipulate client and internal marketing data across various platforms. - Automate scripts for data transfer and manipulation. - Build, deploy, and manage cloud-based data pipelines using AWS services. - Manage multiple tasks with competing priorities for timely client deliverability. - Collaborate with technical staff to maintain and support a proprietary ETL en...

Looking for a Data Engineer (Python+ Linux Developer) with a strong background in Python, data engineering, data modeling, SQL Server, and SDLC *Must have : Hands-on experience on Linux with Python, PySpark, Airflow, MySql, Linux* Hybrid work

Company: HyrEzy Website: Visit Website Business Type: Consulting Firm Company Type: Product Business Model: B2B Funding Stage: Series A Industry: IT Services Salary Range: ₹ 12-15 Lacs PA Job Description 🚀 The Mission Join a premier Data & Analytics consulting organization dedicated to helping forward-thinking brands translate data into actionable insights. As a Data Engineer , you will not just move data; you will architect the Medallion Framework (Staging → Intermediate → Marts) to power high-stakes descriptive and predictive analytics. 🛠️ Technical Command Center We are looking for a specialist proficient in the Modern Data Stack : Core Platform: Snowflake (Warehouse Sizing, Query Profili...

This role is for one of Zepcruit's clients. Role & Responsibilities: We are seeking a highly skilled Senior DevOps Engineer with 8+ years of hands-on experience in designing, automating, and optimizing cloud-native solutions on AWS. AWS and Linux expertise are mandatory. The ideal candidate will have strong experience across databases, automation, CI/CD, containers, and observability, with the ability to build and scale secure, reliable cloud environments. Key Responsibilities: Cloud & Infrastructure as Code (Isac)- Architect and manage AWS environments ensuring scalability, security, and high availability. Implement infrastructure automation using Terraform, CloudFormation, and Ansible. Con...

Description We are looking for an experienced and results-driven Data Engineer to join our growing Data Engineering team. The ideal candidate will be proficient in building scalable, high-performance data transformation pipelines using Snowflake and dbt or Matillion and be able to effectively work in a consulting setup. In this role, you will be instrumental in ingesting, transforming, and delivering high-quality data to enable data-driven decision-making across the clients organization. Key Responsibilities Design and implement scalable ELT pipelines using dbt on Snowflake, following industry accepted best practices. Build ingestion pipelines from various sources including relational databa...

Growexx is looking for a smart and passionate Senior Data Scientist , who will empower Marketing, Product, and Sales teams to make strategic, data-driven decisions. Key Responsibilities Mine, process, and analyse hit/event level web, product, sales, and digital marketing data. Leverage LLMs (Large Language Models) and traditional machine learning to mine, process, and analyze web, product, sales, and digital marketing event-level data. Develop and fine-tune LLM-driven solutions for tasks such as text summarization, customer support automation, personalization, and user journey understanding. Build and deploy predictive models and ML algorithms across structured and unstructured customer prof...

Qualifications B.Tech./M.Tech/M.S./PhD in Computer Science, Statistics, Mathematics, Economics, or related quantitative field (advanced degree preferred). Minimum 8+ years of experience in data analytics, business intelligence, or quantitative research, including at least 3 years leading analytics initiatives. Key Responsibilities Oversee the design and implementation of analytics frameworks for platform performance monitoring and user behaviour analysis, aligning with SIDH's objectives as a Digital Public Infrastructure. Oversee development of real-time dashboards for tracking skill acquisition, certification rates, employment outcomes, and scheme effectiveness across government programs. E...

Job Overview As a Data Scientist, you will play a key role in delivering end-to-end data science solutions across pharmaceutical and healthcare engagements. The role demands a blend of technical depth, business acumen, and scientific curiosity. You will translate complex business problems into analytical frameworks, develop scalable machine learning and statistical solutions, and generate actionable insights that drive commercial, clinical, and operational impact for clients and patients worldwide. Beyond technical execution, you are expected to think strategically, framing business challenges, designing analytical approaches, and guiding clients toward the most effective data-driven decisio...