15348 Airflow Jobs - Page 20

what is CRED CRED is an exclusive community for India's most trustworthy and creditworthy individuals, where the members are rewarded for good financial behavior. CRED was born out of a need to bring back the focus on a long lost virtue, one of trust, the idea being to create a community centered around this virtue. a community that constantly strives to become more virtuous in this regard till they finally scale their behavior to create a utopia where being trustworthy is the norm and not the exception. to build a community like this requires a community of its own a community special in its own way, working towards making this vision come true. here's a thought experiment: what do you get ...

The Senior Data Engineer will be responsible for the architecture, design, development, and maintenance of our data platforms, with a strong focus on leveraging Python and PySpark for data processing and transformation. This role requires a strong technical leader who can work independently and as part of a team, contributing to the overall data strategy and helping to drive data-driven decision-making across the organization. Key Responsibilities Data Architecture & Design: Design, develop, and optimize data architectures, pipelines, and data models to support various business needs, including analytics, reporting, and machine learning. ETL/ELT Development (Python/PySpark Focus): Build, tes...

Job Description We are seeking an experienced Data Architect specializing in Databricks to lead the architecture, design, and migration of enterprise data workloads from on-premises systems (e.g., Oracle, Exadata, Hadoop) to Databricks on Azure or AWS . The role involves designing scalable, secure, and high-performing data platforms based on the medallion architecture (bronze, silver, gold layers), supporting large-scale ingestion, transformation, and publishing of data. Responsibilities Key Responsibilities Define and design cloud-native data architectures on Databricks using Delta Lake, Unity Catalog, and related components. Develop and execute migration strategies for moving on-premises d...

Job Description We are seeking an experienced Data Architect specializing in Databricks to lead the architecture, design, and migration of enterprise data workloads from on-premises systems (e.g., Oracle, Exadata, Hadoop) to Databricks on Azure or AWS . The role involves designing scalable, secure, and high-performing data platforms based on the medallion architecture (bronze, silver, gold layers), supporting large-scale ingestion, transformation, and publishing of data. Responsibilities Key Responsibilities Define and design cloud-native data architectures on Databricks using Delta Lake, Unity Catalog, and related components. Develop and execute migration strategies for moving on-premises d...

VP – Data Architect || 10–15 YOE || Delhi || 5 Days || Max NP 90 Days || Mandatory: 10+ YOE Data Engg + Large-Scale Data + Java/Python + Leadership Hiring for a B2B SaaS Product Company Delhi (Onsite, 5 Days) Role: VP – Data Architect We are looking for a super-strong Data Architect who has scaled high-load, data-heavy systems and led Data Engineering teams in modern product environments. Mandatory Criteria 10+ YOE with 6+ YOE in Data Engineering + 2+ years in leadership 7+ YOE hands-on coding (Java highly preferred / Python / Node.js / Go) Strong experience in HDFS, YARN, MapReduce, Hive, Kafka, Spark, Airflow, Presto Expertise in HLD & LLD , scalable architectures Must have led 5+ Data Eng...

NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Snowflake, Python, Airflow Engineer to join our team in Bangalore, Karntaka (IN-KA), India (IN). Job Duties: Team Overview The Controls Engineering, Measurement and Analytics (CEMA) department is responsible for Cyber Risk and Control assessment, management, monitoring, and reporting capabilities across Technology, resulting in risk reduction and better oversight of the technology risk landscape of the firm. Our work is always client focused, our engineers are problem-s...

Key Responsibilities Design, develop, and maintain scalable ETL/ELT pipelines in Snowflake to support data migration from legacy systems. Leverage Python for data transformation, automation, and orchestration of migration workflows. Optimize and refactor complex SQL queries to ensure efficient data processing and reporting in Snowflake. Collaborate on data modeling and schema design to align with Snowflake architecture and performance best practices. Monitor and troubleshoot data pipeline performance during and after migration phases. Work closely with data analysts, scientists, and business stakeholders to ensure accurate and timely data delivery. Implement and enforce data governance, secu...

Opening for Data Engineer Exp:6-12 Yrs Location: Bangalore kindly share your details, if you are available for F2F Interview on Coming Weekends. Job Description, BigQuery Cloud Composer or Airflow (any one is required Dataflow or Dataproc or Datafusion (any one is required) Python or Pyspark (any one is required) DBT SQL GKE Looker

Software, the fuel for mobility We bring bold digital visions to life. So we’re on the lookout for more curious and creative engineers who want to create change – one line of high-quality code at a time. Our transformation isn't for everyone, but if you're excited about solving the leading-edge technological challenges facing the auto industry, then let’s talk about your next move. Let's introduce ourselves At Volvo Cars, we are making bold digital visions come true. We aim to be the leader in the automotive world by creating a digital ecosystem built around making our customers' lives less complicated. What we all have in common at Volvo Cars is our passion for protecting lives, our endless...

We are Hiring: Data Engineering Professionals! (Drive in Bangalore, Chennai & Gurgaon - Final Job Location: Bangalore) Are you ready to elevate your career with a fast-growing, innovation-driven team? Were on the lookout for passionate Data Engineers who love solving complex problems and turning data into powerful insights. If this sounds like you, we want to meet you! Who Were Looking For: Experience: Minimum 2+ years Skills Required: Python SQL PySpark AWS Availability: Immediate Joiners Preferred! Drive Locations: Bangalore Chennai Gurgaon (Final work location will be Bangalore after selection.) Interested? Please fill out the form below: https://forms.gle/bnR5mGwVLZWjyKGS7 Lets build the...

Role & responsibilities Python Stack Integration Airflow & ETL Tools Migration, Dataiku to Jupyter Notebooks, Code Conversion, Automation / Accelerators, BI Tools(Tableau MSTR) MANDATORY Python Developer ; airflow and any ETL tool migration Jupyter Notebooks (knowledge on Dataiku) Experience with Big Data Environment . Hands on coding in Python, Spark, Hive.

Who We Are VOIS (Vodafone Intelligent Solutions) is a strategic arm of Vodafone Group Plc, creating value for customers by delivering intelligent solutions through Talent, Technology & Transformation. As the largest shared services organisation in the global telco industry with 30,000 FTE, our portfolio of next-generation solutions and services are designed in partnership with customers across Vodafone Group, local markets, and partner markets to simplify and drive growth. With our strategic partner Accenture, we work alongside our Vodafone customers, other Telco and tech companies to drive transformation, meet the challenges of our industry and ensure we stay relevant and resilient. This pa...

Job Description 6+yrs of experience in Software development with end to end understanding of the development process Must Have: Snowflake, DBT, Airflow and Data Modeling Nice to Have: Power BI, Java, Angular, Laons Domain knowledge Design and develop scalable and resilient systems using Java or Python to contribute to continual, iterative improvements for product teams Executes software solutions, design, development, and technical troubleshooting Identifies hidden problems and patterns in data and uses these insights to drive improvements to coding hygiene and system architecture Gathers, analyzes, synthesizes, and develops visualizations and reporting from large, diverse data sets in servi...

Who we are VOIS (Vodafone Intelligent Solutions) is a strategic arm of Vodafone Group Plc, creating value for customers by delivering intelligent solutions through Talent, Technology & Transformation. As the largest shared services organisation in the global telco industry with 30,000 FTE, our portfolio of next-generation solutions and services are designed in partnership with customers across Vodafone Group, local markets, and partner markets to simplify and drive growth. With our strategic partner Accenture, we work alongside our Vodafone customers, other Telco and tech companies to drive transformation, meet the challenges of our industry and ensure we stay relevant and resilient. This pa...

Job Title - HVAC Design Engineer / Sr. Energy Engineer Location - Chennai Experience : 1-6 Yrs Department - Technology / Engineering Reports To - Energy Auditor Key Responsibilities: HVAC Design & Load Calculations Perform detailed cooling/heating load calculations using industry standards (ASHRAE/ISHAE/IS). Prepare HVAC system designs, equipment sizing, ducting layouts, and technical BOQs. Evaluate existing systems and propose design improvements for energy efficiency. Energy Analysis & Optimization Conduct energy performance assessments of HVAC systems including chillers, pumps, cooling towers, AHUs, and ventilation units. Identify energy-saving opportunities (ECMs), evaluate ROI/payback, ...

3 - 5 Years 15 Openings Trivandrum Role description Role Proficiency: This role requires proficiency in data pipeline development including coding and testing data pipelines for ingesting wrangling transforming and joining data from various sources. Must be adept at using ETL tools such as Informatica Glue Databricks and DataProc with coding skills in Python PySpark and SQL. Works independently and demonstrates proficiency in at least one domain related to data with a solid understanding of SCD concepts and data warehousing principles. Outcomes: Collaborate closely with data analysts data scientists and other stakeholders to ensure data accessibility quality and security across various data ...

CACI International Inc is an American multinational professional services and information technology company headquartered in Northern Virginia. CACI provides expertise and technology to enterprise and mission customers in support of national security missions and government transformation for defense, intelligence, and civilian customers. CACI has approximately 23,000 employees worldwide. Headquartered in London, CACI Ltd is a wholly owned subsidiary of CACI International Inc., a publicly listed company on the NYSE with annual revenue in excess of US $6.2bn. Founded in 2022, CACI India is an exciting, growing and progressive business unit of CACI Ltd. CACI Ltd currently has over 2000 intell...

Welcome to Warner Bros. Discovery… the stuff dreams are made of. Who We Are… When we say, “the stuff dreams are made of,” we’re not just referring to the world of wizards, dragons and superheroes, or even to the wonders of Planet Earth. Behind WBD’s vast portfolio of iconic content and beloved brands, are the storytellers bringing our characters to life, the creators bringing them to your living rooms and the dreamers creating what’s next… From brilliant creatives, to technology trailblazers, across the globe, WBD offers career defining opportunities, thoughtfully curated benefits, and the tools to explore and grow into your best selves. Here you are supported, here you are celebrated, here ...

Responsibilities: Data Architecture & Ingestion — Design and operate Data Cloud data models, ingest pipelines, and real-time streaming for customer, vehicle, product, and telematics data. Own connectors (Salesforce sources, Snowflake, S3, APIs), transformation logic, identity resolution rules, and orchestration to deliver production-ready datasets. Ensure lineage, observability, and SLAs for data delivery. Identity Resolution & Data Governance — Implement and tune identity stitching/resolution to create trusted, unified profiles. Apply data governance, PII masking, retention policies, and role-based access so data is compliant and usable across Sales, Service, and Marketing. Analytics, Segme...

Job description: 4+ years of professional experience in data engineering and data analysis roles. Strong proficiency in SQL and experience with database management systems such as MySQL, PostgreSQL, Oracle, and MongoDB. Hands-on experience with big data tools like Hadoop and Apache Spark. Proficient in Python programming. Experience with data visualization tools such as Tableau, Power BI, and Jupyter Notebooks. Proven ability to design, build, and maintain scalable ETL pipelines using tools like Apache Airflow, DBT, Composer (GCP), Control-M, Cron, and Luigi. Familiarity with data engineering tools including Hive, Kafka, Informatica, Talend, SSIS, and Dataflow. Experience working with cloud ...

We are seeking an experienced Databricks Developer with 5 to 7 years of expertise in big data engineering and analytics platforms. The ideal candidate will have deep experience in Apache Spark Databricks PySpark and cloud platforms such as Azure or AWS and a strong background in data pipeline development performance optimization and data governance. Key Responsibilities Design develop and maintain scalable data pipelines using Apache Spark on Databricks Write efficient and production ready PySpark or Scala code for data transformation and ETL processes Integrate data from various structured and unstructured sources into a unified platform Implement Delta Lake and manage data versioning updat...

Job Responsibilities Build and maintain scalable data pipelines using dbt and Snowflake Design and manage models to transform raw data into analytics-ready datasets Optimize SQL queries and Snowflake performance (clustering, partitioning, tuning) Collaborate with analysts, scientists, and stakeholders to deliver data solutions Ensure data quality with automated testing, validation, and monitoring Document models, transformations, and pipeline processes clearly Manage deployments with Git, CI/CD, and dbt automation Monitor and troubleshoot pipeline issues proactively Automate workflows using Python and Bash scripting Qualifications & Skills Strong expertise in SQL, dbt, and Snowflake Experien...

To get the best candidate experience, please consider applying for a maximum of 3 roles within 12 months to ensure you are not duplicating efforts. Job Category Software Engineering Job Details About Salesforce Salesforce is the #1 AI CRM, where humans with agents drive customer success together. Here, ambition meets action. Tech meets trust. And innovation isn’t a buzzword — it’s a way of life. The world of work as we know it is changing and we're looking for Trailblazers who are passionate about bettering business and the world through AI, driving innovation, and keeping Salesforce's core values at the heart of it all. Ready to level-up your career at the company leading workforce transfor...

Data Engineering Lead Analyst Position Overview Evernorth Core Platform Engineering team is looking for a Data Engineer to design, develop, and implement robust data pipelines for Packaged Business Capabilities (PBCs). You'll work closely with data scientists, analysts, and other engineers to ensure high data quality, performance, and availability. The ideal candidate brings hands-on experience working with big data tools and platforms such as Apache Spark and Databricks, has a strong command of Python, and is comfortable managing ETL workflows, DAGs, and orchestration using tools like Jenkins or Airflow. Experience in cloud-native environments—particularly AWS and AWS Glue —is essential. AB...

Job Description Are You Ready to Make It Happen at Mondel?z International Join our Mission to Lead the Future of Snacking. Make It With Pride. Together with analytics team leaders youwill support our businesswith excellent data models to uncover trends that can drive long-term business results. How you will contribute You will: Work in close partnership with the business leadership team to execute the analytics agenda Identify and incubate best-in-class external partners to drive delivery on strategic projects Develop custom models/algorithms to uncover signals/patterns and trends to drivelong-term business performance Execute the business analytics program agenda using a methodical approach...