988 Apache Airflow Jobs - Page 31

As a Digital Product Engineering company, Nagarro is seeking a skilled individual to join our team as an ETL Tester. With over 18000 experts across 38 countries, we are scaling up and looking for new colleagues who can contribute to our dynamic and non-hierarchical work culture. **Requirements:** - Possess a total experience of 3+ years in ETL Testing, data migration, and data validation processes. - Demonstrated expertise in complex SQL queries and data validation techniques. - Experience with tools like Apache Airflow, Databricks, or similar data orchestration platforms. - Proven track record in managing data readiness for large-scale implementations across multiple geographies. - Familiar...

As a Digital Product Engineering company scaling in a significant way, Nagarro is seeking a skilled professional to join our dynamic and non-hierarchical work culture. With over 18000 experts spread across 38 countries, we are dedicated to building products, services, and experiences that inspire, excite, and delight users across all digital mediums. **REQUIREMENTS:** - Possess a total of 5+ years of experience in the field. - Strong proficiency in ETL Testing, data migration, and data validation processes. - Demonstrated expertise in complex SQL queries and data validation techniques. - Working knowledge of AWS cloud services, specifically in data handling. - Experience with data orchestrat...

As a Data Engineer Architect, you will play a critical role in leading our data engineering efforts by designing and implementing scalable data solutions that align with our business objectives. Your expertise in Snowflake, data warehousing, and modern data engineering tools will be key in ensuring the success of our data projects. Your responsibilities will include designing robust data architecture solutions, developing and maintaining data pipelines using tools like DBT and Apache Airflow, collaborating with cross-functional teams to gather requirements, optimizing data processes for improved performance, and managing RDBMS databases with a focus on AWS RDS. Additionally, you will utilize...

UnifyCX is looking for a highly experienced Senior Data Scientist to join the team. As a Senior Data Scientist, you will be responsible for developing and implementing complex statistical models and machine learning algorithms to support data-driven decision-making processes. This role involves leading data analysis projects, collaborating with cross-functional teams, and identifying key business insights, trends, and opportunities. We believe that data transformation and integration play a crucial role in generating business insights. Therefore, we are seeking a Senior Data Scientist with experience in automating data pipelines to ensure proper data transformation and integration for analyt...

As a Lead Data Engineer with over 7 years of experience, you will be responsible for designing, developing, and maintaining data pipelines, ETL processes, and data warehouses. You will be based in Hyderabad and should be able to join immediately. Your primary skills should include proficiency in SQL, Python, PySpark, AWS, Airflow, Snowflake, and DBT. Additionally, you should have a Bachelor's or Master's degree in Computer Science, Information Systems, Engineering, or a related field. In this role, you will need a minimum of 4+ years of hands-on experience in data engineering, ETL, and data warehouse development. You should have expertise in ETL tools such as Informatica Power Center or IDMC...

Are you ready to make it happen at Mondelz International Join our mission to lead the future of snacking and make it with pride. Together with analytics team leaders, you will support our business by providing excellent data models to uncover trends that can drive long-term business results. Your role will involve: - Working closely with the business leadership team to execute the analytics agenda - Identifying and incubating best-in-class external partners for strategic projects - Developing custom models/algorithms to uncover signals, patterns, and trends for long-term business performance - Executing the business analytics program agenda using a methodical approach that communicates the d...

You are an experienced Python developer with a focus on the stock market domain, having a minimum of 4 years of relevant experience. As a Python developer, you will be responsible for various data engineering tasks using your expertise in Python programming. Your qualifications include a Bachelors or Masters degree in Computer Science, Data Engineering, or a related field. You should have at least 4 years of hands-on experience in Python programming specifically for data engineering tasks. Proficiency in web server technologies using frameworks like Flask, FastAPI, and Django is essential for this role. Additionally, you should have expertise in creating and managing workflows using Apache A...

As a DataOps Engineer at BlackLine, you will play a crucial role in ensuring the robustness, reliability, and scalability of our data pipelines and infrastructure. Your responsibilities will include developing and maintaining data pipelines, orchestrating workflows, containerizing applications, managing cloud infrastructure, scripting automation, implementing CI/CD pipelines, providing system administration support, monitoring data pipelines, collaborating with various stakeholders, and documenting operational procedures. To excel in this role, you are required to have 2-6 years of professional experience in DataOps, Data Engineering, or a related field. Proficiency in Python and SQL for dat...

You are invited to apply for the position of Data Engineer at our company based in Bengaluru. As a Data Engineer with 5 to 7 years of experience, you will be responsible for designing, building, and optimizing scalable data pipelines and infrastructure. Collaborating closely with data scientists, analysts, and software engineers, you will play a key role in ensuring the reliable and efficient delivery of data across our data ecosystem. The ideal candidate should hold a Bachelor's or Master's degree in Computer Science, Engineering, Data Science, or a related field. You should have at least 3 to 5 years of experience in data engineering or a similar role. Proficiency in SQL and one programmin...

The position is based at Altimetrik with base locations in Bangalore, Chennai, Pune, Jaipur, Hyderabad, Gurugram. The ideal candidate should be able to join immediately or within 10 days. As a Machine Learning Engineer, your primary responsibility will be to design and implement ML solutions while architecting scalable and efficient systems. You should be proficient in Machine Learning Algorithms, Data Engineering, ETL/ELT processes, data cleaning, preprocessing, EDA, feature engineering, data splitting, and encoding. Additionally, you should have experience in MLOps, including model versioning, training, experimenting, deployment, and monitoring using tools such as Python, Pandas, TensorFlo...

As a GCP Data Engineer specialized in Data Migration & Transformation, you will be responsible for designing and constructing robust, scalable data pipelines and architectures on Google Cloud Platform (GCP), particularly focusing on BigQuery. Your primary tasks will involve migrating and transforming large-scale data systems and datasets to GCP while emphasizing performance, scalability, and reliability. It will be crucial for you to automate data lineage extraction and ensure data integrity across various systems and platforms. Collaborating closely with architects and stakeholders, you will play a key role in implementing GCP-native and 3rd-party tools for data ingestion, integration, and ...

As a Data Quality Developer joining our Enterprise Data Governance team, you will be responsible for implementing data quality rules within our SuperZoom data quality platform. Your primary tasks will include translating business data quality requirements into technical solutions, developing SQL-based data quality rules, and collaborating with various team members and stakeholders to ensure successful implementation of data quality rules. You will need to leverage your strong SQL expertise and understanding of data quality challenges to monitor and enhance data integrity. Working closely with the data governance team, data quality team, and business stakeholders, you will play a crucial role...

As a Senior Data Engineer with 4+ years of experience, you will be responsible for designing, developing, and optimizing data pipelines using Airflow, Python, and DBT. Your role will involve building and maintaining data models and data marts in Snowflake, while implementing best practices in data transformation, testing, and documentation. Collaborating with data analysts, scientists, and business stakeholders is crucial to understand data needs and ensure data quality, governance, and lineage across data pipelines. Monitoring and troubleshooting data pipeline issues proactively, optimizing query performance and data storage in Snowflake, as well as automating workflows and scheduling tasks...

You have more than 7 years of IT experience and have expertise in working with at least two structural databases such as SQL, Oracle, or Postgres, and one NoSQL database. You are capable of collaborating with the Presales team to propose optimal solutions and architectures. Additionally, you possess design experience with BQ, Redshift, and Synapse. Your responsibilities include managing the entire product life cycle, from proposal to delivery, and continuously evaluating architecture enhancements with the delivery team. You are well-versed in security protocols for in-transit data, as well as encryption and decryption of PII data. Moreover, you have a strong understanding of analytics tools ...

You will be joining eMeasurematics Pvt Ltd, a leading innovator in intelligent material handling and advanced automation solutions for large-scale manufacturing and warehousing facilities. Our commitment to pioneering autonomous systems and tailored automation solutions has enabled us to work with industry giants across the global steel, mega-manufacturing, and warehousing sectors. By harnessing cutting-edge data-driven models and robust engineering expertise, we empower businesses to enhance productivity and achieve operational excellence. As a forward-thinking leader in industrial automation, eMeasurematics is dedicated to revolutionizing the future of manufacturing through smart, sustaina...

As a Python Developer at MicroGenesis TechSoft in Bangalore, India, you will be responsible for designing, developing, and maintaining robust Python-based applications and data pipelines. Your role will involve building and orchestrating workflows using Apache Airflow, collaborating with cross-functional teams to gather requirements and deliver high-quality solutions, and optimizing existing systems for scalability, reliability, and performance. Additionally, you will participate in code reviews, mentor junior developers, troubleshoot and resolve issues in development, testing, and production environments, and ensure code quality, documentation, and adherence to best practices. To be success...

About Markovate: At Markovate, you don't just follow trends, we drive them. We transform businesses through innovative AI and digital solutions that turn vision into reality. Our team harnesses breakthrough technologies to craft bespoke strategies that align seamlessly with our clients" ambitions. From AI Consulting And Gen AI Development To Pioneering AI Agents And Agentic AI, We Empower Our Partners To Lead Their Industries With Forward-thinking Precision And Unmatched Overview. We are seeking a highly experienced and innovative Senior Data Engineer with a strong background in hybrid cloud data integration, pipeline orchestration, and AI-driven data modelling. Requirements: - 9+ years of e...

Join our Transformation Liquidity Engineering team in Gurugram and collaborate with a peer network of technologists to play a key role in implementing critical liquidity calculations, creating data visualisations, and delivering data to downstream systems. At Macquarie, we bring together diverse people and empower them to shape various possibilities. As a global financial services group operating in 34 markets with 55 years of unbroken profitability, you will be part of a friendly and supportive team where everyone contributes ideas and drives outcomes regardless of their role. In this role, you will leverage your deep understanding of big data technologies and enthusiasm for DevOps practice...

We are seeking a SQL Expert with approximately 5 years of practical experience in creating, enhancing, and refining intricate SQL queries, stored procedures, and database solutions. Your primary responsibility will involve supporting our data-driven applications to ensure efficient data processing, performance optimization, and robust database design. In this pivotal role, you will collaborate closely with product, engineering, and analytics teams to deliver high-quality, reliable, and scalable data solutions. Your duties will encompass designing and implementing complex SQL queries, stored procedures, views, and functions, optimizing query performance, developing ETL/ELT pipelines for data ...

As a Data Engineer, you will be responsible for designing and developing scalable data engineering solutions using Google Cloud Platform (GCP) and PySpark. Your main focus will be on optimizing Spark jobs for performance, scalability, and efficient resource utilization. You will also be involved in developing, maintaining, and enhancing ETL pipelines using BigQuery, Apache Airflow, and Cloud Composer. Collaborating with data scientists, analysts, and DevOps teams to translate business requirements into technical solutions will be a key aspect of your role. Ensuring data integrity and security by implementing data governance, compliance, and security best practices will be crucial. Monitoring...

About the Role We are seeking a highly skilled Senior Data Engineer to design, build, and optimize scalable data platforms that empower data-driven decision-making. This role requires deep technical expertise in modern data engineering frameworks, architectural patterns, and cloud-native solutions on AWS. You will be a key contributor to our data strategy, ensuring data quality, governance, and reliability while mentoring other engineers in the team. Key Responsibilities Design, develop, and own robust, scalable, and maintainable data pipelines (batch & real-time). Architect and implement Data Lake, Data Warehouse, and Lakehouse solutions using modern frameworks and architectural patterns. E...

Key Responsibilities: Identify & analyze MIM workflows, Synchronization, policy rules (Management Policy Rules). Synchronization Service (FIM/MIM) extensively worked on the Metaverse extension code Deep understanding of synchronization rules & Troubleshoot MIM synchronization issues and ensure data integrity across connected systems. Collaborate with security, infrastructure, and application teams to define and enforce identity governance policies. Develop technical documentation, including architecture diagrams, configuration guides, and operational procedures. Support migration from MIM to other platforms. Experience on migrating from MIM synchronization service to other modern identity pl...

We are seeking an experienced Amazon Redshift Developer / Data Engineer to design, develop, and optimize cloud-based data warehousing solutions. The ideal candidate should have expertise in Amazon Redshift, ETL processes, SQL optimization, and cloud-based data lake architectures. This role involves working with large-scale datasets, performance tuning, and building scalable data pipelines. Key Responsibilities: Design, develop, and maintain data models, schemas, and stored procedures in Amazon Redshift. Optimize Redshift performance using distribution styles, sort keys, and compression techniques. Build and maintain ETL/ELT data pipelines using AWS Glue, AWS Lambda, Apache Airflow, and dbt. ...

We are seeking a highly skilled Senior Data Engineer to join our dynamic team in Bangalore. You will design, develop, and maintain scalable data ingestion frameworks and ELT pipelines using tools such as DBT, Apache Airflow, and Prefect. The ideal candidate will have deep technical expertise in cloud platforms (especially AWS), data architecture, and orchestration tools. You will work with modern cloud data warehouses like Snowflake, Redshift, or Databricks and integrate pipelines with AWS services such as S3, Lambda, Step Functions, and Glue. A strong background in SQL, scripting, and CI/CD practices is essential. Experience with data systems in manufacturing is a plus.

About Inspire Brands: Inspire Brands is looking for a Data Architect, a self-driven senior technical professional to collaborate with our business, Product and Development teams and help qualify, identify, and build Data & Analytics solutions. As part of the Enterprise Data Team, this position is responsible for actively defining robust, efficient, scalable and innovation solutions that are custom fit to our needs. Job Summary: Play a key role working with product and business teams to understand their strategic, business, and technical needs. Define technical architecture roadmaps which help realize business values in both tactical and strategic ways. Define and continuously update architec...