10863 Airflow Jobs - Page 16

Role Overview: You will be joining Fluent Health, a dynamic healthcare startup that is revolutionizing healthcare management for individuals and families. As a Senior Data Engineer, you will be a key player in designing, implementing, and optimizing the analytical and real-time data platform. Your role will involve a combination of hands-on data engineering and high-level architectural thinking to build scalable data infrastructure, with ClickHouse as a central component of the analytics and data warehousing strategy. Key Responsibilities: - Architecture & Strategy: - Take ownership of the target data architecture, focusing on ClickHouse for large-scale analytical and real-time querying work...

Role Overview: As a developer, your primary responsibility will be to build applications, features, and components based on design specifications while ensuring high-quality code that complies with coding standards and project timelines. You will also be involved in testing, debugging, technical decision-making, documentation, domain expertise, project, and release management, team leadership, customer interaction, and utilizing a specific technology stack. Key Responsibilities: - Develop and deliver applications, features, and components according to design specifications. - Write, review, and execute unit test cases, debug code, validate results with users, and support defect analysis and ...

Role Overview: As a Senior Engineer I at lululemon, you will be part of the Product Integrity, Sustainability & Compliance Technology team, which focuses on empowering the organization to drive innovation and deliver on its strategic vision. Your role will involve contributing to the development and delivery of industry-leading technology solutions that align with lululemon's business goals. You will bring a high level of technical knowledge and mentoring abilities, acting as a leader in your technology space and supporting the team through various development and operational activities. Key Responsibilities: - Act as a main contributor in Agile ceremonies - Provide mentorship and engineerin...

• Bachelor’s degree in Computer Science, Engineering, or related field. • 5–8 years of hands-on experience in data engineering. • Strong programming experience in Python, PySpark and databricks for big data processing. • Solid experience in SQL writing. • Proven experience working on AWS services such as S3, EMR. • Proficient in building and maintaining CI/CD pipelines for data infrastructure. • Solid understanding of data lake and data warehouse architecture. • Strong SQL skills for querying large datasets. • Experience with version control (Git) and collaborative workflows. Nice to Have (Preferred): • Experience with Terraform / CloudFormation for infrastructure as code. • Familiarity with...

Job Description Apache Airflow Python Tech Lead Who are we looking for? We are seeking an Apache Airflow Senior Python Tech Lead with strong expertise in Python and hands-on experience in Azure cloud technologies. The role will focus on migrating processes from the current 3rd Party RPA modules to Apache Airflow modules, ensuring seamless orchestration and automation of workflows. The ideal candidate will bring technical proficiency, problem-solving skills, and a deep understanding of workflow automation, along with a strong grasp of the North America insurance industry processes. Responsibilities Strong expertise in Apache Airflow workflow orchestration. Proficiency in Python programming fo...

Job Description Python API / FAST API Developer Who are we looking for? We are seeking a Python Developer with strong expertise in Python and Databases & hands-on experience in Azure cloud technologies. The role will focus on migrating processes from the current 3 rd Party RPA modules to Apache Airflow modules, ensuring seamless orchestration and automation of workflows. The ideal candidate will bring technical proficiency, problem-solving skills, and a deep understanding of workflow automation, along with a strong grasp of the North America insurance industry processes Responsibilities · Proficiency in Python programming for API Development, Scripting, Data transformation, and Process Autom...

As a Tech Lead ETL, you will play a crucial role in handling data integration using a variety of tools and technologies. Your responsibilities will include: - Extracting data from different sources like databases, CRM systems, and flat files. - Designing and creating ETL processes and pipelines. - Ensuring data quality, modeling, and tuning for efficient operations. - Utilizing strong troubleshooting and problem-solving skills to quickly identify and resolve issues, while also providing innovative solutions. - Collaborating with developers, administrators, and stakeholders to ensure seamless integration and operations. - Keeping up to date with industry trends and technologies to drive conti...

As a GCP Data Architecture at TekWissen, your role will involve designing and deploying Data Centric Architecture in Google Cloud Platform for the Materials Management platform. This platform is a part of a larger Industrial Systems IT Transformation effort, aimed at transforming the client's Materials Requirement Planning & Inventory Management capabilities. Your responsibilities will include getting/giving data from multiple applications in Product Development, Manufacturing, Finance, Purchasing, N-Tier Supply Chain, and Supplier Collaboration. **Key Responsibilities:** - Designing and deploying Data Centric Architecture in GCP for Materials Management platform - Getting/giving data from m...

IMEA (India, Middle East, Africa) India LIXIL INDIA PVT LTD Employee Assignment Fully remote possible Full Time 1 May 2025 Title Data Engineer Job Description A Data Engineer is responsible for designing, building, and maintaining large-scale data systems and infrastructure. Their primary goal is to ensure that data is properly collected, stored, processed, and retrieved to support business intelligence, analytics, and data-driven decision-making. Key Responsibilities Design and Develop Data Pipelines: Create data pipelines to extract data from various sources, transform it into a standardized format, and load it into a centralized data repository. Build and Maintain Data Infrastructure: Des...

Overview TekWissen is a global workforce management provider throughout India and many other countries in the world. The below client is a global company with shared ideals and a deep sense of family. From our earliest days as a pioneer of modern transportation, we have sought to make the world a better place – one that benefits lives, communities and the planet Job Title: Artificial Intelligence Senior Specialist Location: Chennai Work Type: Hybrid Position Description Employees in this job function are responsible for developing intelligent programs, cognitive applications and algorithms for data analysis and automation, leveraging various AI techniques such as deep learning, generative AI...

C1X AdTech Pvt Ltd is a fast-growing, product and engineering-driven AdTech company building next-generation advertising and marketing technology platforms. Our mission is to empower enterprise clients with the smartest marketing solutions, enabling seamless integration with personalization engines and delivering cross-channel marketing capabilities. We are dedicated to enhancing customer engagement and experiences while focusing on increasing Lifetime Value (LTV) through consistent messaging across all channels. Our engineering team spans front end (UI), back end (Java/Node.js APIs), Big Data, and DevOps, working together to deliver scalable, high-performance products for the digital advert...

Job Summary: We are seeking a highly skilled and motivated Data Engineer to design, develop, and optimize our critical data infrastructure. You will play a pivotal role in building scalable batch and real-time data pipelines, ensuring data quality, and collaborating with cross-functional teams to deliver impactful data solutions. If you are passionate about data, possess strong technical skills, and thrive in a collaborative environment, we encourage you to apply. Responsibilities: Design, implement, and optimize robust batch and real-time data pipelines using technologies such as Spark, Python, and Airflow. Leverage AWS native tools (e.g., S3, EMR, Glue) effectively to build and manage scal...

Position: Software test Engineer _ ETL Test Automation Engineer Location: Pune Work mode: Hybrid (2-3 days in office) Timings: 1 Pm to 9 PM Experience: 5 to 10 years Looking for immediate joiners Company : Dataceria Software solutions We have an exciting opportunity in the Data Services team for an Software test Engineer _ ETL Test Automation Engineer to develop and maintain test, data validation frameworks. The Test Engineer will ensure stability of data pipelines and metadata management . Provides technical support and address data-related issues for Product, Data and Design teams. Knowledge/Skills Excellent written and verbal communication skills, along with an ability to effectively inte...

Role Overview: You will be part of CloudSEK, a leading Cyber security product company, working with a team of enthusiastic and highly driven individuals striving towards a common goal. The company's mission is to develop the world's fastest and most reliable AI technology for real-time detection and resolution of digital threats. Key Responsibilities: - Develop and maintain scalable backend services using Python and optionally Golang. - Work on data pipelines and system components involving Kafka, Airflow, and PySpark. - Write robust code interacting with SQL/NoSQL databases like PostgreSQL and MongoDB. - Build internal tools and services, participate in architecture reviews, and manage depl...

As a Senior Data Engineer at our company, you will be responsible for contributing to the development and maintenance of scalable data solutions. Your expertise in SQL, Snowflake, and AWS-based ETL tools will be crucial in ensuring the high performance of our data systems. **Key Responsibilities:** - Building and deploying reliable ETL/ELT workflows - Designing large-scale data pipelines and automated audit processes - Extracting data from diverse sources such as flat files, XML, big data appliances, and RDBMS - Collaborating across teams in Agile environments - Writing and updating technical documentation **Qualifications Required:** - 7+ years of relevant experience - Strong hands-on exper...

As a Data Engineer in the Marketing Data team, your role is crucial in enhancing the data platform to drive world-class marketing insights. You will collaborate with Data Scientists, Analysts, and Marketing stakeholders to ensure the reliability, scalability, and operational excellence of data products essential for marketing strategy. Your primary responsibilities include: - Maintaining and optimizing data pipelines processing high volumes of marketing data from various sources. - Developing monitoring, alerting, and testing frameworks to ensure data quality and operational reliability. - Building data models and infrastructure supporting marketing attribution, audience targeting, and A/B t...

You have been asked to join Luxoft as a Developer to support various customer initiatives, focusing on developing solutions based on client requirements in the Telecom/network work environment. As a Developer, your responsibilities will include: - Utilizing technologies such as Python, Airflow, Node.js, Microsoft Azure App Service, PostgreSQL, MySQL, Celery, and RabbitMQ for back-end development. - Applying knowledge of SAFe/Agile methodologies, RDBMS, DevOps, Azure, and building GUI. - Translating User / Business Requirements into Technical Requirements. - Conducting Code scans to identify and fix security vulnerabilities. - Working in a Scaled Agile model and debugging production issues. -...

Job Description: Python Developer / Data Engineer – Talend to Python Migration About the Role We are seeking experienced Python Developers/Data Engineers to join our team for a strategic migration project, moving enterprise ETL workloads from Talend to a modern Python-based ingestion framework on Google Cloud Platform (GCP). You will work closely with architects, platform engineers, and automation teams to design, build, and optimize scalable data pipelines, leveraging Airflow, Cloud Run, Dataproc, and BigQuery. Key Responsibilities * ETL Migration & Development * Analyze existing Talend jobs/modules and design equivalent Python-based ETL workflows. * Develop, test, and deploy Python scripts...

Join us as a Software Engineer This is an opportunity for a driven Software Engineer to take on an exciting new career challenge Day-to-day, you'll build a wide network of stakeholders of varying levels of seniority It’s a chance to hone your existing technical skills and advance your career We're offering this role at associate level What you'll do In your new role, you’ll engineer and maintain innovative, customer centric, high performance, secure and robust solutions. You’ll be working within a feature team and using your extensive experience to engineer software, scripts and tools that are often complex, as well as liaising with other engineers, architects and business analysts across th...

Join us as a Software Engineer This is an opportunity for a driven Software Engineer to take on an exciting new career challenge Day-to-day, you'll build a wide network of stakeholders of varying levels of seniority It’s a chance to hone your existing technical skills and advance your career We're offering this role at associate level What you'll do In your new role, you’ll engineer and maintain innovative, customer centric, high performance, secure and robust solutions. You’ll be working within a feature team and using your extensive experience to engineer software, scripts and tools that are often complex, as well as liaising with other engineers, architects and business analysts across th...

Equifax is seeking creative, high-energy and driven software engineers with hands-on development skills to work on a variety of meaningful projects. Our software engineering positions provide you the opportunity to join a team of talented engineers working with leading-edge technology. You are ideal for this position if you are a forward-thinking, committed, and enthusiastic software engineer who is passionate about technology. What You’ll Do Demonstrate a deep understanding of cloud native, distributed micro service based architectures Deliver solutions for complex business problems through software standard SDLC Build strong relationships with both internal and external stakeholders includ...

Bachelor's degree in computer science or a related discipline or equivalent work experience required. 6 - 8 years of application or infrastructure related experience required experience in the securities or financial services industry is a plus 10+ years of experience in infrastructure engineering, DevOps, or site reliability roles. Hands-on experience with Kubernetes, Docker, HELM, and GitLab CI/CD. Proficiency in Python and Bash/Shell scripting for automation and operational tooling. Familiarity with enterprise tools such as JIRA, ServiceNow, and Azure AD. Working knowledge of networking fundamentals and storage systems, especially as they apply to distributed AI systems. Strong documentat...

Equifax is seeking creative, high-energy and driven software engineers with hands-on development skills to work on a variety of meaningful projects. Our software engineering positions provide you the opportunity to join a team of talented engineers working with leading-edge technology. You are ideal for this position if you are a forward-thinking, committed, and enthusiastic software engineer who is passionate about technology. What You’ll Do Design, develop, and operate high scale applications across the full engineering stack Design, develop, test, deploy, maintain, and improve software. Apply modern software development practices (serverless computing, microservices architecture, CI/CD, i...

As a Senior Data Engineer at Milestone Technologies, you will play a crucial role in leading data ingestion, transformation, and optimization initiatives using the modern Apache and Azure data stack. Your responsibilities will include: - Building and managing high-volume data pipelines using Spark/Databricks. - Implementing ELT frameworks using Azure Data Factory/Synapse Pipelines. - Optimizing large-scale datasets in Delta/Iceberg formats. - Implementing robust data quality, monitoring, and governance layers. - Collaborating with Data Scientists, Analysts, and Business stakeholders. Your technical stack will involve: - Big Data: Apache Spark, Kafka, Hive, Airflow, Hudi/Iceberg. - Cloud: Azu...

Role Overview: You will be leading a team responsible for a product capability, delivering complex solutions, participating in technical designs, and actively participating in production support. Your role will involve planning, performing code and architecture reviews, ensuring the quality and integrity of the Software Development Life Cycle (SDLC) for your team, and identifying opportunities for improvement in team processes. Key Responsibilities: - Manage individual performance through regular 1:1s, coaching, mentoring, and development plans - Partner with the product owner to ensure clear definition of requirements - Lead efforts to translate requirements into technical specifications - ...