76 Airflow Jobs - Page 3

Line of Service Advisory Industry/Sector Not Applicable Specialism Data, Analytics & AI Management Level Senior Associate Job Description & Summary At PwC, our people in data and analytics engineering focus on leveraging advanced technologies and techniques to design and develop robust data solutions for clients. They play a crucial role in transforming raw data into actionable insights, enabling informed decision-making and driving business growth. In data engineering at PwC, you will focus on designing and building data infrastructure and systems to enable efficient data processing and analysis. You will be responsible for developing and implementing data pipelines, data integration, and d...

Line of Service Advisory Industry/Sector Not Applicable Specialism Data, Analytics & AI Management Level Senior Associate Job Description & Summary At PwC, our people in data and analytics engineering focus on leveraging advanced technologies and techniques to design and develop robust data solutions for clients. They play a crucial role in transforming raw data into actionable insights, enabling informed decision-making and driving business growth. In data engineering at PwC, you will focus on designing and building data infrastructure and systems to enable efficient data processing and analysis. You will be responsible for developing and implementing data pipelines, data integration, and d...

Line of Service Advisory Industry/Sector Not Applicable Specialism Data, Analytics & AI Management Level Senior Associate Job Description & Summary At PwC, our people in data and analytics engineering focus on leveraging advanced technologies and techniques to design and develop robust data solutions for clients. They play a crucial role in transforming raw data into actionable insights, enabling informed decision-making and driving business growth. In data engineering at PwC, you will focus on designing and building data infrastructure and systems to enable efficient data processing and analysis. You will be responsible for developing and implementing data pipelines, data integration, and d...

Line of Service Advisory Industry/Sector Not Applicable Specialism Data, Analytics & AI Management Level Senior Associate Job Description & Summary At PwC, our people in data and analytics engineering focus on leveraging advanced technologies and techniques to design and develop robust data solutions for clients. They play a crucial role in transforming raw data into actionable insights, enabling informed decision-making and driving business growth. In data engineering at PwC, you will focus on designing and building data infrastructure and systems to enable efficient data processing and analysis. You will be responsible for developing and implementing data pipelines, data integration, and d...

Job Description: 5 years of in depth hands on experience of developing testing deployment and debugging of Spark Jobs using Scala in Hadoop Platform In depth knowledge of Spark Core working with RDDs Spark SQL In depth knowledge on Spark Optimization Techniques and Best practices Good Knowledge of Scala Functional Programming Try Option Future Collections Good Knowledge of Scala OOPS Classes Traits and Objects Singleton and Companion Case Classes Good Understanding of Scala Language Features Type System Implicit Givens Hands on experience of working in Hadoop Environment HDFS Hive AWS S3 EMR Working experience on Workflow Orchestration tools like Airflow Oozie Working with API calls in Scala...

As a Product Owner III, your role will involve defining and prioritizing features and user stories, outlining acceptance criteria, and collaborating with cross-functional teams to ensure successful delivery of product increments. You will need strong communication skills to effectively engage with stakeholders, gather requirements, and facilitate product demos. Key Responsibilities: - Define and communicate the vision, roadmap, and backlog for data products. - Manage team backlog items and prioritize based on business value. - Partner with the business owner to understand needs, manage scope, and add/eliminate user stories while contributing heavy influence to build an effective strategy. - ...

As a Data Engineer for Generative AI projects, you will be responsible for designing and developing data pipelines using a variety of technologies like Vector DB, Graph DB, Airflow, Spark, PySpark, Python, LangChain, AWS Functions, Redshift, and SSIS. Your role will involve integrating these tools efficiently to create high-performance data flows that support the data requirements of cutting-edge AI initiatives. You will collaborate with data scientists, AI researchers, and stakeholders to understand data needs and implement effective data engineering solutions. - Manage the movement, organization, and quality assessment of large datasets to build a Knowledge base for RAG systems and model t...

In the Global Assessments & People Analytics & Insights group at Citigroup, you will be solving business problems with workforce and business data. Analyzing data to facilitate evidence-based decision making will be a key responsibility. Utilizing statistical models to predict future outcomes and providing actionable insights will be integral to your role. The mission is to equip decision makers with data-driven insights through analytics to make informed decisions about individuals, teams, and organizations in order to enhance business performance. - Collaborate with cross-functional teams, including data scientists, project managers, HR partners, and business stakeholders. - Understand dat...

As a Senior Data Engineer, you will be responsible for leading the design, development, and implementation of scalable data pipelines and ELT processes using tools such as Databricks, DLT, dbt, and Airflow. Your main responsibilities will include collaborating with stakeholders to understand data requirements, delivering high-quality data solutions, and optimizing existing data pipelines to ensure data quality, reliability, and performance. Additionally, you will develop and enforce data engineering best practices, mentor junior data engineers, and monitor and troubleshoot data pipeline issues to ensure minimal disruption to business operations. Qualifications: - Bachelor's degree in Managem...

We are seeking an experienced Senior Data Engineer with strong hands-on expertise in Databricks and AWS to design, develop, and optimize scalable data pipelines and modern data platforms. The ideal candidate will have deep experience with big data ecosystems, cloud-based data solutions (AWS), and ETL/ELT frameworks using Python, PySpark, and SQL. Key Responsibilities: Design, build, and maintain data pipelines and ETL workflows using Databricks (PySpark, Spark SQL) and AWS services (S3, EMR, Glue, Lambda, RDS, DynamoDB). Implement data lakehouse architectures integrating Delta Lake, Snowflake, and AWS storage layers. Develop and deploy automated and scalable data ingestion frameworks to proc...

Join the AI and Data Platforms team at Apple, where we build and manage cloud-based data platforms handling petabytes of data at scale. We are looking for a passionate and independent Software Engineer specializing in reliability engineering for data platforms, with a strong understanding of data and ML systems. If you thrive in a fast-paced environment, love crafting solutions that don't yet exist, and possess excellent communication skills to collaborate across diverse teams, we invite you to contribute to Apple’s high standards in an exciting and dynamic setting. Description As part of our team, you will be responsible for developing and operating our big data platform using open source o...

We have an opportunity to impact your career and provide an adventure where you can push the limits of what's possible. As a Software Engineer III at JPMorganChase within the Corporate Risk Technology, youare an integral part of an agile E&A team that works to design, build, enhance and deliver advanced data engineering solutions and trusted market-leading technology products in a secure, stable, and scalable way. As a core technical contributor, you are responsible for conducting critical technology solutions across multiple technical areas within various business functions in support of the firm's business objectives. Job responsibilities Executes creative software solutions, design, devel...

Ready to shape the future of work? At Genpact, we don’t just adapt to change—we drive it. AI and digital innovation are redefining industries, and we’re leading the charge. Genpact’s AI Gigafactory, our industry-first accelerator, is an example of how we’re scaling advanced technology solutions to help global enterprises work smarter, grow faster, and transform at scale. From large-scale models to agentic AI, our breakthrough solutions tackle companies’ most complex challenges. If you thrive in a fast-moving, tech-driven environment, love solving real-world problems, and want to be part of a team that’s shaping the future, this is your moment. Genpact (NYSE: G) is an advanced technology serv...

JOB DESCRIPTION We have an opportunity to impact your career and provide an adventure where you can push the limits of what's possible. As a Lead Software Engineer at JPMorganChase within the Corporate Risk Technology, you are an integral part of an agile E&A team that works to design, build, enhance and deliver advanced data engineering solutions and trusted market-leading technology products in a secure, stable, and scalable way. As a core technical contributor, you are responsible for conducting critical technology solutions across multiple technical areas within various business functions in support of the firm’s business objectives. Job responsibilities Executes creative software soluti...

JOB DESCRIPTION We have an opportunity to impact your career and provide an adventure where you can push the limits of what's possible. As a Software Engineer III at JPMorganChase within the Corporate Risk Technology, you are an integral part of an agile E&A team that works to design, build, enhance and deliver advanced data engineering solutions and trusted market-leading technology products in a secure, stable, and scalable way. As a core technical contributor, you are responsible for conducting critical technology solutions across multiple technical areas within various business functions in support of the firm’s business objectives. Job responsibilities Executes creative software solutio...

Ready to build the future with AI? At Genpact, we don’t just keep up with technology—we set the pace. AI and digital innovation are redefining industries, and we’re leading the charge. Genpact’s AI Gigafactory, our industry-first accelerator, is an example of how we’re scaling advanced technology solutions to help global enterprises work smarter, grow faster, and transform at scale. From large-scale models to agentic AI, our breakthrough solutions tackle companies’ most complex challenges. If you thrive in a fast-moving, innovation-driven environment, love building and deploying cutting-edge AI solutions, and want to push the boundaries of what’s possible, this is your moment. Genpact (NYSE:...

Ready to shape the future of work? At Genpact, we don’t just adapt to change—we drive it. AI and digital innovation are redefining industries, and we’re leading the charge. Genpact’s AI Gigafactory, our industry-first accelerator, is an example of how we’re scaling advanced technology solutions to help global enterprises work smarter, grow faster, and transform at scale. From large-scale models to agentic AI, our breakthrough solutions tackle companies’ most complex challenges. If you thrive in a fast-moving, tech-driven environment, love solving real-world problems, and want to be part of a team that’s shaping the future, this is your moment. Genpact (NYSE: G) is an advanced technology serv...

Equifax is seeking creative, high-energy and driven software engineers with hands-on development skills to work on a variety of meaningful projects. Our software engineering positions provide you the opportunity to join a team of talented engineers working with leading-edge technology. You are ideal for this position if you are a forward-thinking, committed, and enthusiastic software engineer who is passionate about technology. What you’ll do Design, develop, and operate high scale applications across the full engineering stack Design, develop, test, deploy, maintain, and improve software. Apply modern software development practices (serverless computing, microservices architecture, CI/CD, i...

Ready to build the future with AI? At Genpact, we don’t just keep up with technology—we set the pace. AI and digital innovation are redefining industries, and we’re leading the charge. Genpact’s AI Gigafactory, our industry-first accelerator, is an example of how we’re scaling advanced technology solutions to help global enterprises work smarter, grow faster, and transform at scale. From large-scale models to agentic AI, our breakthrough solutions tackle companies’ most complex challenges. If you thrive in a fast-moving, innovation-driven environment, love building and deploying cutting-edge AI solutions, and want to push the boundaries of what’s possible, this is your moment. Genpact (NYSE:...

Founded in 1976, CGI is among the largest independent IT and business consulting services firms in the world. With 94,000 consultants and professionals across the globe, CGI delivers an end-to-end portfolio of capabilities, from strategic IT and business consulting to systems integration, managed IT and business process services and intellectual property solutions. CGI works with clients through a local relationship model complemented by a global delivery network that helps clients digitally transform their organizations and accelerate results. CGI Fiscal 2024 reported revenue is CA$14.68 billion and CGI shares are listed on the TSX (GIB.A) and the NYSE (GIB). Learn more at cgi.com. Job Titl...

Job Summary As a Sr. Developer you will play a pivotal role in designing developing and optimizing data solutions using cutting-edge technologies. Your expertise in Spark in Scala Delta Sharing and Databricks will drive innovation and efficiency in our data processes. Collaborate with cross-functional teams to enhance data management and analytics capabilities contributing to the companys growth and societal impact. Responsibilities Develop and implement robust data solutions using Spark in Scala to optimize performance and scalability. Collaborate with teams to integrate Delta Sharing for seamless data exchange and interoperability. Administer Databricks Unity Catalog to ensure secure and o...

Role Overview: You will play a crucial role as a Senior AI/ML Engineer at EY, helping clients in the realm of modern data science and analytics. Your expertise will be utilized in designing, implementing, stabilizing, and optimizing internal controls using cutting-edge AI & Big Data technologies. By leveraging your skills, you will contribute to building comprehensive Risk & Controls monitoring mechanisms and developing next-generation AI & Data led Risk technology platforms. Key Responsibilities: - Develop robust AI/ML models to provide valuable insights and enhance decision-making processes across multiple business lines. - Lead the design and development of customized machine learning alg...

Role & responsibilities 6+ years of experience with proven track of - Strong SQL background Strong DataStage tool experience Airflow, GitHub, Git Actions or Jenkins Teradata or similar DB experience Python and Spark background is plus

Job Title: - GCP Data Engineer with Big Query Location: - AIA Kolkata Job Type 3 days from office (Hybrid) Minimum 6 to 13 years of experience Mandatory Skills: GCP Services – Big Query, Cloud SQL, Data flow Around 7+ years of experience in development in Data warehousing projects in GCP platforms, Good understanding of dimensional modelling Expertise in MySQL & SQL/PL GCP & BigQuery knowledge is must, GCP certification is added advantage Good experience in Cloud Composer, DAGs , airflow REST API development experience Good in analytical and problem solving, efficient communication Ability to lead the team members, convert requirements into technical solutions, assign the work, coordinate th...

Experience : 3.00 + years Salary : Confidential (based on experience) Expected Notice Period : 15 Days Shift : (GMT+05:30) Asia/Kolkata (IST) Opportunity Type : Remote Placement Type : Full Time Permanent position(Payroll and Compliance to be managed by: Datalogz) (*Note: This is a requirement for one of Uplers' client - Datalogz) What do you need for this opportunity? Must have skills required: Power BI, SQL Alchemy Datalogz is Looking for: Sr Data Engineer Position Overview We are looking for a Data Engineer to join our growing engineering team and help shape the core data infrastructure that powers the Datalogz platform. You will be responsible for building and maintaining reliable, scala...