18 Mwaa Jobs

We are looking for Data Engineers ! Salary : INR 10,00,000 - 12,00,000 / year Responsibilities Transform and process source data into data products and enable egression to other platforms Develop efficient Data Lake frameworks using Scala, PySpark, or Python, with robust data quality and security controls. Create reusable libraries and config driven pipelines for enterprise wide ingestion and integration Ensure compliance with data governance and security standards using tools like AWS DataZone, Lake Formation, AWS Glue and MWAA Eligibility This is an entry-level job Experience with CI/CD tools such as GitHub, GitHub Actions, ArgoCD, and automated deployment pipelines. Demonstrable in Python...

Role Overview: As a member of the team at Experian, you will be responsible for developing client-facing standardized reports using Business Intelligence tools such as Sigma and Tableau. You will have the opportunity to perform data profiling on source data with minimal documentation, troubleshoot data independently, and develop complex SQL code. Your role will also involve writing secure, stable, testable, and maintainable Python code, as well as conducting root cause analysis, proposing solutions, and taking ownership of their resolution. Additionally, you will create and maintain report specifications and process documentations, collaborate with Engineering teams, and provide on-call prod...

Welo Data works with technology companies to provide datasets that are high-quality, ethically sourced, relevant, diverse, and scalable to supercharge their AI models. As a Welocalize brand, WeloData leverages over 25 years of experience in partnering with the world's most innovative companies and brings together a curated global community of over 500,000 AI training and domain experts to offer services that span: ANNOTATION & LABELLING: Transcription, summarization, image and video classification and labeling. ENHANCING LLMs: Prompt engineering, SFT, RLHF, red teaming and adversarial model training, model output ranking. DATA COLLECTION & GENERATION: From institutional languages to remote f...

You are applying for the position of Senior Snowflake Data Engineer (Snowflake Specialist) for a leading Loan Software Company in the USA. In this role, you will be responsible for designing, implementing, and optimizing Snowflake-based data warehouses, developing ELT/ETL pipelines using SQL and Python, and collaborating with technical leads to design domain-specific data products. Your qualifications should include a Bachelor's degree in Computer Science or related field, proven expertise in Snowflake data warehouse design, advanced SQL skills, and experience with AWS cloud services integrated with Snowflake. **Role Overview:** As a Senior Snowflake Data Engineer, your primary role will be ...

Job Tittle :Data Engineer MWAA & Redshift Pipelines Job Location Chennai \ Ahmedabad Exp 7 10 Yrs Pipeline Design & Development Design, build, and maintain data ingestion and transformation pipelines using MWAA (Apache Airflow) and AWS Redshift. Develop Airflow DAGs to orchestrate data extraction from diverse sources (e.g., Oracle EBS, APIs, flat files, or S3). Implement transformation logic using SQL, Python, or Redshift stored procedures to curate data for analytical consumption. Create and manage staging, curated, and semantic data layers in Redshift aligned with the Medallion architecture principles. Integrate data ingestion pipelines with AWS services (e.g., S3, Glue, Lambda, Secrets Ma...

Pipeline Design & Development Design, build, and maintain data ingestion and transformation pipelines using MWAA (Apache Airflow) and AWS Redshift. Develop Airflow DAGs to orchestrate data extraction from diverse sources (e.g., Oracle EBS, APIs, flat files, or S3). Implement transformation logic using SQL, Python, or Redshift stored procedures to curate data for analytical consumption. Create and manage staging, curated, and semantic data layers in Redshift aligned with the Medallion architecture principles. Integrate data ingestion pipelines with AWS services (e.g., S3, Glue, Lambda, Secrets Manager Performance, Optimization & Maintenance Tune Redshift queries and schema for high performanc...

Data Ops Support Engineer Responsibilities: Implement and manage continuous integration and deployment pipelines for various applications and services. Proactively monitor data pipelines, system performance and troubleshoot any issues to maintain high availability and reliability of the infrastructure Collaborate with development and business teams to design and implement scalable and resilient solutions. Automate routine tasks and processes to streamline operations and improve efficiency. Conduct in-depth reviews of code and debug issues in data pipelines across multiple applications in production environments, with the ability to perform detailed code analysis and troubleshoot complex issu...

Job Title: Senior Consultant Snowflake Career Level: D1 Introduction To Role Are you ready to drive innovation and optimize services in the realm of Enterprise Data Management At AstraZeneca, we are on a mission to pioneer scientific breakthroughs and transform patient outcomes. As a Senior Consultant, you will play a pivotal role in enhancing our Enterprise Data Platform and engineering Enterprise Data Assets & Products. Join us in our journey to leverage cutting-edge technologies, scale AI solutions, and unlock the true potential of data. Accountabilities Ensure the service is in Always ON mode and maintain at least 99% service availability for users. Optimize the service for improved pipe...

Technology Lead ETL & Data Engineering (Fandango) Location: Pune / Hybrid Experience: 8 to 12 Years Employment Type: Full-Time Job Summary We are seeking a highly skilled and experienced Technology Lead with 10+ years of expertise in ETL, Data Warehousing, and AWS cloud services. The ideal candidate should have strong hands-on experience with Talend (Data Integration, Big Data, Admin), AWS Glue, PySpark, Airflow (MWAA preferred), and AWS Redshift. You will play a critical role in designing, developing, and leading data integration pipelines, ensuring scalability, performance, and business impact. Key Responsibilities Lead the design, development, and deployment of end-to-end ETL and Data War...

Description Fulfillment by Amazon (FBA) enables sellers to scale their businesses globally by leveraging Amazon's world-class fulfillment network. Sellers using FBA benefit from fast, reliable shipping, Prime delivery eligibility, and hassle-free returns-allowing them to focus on growth while we handle operations. The WW FBA Central Analytics team builds and operates scalable, enterprise-grade data infrastructure, tools, and analytics solutions that power WW FBA business. We partner across global product, program, and operations teams to unify diverse datasets, deliver self-service analytics, and develop next-generation capabilities using LLMs to unlock insights. Our charter includes buildin...

This job is with Amazon, an inclusive employer and a member of myGwork the largest global platform for the LGBTQ+ business community. Please do not contact the recruiter directly. Description Fulfillment by Amazon (FBA) enables sellers to scale their businesses globally by leveraging Amazon&aposs world-class fulfillment network. Sellers using FBA benefit from fast, reliable shipping, Prime delivery eligibility, and hassle-free returns-allowing them to focus on growth while we handle operations. The WW FBA Central Analytics team builds and operates scalable, enterprise-grade data infrastructure, tools, and analytics solutions that power WW FBA business. We partner across global product, progr...

Experian is a global data and technology company that powers opportunities for individuals and businesses worldwide. Our unique combination of data, analytics, and software allows us to redefine lending practices, prevent fraud, simplify healthcare, create marketing solutions, and provide deeper insights into the automotive market. With a presence in various markets such as financial services, healthcare, automotive, agribusiness, and insurance, we assist millions of individuals in achieving their financial goals while saving them time and money. As part of our commitment to unlocking the power of data, we are looking for a skilled professional to join our team as a Business Intelligence Dev...

Key Responsibilities: Develop ingestion pipelines (batch & stream) to move data to S3. Convert HiveQL to SparkSQL/PySpark. Orchestrate workflows using MWAA (Airflow). Build and manage Iceberg tables with proper partitioning and metadata. Perform job validation and implement unit testing. Required Skills: 35 years of data engineering experience, with strong AWS expertise. Proficient in EMR (Spark), S3, PySpark, and SQL. Familiar with Cloudera/HDFS and legacy Hadoop pipelines. Knowledge of data lake/lakehouse architectures is a plus.

Key Responsibilities: Develop ingestion pipelines (batch & stream) to move data to S3. Convert HiveQL to SparkSQL/PySpark. Orchestrate workflows using MWAA (Airflow). Build and manage Iceberg tables with proper partitioning and metadata. Perform job validation and implement unit testing. Required Skills: 35 years of data engineering experience, with strong AWS expertise. Proficient in EMR (Spark), S3, PySpark, and SQL. Familiar with Cloudera/HDFS and legacy Hadoop pipelines. Knowledge of data lake/lakehouse architectures is a plus.

Key Responsibilities: Develop ingestion pipelines (batch & stream) to move data to S3. Convert HiveQL to SparkSQL/PySpark. Orchestrate workflows using MWAA (Airflow). Build and manage Iceberg tables with proper partitioning and metadata. Perform job validation and implement unit testing. Required Skills: 35 years of data engineering experience, with strong AWS expertise. Proficient in EMR (Spark), S3, PySpark, and SQL. Familiar with Cloudera/HDFS and legacy Hadoop pipelines. Knowledge of data lake/lakehouse architectures is a plus.

Job Description Develop client-facing standardized reports with Business Intelligence tools such as Tableau. Perform data profiling on source data with minimal documentation. Independently troubleshoot data, perform detail data analyses, and develop complex SQL code. Write secure, stable, testable, and maintainable Python code with minimal defects Perform root cause analysis, propose solutions, and take ownership of the next steps for their resolution Create and maintain report specifications and process documentations as part of the required data deliverables. Writes queries to pull/summarize/analyze data from various data sets and platforms Collaborate with Engineering teams to discover an...

About our team DEX is a central data org for Kotak Bank which manages entire data experience of Kotak Bank. DEX stands for Kotaks Data Exchange. This org comprises of Data Platform, Data Engineering and Data Governance charter. The org sits closely with Analytics org. DEX is primarily working on greenfield project to revamp entire data platform which is on premise solutions to scalable AWS cloud-based platform. The team is being built ground up which provides great opportunities to technology fellows to build things from scratch and build one of the best-in-class data lake house solutions. The primary skills this team should encompass are Software development skills preferably Python for pla...

Job Summary: AWS Developer (Offshore Role) Role Overview: Responsible for migrating and transforming data pipelines from legacy Cloudera/Hadoop systems to AWS-native solutions, using tools like PySpark, MWAA, and EMR. Key Responsibilities: Develop ingestion pipelines (batch & stream) to move data to S3. Convert HiveQL to SparkSQL/PySpark. Orchestrate workflows using MWAA (Airflow). Build and manage Iceberg tables with proper partitioning and metadata. Perform job validation and implement unit testing. Required Skills: 35 years of data engineering experience, with strong AWS expertise. Proficient in EMR (Spark), S3, PySpark, and SQL. Familiar with Cloudera/HDFS and legacy Hadoop pipelines. Kn...