10 Etl Pipeline Jobs

Role Overview: You will be responsible for designing, building, and maintaining robust data models and pipelines using Azure Synapse and MS SQL to support analytics, reporting, and performance needs. Your role will involve implementing scalable ingestion frameworks for structured and unstructured data into the data warehouse (DWH), ensuring data integrity and consistency. Additionally, you will use Python for data processing, automation, and analytics, following best practices for maintainability and performance. Managing tasks and progress using Jira will be crucial to ensure timely delivery of high-quality, production-ready data solutions aligned with business goals. Collaboration with sta...

lululemon is an innovative performance apparel company dedicated to supporting individuals in their yoga, running, training, and other athletic pursuits. With a focus on technical fabrics and functional design, we aim to create transformational products and experiences that encourage movement, growth, connection, and overall well-being. Our success is attributed to our groundbreaking products, our commitment to our team members, and the strong connections we establish within every community we engage with. As a company, we are dedicated to fostering positive change and building a healthier, thriving future. Central to this mission is the establishment of an equitable, inclusive, and growth-o...

Profile Description Were seeking someone to join our team as (Associate) who will work as a hands-on Data Base & Pyspark Developer within the AIDT Data & Services RWMS Squad. This position is focused on delivering tactical and strategic solutions to support the Squad for analysis, processing, and reporting. WM_Technology Wealth Management Technology is responsible for the design, development, delivery, and support of the technical solutions behind the products and services used by the Morgan Stanley Wealth Management Business. Practice areas include: Analytics, Intelligence, & Data Technology (AIDT), Client Platforms, Core Technology Services (CTS), Financial Advisor Platforms, Global Bankin...

You should have a minimum of 6 years of experience as an ETL Pentaho Developer. Candidates with exposure to the latest versions like 7/8 are preferred. Your data analysis skills should be excellent, and you should have a good amount of experience with the Pentaho BI Suite, including Pentaho Data Integration Designer / Kettle, Pentaho Report Designer, Pentaho Design Studio, Pentaho Enterprise Console, Pentaho BI Server, Pentaho Metadata, Pentaho Analysis View, Pentaho Analyser & Mondrian. You should also have experience in performing Data Masking/Protection using Pentaho Data Integration. Your responsibilities will include creating ETL pipelines, which involves extraction, transformation, mer...

You will be responsible for performing comprehensive testing of ETL pipelines to ensure data accuracy and completeness across different systems. This includes validating Data Warehouse objects such as fact and dimension tables, designing and executing test cases and test plans for data extraction, transformation, and loading processes, as well as conducting regression testing to validate enhancements with no breakage of existing data flows. You will also work with SQL to write complex queries for data verification and backend testing, and test data processing workflows in Azure Data Factory and Databricks environments. Collaboration with developers, data engineers, and business analysts to u...

The ideal candidate for this position should have advanced proficiency in Python, with a solid understanding of inheritance and classes. Additionally, the candidate should be well-versed in EMR, Athena, Redshift, AWS Glue, IAM roles, CloudFormation (CFT is optional), Apache Airflow, Git, SQL, Py-Spark, Open Metadata, and Data Lakehouse. Experience with metadata management is highly desirable, particularly with AWS Services such as S3. The candidate should possess the following key skills: - Creation of ETL Pipelines - Deploying code in EMR - Querying in Athena - Creating Airflow Dags for scheduling ETL pipelines - Knowledge of AWS Lambda and ability to create Lambda functions This role is fo...

Designing and developing custom SharePoint solutions based on business requirements. Creating and configuring SharePoint sites, lists, libraries, workflows, and web parts. Developing custom forms and templates using InfoPath and SharePoint Designer. Providing technical support for SharePoint users. Developing and implementing SharePoint security and access controls. Monitoring SharePoint performance and troubleshooting issues. Collaborating with other developers and stakeholders to ensure solutions meet business needs. Excellent knowledge of understanding organization structures and business operations and accordingly designing a SharePoint implementation Experience on SharePoint Online Expe...

Job Title - Technical Project Manager Location - Gurgaon/ Bangalore Nature of Job - Permanent Department - data analytics What you will be doing Demonstrated client servicing and business analytics skills with at least 5 - 9 years of experience as data engineer, BI developer, data analyst, technical project manager, program manager etc. Technical project management- drive BRD, project scope, resource allocation, team coordination, stakeholder communication, UAT, Prod fix, change requests, project governance Sound knowledge of banking industry (payments, retail operations, fraud etc.) Strong ETL experience or experienced Teradata developer Managing team of business analysts, BI developers, ET...

Role - Python Developer + SQL Experience - 5+ Years Location - Chennai (DLF) Hybrid work from office Shift timings - 6 pm - 3 am Must-Have Skills: Strong Python programming skills Very strong SQL skills Experience in ETL/ELT development Knowledge of relational databases Ability to work independently and communicate effectively Good-to-Have: Knowledge of data quality frameworks and testing strategies Experience with version control systems like Git Familiarity with CI/CD pipelines for data engineering

Designing and implementing scalable and resilient data architectures for both batch and streaming data processing. Developing data models and database structures. Ensuring data security, integrity, and compliance with relevant regulations. Required Candidate profile Experience in Hadoop, Spark, NoSQL databases. Cloud exposure: AWS, Azure, GCP. Coding skills in Python, Java, Scala, and Spark frameworks. Hands-on with ETL tools and building data pipelines.