924 Elt Jobs - Page 2

JD for quick reference: 8+ years of experience in data engineering, BI, or analytics with at least 2+ years of hands-on expertise in Microsoft Fabric. Manage/Enhance the current pipelines, integrations, on-premises SQL Servers and other DBs as needed. Lead the migration and transformation of the existing data ecosystem into Microsoft Fabric including end-to-end data solution design — from ingestion to consumption — ensuring scalability, performance, and security. Build and manage data pipelines, dataflows, and semantic models to ensure seamless data ingestion, transformation, and accessibility. Expertise in data modeling, ETL/ELT pipelines in Fabric’s Lakehouse environment. Optimize data pip...

**Job Description**: **Role Overview**: As a Data Engineer at Deutsche Bank, you will be responsible for developing and delivering engineering solutions to achieve business goals. You will work on medium to large-sized projects with strict deadlines in a cross-application mixed technical environment. Your role will involve collaborating with a geographically dispersed team to build reliability and resiliency into solutions through testing, peer reviews, and automating the delivery life cycle. This position is crucial for the buildout of Compliance tech internal development team in India. **Key Responsibilities**: - Design, develop, and maintain data pipelines using Python and SQL programming...

Role Overview: As a member of the AMA Data Solutions & Engineering Team, you will play a crucial role in managing the company's most valuable asset in the Digital World - Data. Your primary responsibility will be to deliver Data as a competitive advantage for AMA Business by building unified data platforms, customizing BI tools for managers, and enabling insightful business decisions through AI in Data. You will have the opportunity to work with a variety of tools and technologies, including big data platforms, machine learning frameworks, and data visualization tools to create innovative and effective solutions. If you are passionate about data possibilities and eager to make a real impact ...

You will be responsible for leading the data management efforts at our client's R&D team in Kolkata. Your role will involve designing, developing, and deploying data management and storage modules in their product. Additionally, you will oversee data architecture, integration processes, and ensure data quality, performance, and optimal usage of storage technologies. Key Responsibilities: - Drive the design, development, and deployment of data management and storage modules. - Oversee data architecture and integration processes. - Enable real-time and batch ETL and ELT processes for data quality and performance. - Ensure data governance principles and best practices are followed. - Implement ...

As a Consultant & Senior Consultant in our Consulting team, you ll build and nurture positive working relationships with teams and clients with the intention to exceed client expectations. You ll: We are seeking experienced AWS Data Engineers to design, implement, and maintain robust data pipelines and analytics solutions using AWS services. The ideal candidate will have a strong background in AWS data services, big data technologies, and programming languages. Key Responsibilities: 1. Design and implement scalable, high-performance data pipelines using AWS services 2. Develop and optimize ETL processes using AWS Glue, EMR, and Lambda 3. Build and maintain data lakes using S3 and Delta Lake ...

Design, develop, and maintain scalable ETL/ELT data pipelines on GCP (BigQuery, Dataflow, Cloud Composer, Pub/Sub, etc) Build and optimize data models and data marts in BigQuery for analytical and reporting use cases Ensure data quality, integrity, and security across the data lifecycle Implement data transformation logic using SQL, Python, and Cloud Dataflow/Dataproc Collaborate with business and analytics teams to understand data requirements and deliver efficient solutions Automate workflows and orchestrate pipelines using Cloud Composer (Airflow) Monitor and optimize BigQuery performance and manage cost efficiency Support CI/CD deployment processes and maintain version control using Git ...

Role Design, Build & Optimize Scalable Data Solutions and End-to-End Pipelines Responsibilities Develop, and deploy end-to-end data pipelines and solutions on Databricks, integrating with various data sources and systems. Collaborate with cross-functional teams to understand data, and deliver effective BI solutions. Implement data ingestion, transformation, and processing workflows using Spark (PySpark/Scala), SQL, and Databricks notebooks. Develop and maintain data models, ETL/ELT processes ensuring high performance, reliability, scalability and data quality. Build and maintain APIs and data services to support analytics, reporting, and application integration. Ensure data quality, integrit...

Your role and responsibilities As a Quality Engineer/tester work with client and IBM stakeholders to identify various business controls for client and work with respective IBM and client to ensure successful implementation of controls identified. Your primary responsibilities include: Software Tester at AT&T for BGW IOT - Microservices and Databricks; Production Support Analyze test specifications and convert them into Manual/Auto Test Cases. Identify the initial setup, input data, appropriate steps, and the expected response in the manual test cases. Conduct sanity testing of the application based on user requirements. Required education Bachelor's Degree Required technical and professional...

About the Role As a Data Engineer on the Data & Analytics (D&A) team, you will ensure the data powering business decisions is accurate, well-structured, and accessible. Youll work with technologies such as Snowflake, DBT, Power BI, Fivetran, AWS, and Python to deliver clean, reliable, and performant data. Your initial focus will be on building robust data models in Snowflake and semantic models in Power BI, creating the trusted foundation for dashboards and analyses across Quickbase. Over time, you will also contribute to broader data engineering responsibilities including pipeline design, data integration, compute optimization, governance enforcement, and data quality improvements. This rol...

About The Role Project Role : Data Architect Project Role Description : Define the data requirements and structure for the application. Model and design the application data structure, storage and integration. Must have skills : Reltio Good to have skills : NA Minimum 7.5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Architect/MDM Architect is a senior technology leader responsible for designing, building, and overseeing the enterprise's Master Data Management solution. This role is pivotal in establishing a "single source of truth" for critical data domains such as Customer, Product, Vendor, and Employee.You will be the chief t...

We are looking for a skilled Hadoop professional with 7-14 years of experience to join our team in Pune and Hyderabad. The ideal candidate will have expertise in Hadoop, Spark, Kafka, Data Visualization, scripting languages in Python and R, SQL and NoSQL, Agile methodology, ETL / ELT data pipelines. Roles and Responsibility Design and develop scalable Hadoop applications using Spark and Kafka. Create data visualizations using tools like Splunk, Qlik, and Grafana. Develop and maintain ETL/ELT data pipelines using Agile methodology. Collaborate with cross-functional teams to identify and prioritize project requirements. Troubleshoot and resolve technical issues related to Hadoop applications. ...

We are looking for a skilled Data Engineer with 7 to 10 years of experience to join our team in Bangalore, Hyderabad, Chennai, and Pune. The ideal candidate will have expertise in data engineering, Azure cloud, Snowflake, and Snowflake ELT methodologies. Roles and Responsibility Design and develop scalable data pipelines using Azure cloud and Snowflake. Implement ETL processes on Azure and manage data management tasks. Develop automation scripts using Python, Scala, or other languages. Collaborate with cross-functional teams to ensure seamless data integration. Ensure data integrity and accuracy during migration efforts. Optimize data processing workflows for improved efficiency. Job Require...

About The Role Project Role : Application Lead Project Role Description : Lead the effort to design, build and configure applications, acting as the primary point of contact. Must have skills : Microsoft Azure Data Services Good to have skills : NA Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Job Summary :We are seeking a skilled Azure Data Engineer to design, build, and manage scalable data pipelines and integrations within the Microsoft Azure ecosystem. The ideal candidate will have hands-on experience with Azure Data Factory (ADF), Azure Data Lake, and Azure SQL/Synapse, as well as a solid understanding of ETL/ELT processes, data mod...

Role & Responsibilities Role Overview: We are seeking a talented and forward-thinking Data Engineer for one of the large financial services GCC based in Hyderabad with responsibilities that include designing and constructing data pipelines, integrating data from multiple sources, developing scalable data solutions, optimizing data workflows, collaborating with cross-functional teams, implementing data governance practices, and ensuring data security and compliance. Technical Requirements: Proficiency in ETL, Batch, and Streaming Process Experience with BigQuery, Cloud Storage, and CloudSQL Strong programming skills in Python, SQL, and Apache Beam for data processing Understanding of data mod...

6-9+ years of experience on design, develop, and maintain ETL (Extract, Transform, Load) processes using Pentaho Kettle. • Collaborate with Business Analysts and other developers to understand data requirements and translate them into efficient ETL solutions. • Monitor and optimize ETL processes to ensure data accuracy and performance. • Create and maintain data model, ER diagrams, and other documentation. • Troubleshooting and resolving issues related to ETL processes and data integration. • Participate in cross-functional teams to support organizational goals and projects. • Provide software solutions to technically challenging business requirements. • Strong knowledge of data handling, ET...

Overview Design and implement complex ETL/ELT pipelines using PySpark and Airflow for large-scale data processing on GCP.Lead data migration initiatives, including automating the movement of Teradata tables to BigQuery, ensuring data accuracy and consistency. Develop robust frameworks to streamline batch and streaming data ingestion workflows, leveraging Kafka, Dataflow, and NiFi. Collaborate with data scientists to build ML-ready data layers and support analytics solutions. Conduct proof of concepts (POCs) and document performance benchmarking for data throughput and velocity, ensuring optimized data workflows. Enhance CI/CD pipelines using Jenkins and GitLab for efficient deployment and mo...

We are seeking a Consulting Lead-Databricks with strong experience in Databricks, Python, and PySpark, along with hands-on knowledge of Unity Catalog (UC) and Lakehouse architecture. In this role, youll design and optimize large-scale data pipelines, implement robust governance and security through UC, and build scalable solutions in a modern cloud data environment. The ideal candidate must have 5+ years in data engineering, expertise with any one of the cloud platforms (Azure/AWS/GCP), and proven ability to deliver high-performing ETL/ELT pipelines that support business-critical analytics. Qualification Hands-on expertise in Databricks, Python, PySpark, and Delta Lake/Lakehouse architecture...

Role & responsibilities Key Responsibilities Design and implement robust ETL/ELT pipelines using Azure Data Factory, SSIS, and Databricks. Integrate data from diverse sources including on-premises databases, cloud platforms, APIs, and flat files. Develop and optimize data models for Azure SQL Database, Synapse Analytics, and Data Lake Storage Gen2. Architect scalable and secure data storage solutions using Azure Blob Storage and Data Lake. Tune data workflows and clusters for performance, reliability, and cost-efficiency. Monitor and troubleshoot data pipelines using Azure Monitor and Log Analytics. Work closely with business teams to understand data requirements. Translate business needs in...

Role 1: Snowflake_ETL_DataEngineer Role 2: SQL, ETL, Snowflake Role 3: snowflake with dbt

What will your role look like As a Senior Data Engineer, you will architect, build, and maintain scalable data pipelines for both batch and real-time processing. Youll be hands-on with Python, SQL, and modern data tools to ensure data is reliable, consistent, and accessible across the business. You will partner closely with analysts, scientists, and engineers to transform raw data into actionable insights, while optimizing performance and ensuring smooth production operations. Why you will love this role Youll have the opportunity to own end-to-end data engineering solutions that directly impact decision-making and innovation across the company Youll work with a modern data stack (Airflow, F...

Key Responsibilities Design, develop, and maintain Python-based data processing pipelines for on-prem and file-based systems. Work with large structured and unstructured datasets for data ingestion, transformation, and validation. Implement and optimize ETL/ELT processes, ensuring data quality, consistency, and performance. Collaborate with cross-functional teams to design end-to-end data solutions, including integration with cloud and on-premise environments. Leverage AWS services (such as S3, Lambda, Glue, Step Functions, or EC2) for data processing and automation. Participate in solution design discussions and contribute to architectural decisions. Monitor, troubleshoot, and improve exist...

Seeking an Azure Data Engineer to build & optimize ETL/ELT pipelines using ADF, Azure SQL/Synapse, ADLS & Blob.Responsibilities include data modeling, SQL tuning, data validation,and delivering clean,scalable datasets for analytics.DP-203 preferred. Health insurance Provident fund

Experian UK&I Business information division is looking for an accomplished Senior Data Engineer to join our dynamic team. You will develop data engineering applications and scalable data platforms. You will collaborate closely with teams to implement solutions that create value. Key Responsibilities: Design, build, and maintain scalable, cloud-native data pipelines using AWS. Develop ETL/ELT workflows using Glue, Pyspark , and Python Improve data modeling, partitioning, and querying strategies Experience reading and developing Terraform-based infrastructure code Qualifications Bachelor's degree in computer science, Engineering 5 to 7 years of experience in data engineering. Strong expertise ...

About the Role - We are seeking a highly skilled and experienced Senior Azure Databricks Engineer to join our dynamic data engineering team. - As a Senior Azure Databricks Engineer, you will play a critical role in designing, developing, and implementing data solutions on the Azure Databricks platform. - You will be responsible for building and maintaining high-performance data pipelines, transforming raw data into valuable insights, and ensuring data quality and reliability. Key Responsibilities - Design, develop, and implement data pipelines and ETL/ELT processes using Azure Databricks. - Develop and optimize Spark applications using Scala or Python for data ingestion, transformation, and ...

About The Role Project Role : Application Lead Project Role Description : Lead the effort to design, build and configure applications, acting as the primary point of contact. Must have skills : Microsoft Fabric Good to have skills : NA Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Job Title:Microsoft Fabric Data EngineerExperience:8+ years (including 3+ years hands-on experience with Microsoft Fabric)Job Summary We are looking for a skilled Microsoft Fabric Data Engineer with strong experience in designing and implementing scalable data solutions. The role requires expertise in Microsoft Fabric along with a solid background in modern dat...