43 Etl Design Jobs

As a Senior Data Engineer, you will be responsible for designing and implementing high-performance data pipelines to ensure the seamless flow of large datasets across systems. Leveraging your expertise in Databricks, Pyspark, and ETL design, you will play a key role in building efficient data solutions. Moreover, you will contribute to optimizing database performance and ensuring that data systems meet scalability and security standards. Key Responsibilities: - Develop, optimize, and maintain scalable ETL pipelines for processing large datasets using Databricks and Pyspark. - Implement advanced techniques such as chunking and partitioning to handle large file volumes efficiently. - Tune and ...

As an Azure Data Engineer at EY, you will be part of a globally connected powerhouse of diverse teams, where you will have the opportunity to shape your future with confidence. EY is a leading global professional services firm that offers a broad range of services in assurance, tax, transaction, and advisory services. Your role will be crucial in contributing to the betterment of the working world by leveraging your expertise in technology and data engineering. **Key Responsibilities:** - Develop and deploy Azure Databricks in a cloud environment using Azure Cloud services. - Design, develop, and deploy ETL processes in Azure Data Factory. - Collaborate with Onshore teams, understand their b...

Role Overview: At Beghou Consulting, we have over three decades of experience assisting life sciences companies in optimizing their commercialization through strategic insight, advanced analytics, and technology. Our mission is to bring together analytical minds and innovative technology to help life sciences companies navigate the complexity of health care and improve patient outcomes. As a Data Management and Analytics Solutions Leader, your key responsibilities include leading the delivery of data management and analytics solutions for clients in the life sciences industry. You will be involved in managing complex, multi-disciplinary projects, fostering strong client relationships, and al...

Role Overview: You will play a crucial role in ensuring the smooth flow of business processes from Candidate to Co-worker by supporting critical business flow and ensuring data accuracy and reliability across integrated systems. Your expertise in Java development, ETL design, and REST APIs will be essential for this role. Key Responsibilities: - Proficient in Java development with a strong understanding of ETL design and implementation - Well-versed in consuming and posting data via REST APIs - Preferred: Working knowledge or experience with SAP SuccessFactors integration - Ability to work independently and collaboratively in an agile environment Qualification Required: - Java Developer with...

Job Title: Data Architect Location: Hyderabad Role Overview Client is seeking an experienced Data Architect to design, build, and govern our enterprise-wide data ecosystem. The ideal candidate will possess deep expertise in enterprise data modeling , Master Data Management (MDM) , and telecom data architectures , enabling a unified, compliant, and scalable data infrastructure. This role is pivotal in shaping the architecture for data lakes , warehouses , and real-time pipelines , ensuring data integrity, governance, and compliance with industry standards such as GDPR and TRAI . Key Responsibilities Lead the architecture, design, and implementation of scalable enterprise data platforms includ...

As a Business Technology Solutions Manager at ZS, you will take ownership of client deliveries at a cross-office level, focusing on digital experience transformation. Your responsibilities will include building and managing client relationships, generating new business engagements, and providing thought leadership in the Digital Area. Key Responsibilities: - Lead the delivery process for 3-4 client engagements, ensuring world-class MDM solutions are delivered - Ensure proposed design/architecture meets client expectations and solves business problems with high quality - Partner with Senior Leadership team for project management responsibilities such as project planning, staffing management, ...

Job Title: Data Engineer Location: Hyderabad Role Overview We are seeking a highly skilled Data Engineer with 510 years of experience to join our dynamic Data Engineering team. The ideal candidate will be responsible for designing, building, and optimizing large-scale data pipelines and warehouses to enable real-time analytics and business intelligence across CPaaS ecosystem . You will work on diverse datasets, including Call Detail Records (CDR) , collaborating closely with cross-functional teams to ensure data reliability, scalability, and performance . Key Responsibilities Design and implement ETL/ELT pipelines for large-scale data processing and analytics. Develop and optimize analytical...

As a Staff or Senior level candidate with experience in Data warehousing and Data Integration using ETL tool Oracle Data Integrator (ODI), Oracle SQL and PL/SQL, you will play a crucial role in helping clients achieve their end goals. **Key Responsibilities:** - Overall 3-15 years of ETL Lead/developer experience with a minimum of 2-3 years experience in Oracle Data Integrator (ODI). - Minimum 2-3 end-to-end Data Warehouse Implementation experience. - Development of ETL processes including ETL control tables, error logging, auditing, and data quality. Implementation of reusability, parameterization, workflow design, etc. - Expertise in Oracle ODI toolset, Oracle PL/SQL, ODI Master, and work ...

As an Assistant Data Analyst at Agraga, you will play a critical role in building and managing reliable data pipelines to support decision-making across the organization. Your strong technical expertise in Python, SQL, and Excel will be essential in handling large and complex datasets to ensure data accuracy and consistency. You will be responsible for collecting, cleaning, and transforming data from multiple sources, creating end-to-end automated pipelines, and delivering accurate reports and dashboards using BI tools like Power BI or Looker. Key Responsibilities: - Collect, clean, validate, and organize data from multiple sources ensuring high data quality and accuracy - Build end-to-end d...

As a Data Analytics Lead (Associate Architect) for our global capital markets client specializing in private markets and alternative investment strategies, you will play a crucial role in driving delivery excellence and data innovation. Your responsibilities will encompass a diverse range of tasks, including but not limited to: - **Leadership & Delivery:** - Lead cross-functional teams comprising data architects, analysts, business SMEs, and engineers. - Ensure high-quality delivery by implementing best practices in data architecture, analytics, and governance. - Cultivate a culture of ownership, accountability, and continuous improvement within the team. - **Strategic & Technical Oversight:...

Role Overview: You will be responsible for ETL design, development, and business system designs. Additionally, you will need to have a good understanding of AWS networking concepts, proficiency in IAM concepts, hands-on experience in various AWS services, and the ability to write clean, modular, testable, and maintainable code. Your role will also involve working with programming languages such as Python, Scala, or Java, willingness to learn Python/PySpark if not already experienced, understanding Spark architecture, execution plans, and performance tuning, strong SQL skills, experience with Redshift and/or Athena, writing and maintaining Terraform scripts, familiarity with Git, GitHub workf...

Role Overview: As a Data Engineer at our company, you will play a crucial role in simplifying our organization by developing innovative data-driven solutions through data pipelines, modeling, and ETL design. Your main goal will be to ensure commercial success while prioritizing customer safety and data security. You will be responsible for driving customer value by solving complex business problems and implementing the most suitable tools to build data solutions. Additionally, you will engage with the data engineering community to deliver opportunities and build a scalable data architecture. Key Responsibilities: - Build advanced automation for data engineering pipelines by eliminating manua...

Key Responsibilities: Define and implement data quality frameworks, validation rules, and monitoring systems. Lead performance & reliability testing for large-scale data systems (lakes, warehouses, streaming). Manage tools like Great Expectations, dbt, JMeter, Grafana, Prometheus. Mentor and guide SDETs in automation and QA. Collaborate with Data/Platform Engineers to embed quality in CI/CD pipelines. Contribute to ETL/ELT pipeline design, optimization, and governance in multi-cloud environments. Required Skills & Qualifications: Bachelors/Masters in CS/IS or related. 12+ years in software engineering, including 5+ in Data Engineering/Quality & 2+ in leadership. Strong in Java, Python, SQL, ...

Position Purpose To help the project by owning the critical data transformation and integration processes. This would help faster and simpler development and maintenance. The profile is someone with excellent Abinitio experience who can quickly adapt and deliver. Responsibilities Direct Responsibilities The Developer will have following responsibilities: Analyse & estimate the requirement. Write detailed technical analysis with impacts (technical/functionally) Design & develop high quality code Unit test and provide support during implementation Bug fixing & performance optimization Contributing Responsibilities Support to Service Delivery team for Production issue. Technical & Behavioral Co...

Role Overview: As a Data Engineer at the leading MNC in the Banking Domain, you will play a crucial role in simplifying the organization by developing innovative data-driven solutions through data pipelines, modeling, and ETL design. Your primary focus will be on driving customer value, ensuring commercial success while prioritizing customer and bank data security. Your responsibilities will involve understanding complex business problems, applying the most appropriate tools to build data solutions, and contributing to the strategic direction by engaging with the data engineering community. Key Responsibilities: - Build advanced automation of data engineering pipelines by eliminating manual ...

As a Senior Power BI/Data Engineer, your role involves designing, implementing, and optimizing robust data models, pipelines, and reporting solutions to meet business objectives. You will collaborate with cross-functional teams, manage data integration processes, develop Power BI dashboards, and ensure data governance and security measures are in place. Additionally, you will mentor junior data engineers and stay updated with emerging data engineering tools and trends. Key Responsibilities: - Design, develop, and implement scalable data models and pipelines to support business objectives. - Collaborate with cross-functional teams to gather requirements and deliver actionable data solutions. ...

Must haves: Hands-on experience SQL development and data warehousing Strong proficiency in SQL Server, SSIS, SSRS, SSAS, and Visual Studio Expertise in ETL design, data integration, data quality assurance, performance tuning and query optimization. Strong oral and written communication skills Relevant experience: 4-6 Years Shift Timings: Australian shift (3 AM-12 PM) Mostly remote with 1-2 days office visit in a month to meet the team Notice period: Below 45 Days Location: Bangalore

Role Overview: As a Media and Marketing Data Engineer at Logitech, you will be a key player in the ongoing development of the Enterprise Data Warehouse (EDW). Your role will involve participating in data loading and extraction from external sources, such as API, Storage buckets (S3, Blob storage), and marketing-specific data integrations. You will be responsible for data analysis, data modeling, and ensuring successful implementation in the production environment. Key Responsibilities: - Design, develop, document, and test ETL solutions using industry-standard tools. - Design physical and reporting data models for seamless cross-functional and cross-systems data reporting. - Enhance point-of...

Role Overview: As an ETL Developer, you will be responsible for designing and developing efficient, scalable SSIS packages to extract, transform, and load data between systems. You will translate business requirements into technical ETL solutions, integrate data from multiple sources, and optimize data movement for high-volume environments. Your role will also involve error handling, testing, deployment, documentation, collaboration with various teams, and ensuring compliance with data governance regulations. Key Responsibilities: - Design and develop efficient, scalable SSIS packages for data extraction, transformation, and loading - Translate business requirements into technical ETL soluti...

As a skilled ETL Developer, you will be responsible for developing and optimizing scalable data pipelines to efficiently extract, transform, and load data from various sources. Leveraging technologies like Spark, Dask, and other modern ETL frameworks, you will play a key role in ensuring the smooth operation of data processes. Your duties will include implementing data quality controls, monitoring processes, and providing mentorship to junior ETL developers. Collaboration with the infrastructure team is vital to ensure the availability, reliability, and scalability of ETL solutions. Additionally, you will participate in code reviews, contribute to coding standards, and stay updated on emergi...

The ideal candidate for this position would have experience with ODI or OBIEE 11g. You should also have experience in using BI reporting tools like Oracle Business Intelligence Enterprise Edition (OBIEE) 12C. Additionally, you should have experience in developing complex reports using various types of views such as Pivot tables, charts, Narrative view, Tree maps, Word Cloud, Scatter, etc., based on the requirements. It is important that you have experience working with the physical, BMM, and Presentation layers of the Repository. You should have experience in configuring Aggregate tables, creating dimension hierarchies, Time series Measures, implementing business logic, and level-based measu...

As an Azure Data Engineer at our organization, you will be an integral part of our dynamic team. Your primary responsibility will be to design, develop, and maintain data pipelines and ETL processes using Azure cloud services. Your expertise in Azure Data Factory, Azure Databricks, and Azure Synapse Analytics will be essential in creating scalable data solutions to ensure data quality and availability across various platforms. Collaboration is key in this role as you will work closely with data scientists, analysts, and business stakeholders to understand data requirements and deliver effective solutions. You will also be tasked with building and optimizing data storage solutions using Azure...

Join us as a Data Engineer. You'll be the voice of our customers, using data to tell their stories and put them at the heart of all decision-making. We will look to you to drive the build of effortless, digital-first customer experiences. If you're ready for a new challenge and want to make a far-reaching impact through your work, this could be the opportunity you're looking for. This role is based in India, and as such, all normal working days must be carried out in India. We're offering this role at vice president level. As a Data Engineer, you'll be looking to simplify our organization by developing innovative data-driven solutions through data pipelines, modeling, and ETL design, aiming ...

For over 30 years, Beghou Consulting has been a trusted adviser to life science firms. We combine our strategic consulting services with proprietary technology to develop custom, data-driven solutions that allow life sciences companies to take their commercial operations to new heights. We are dedicated to client service and offer a full suite of consulting and technology services, all rooted in advanced analytics, to enhance commercial operations and boost sales performance. Your key responsibilities include leading the delivery of data management and analytics solutions for clients in the life sciences industry. You will be involved in managing complex, multi-disciplinary projects, fosteri...

Core Skills Strong hands-on experience with IBM DataStage (ETL tool) parallel, server, and sequence jobs. Proficiency in ETL design, development, and optimization . Strong knowledge of SQL/PLSQL for data extraction, transformation, and loading. Experience with Unix/Linux shell scripting . Knowledge of Data Warehousing concepts (star schema, snowflake schema, slowly changing dimensions, fact/dimension tables). Additional Skills Experience with job scheduling tools (Control-M, Autosys, or equivalent). Exposure to big data platforms (Hadoop, Spark) is a plus. Familiarity with cloud platforms (AWS, Azure, GCP) for ETL migration/implementation. Strong debugging, performance tuning, and error hand...