988 Etl Development Jobs - Page 6

Job Title: PySpark Data Engineer Summary: We are seeking a skilled PySpark Data Engineer to join our team and drive the development of robust data processing and transformation solutions within our data platform. You will be responsible for designing, implementing, and maintaining PySpark-based applications to handle complex data processing tasks, ensure data quality, and integrate with diverse data sources. The ideal candidate possesses strong PySpark development skills, experience with big data technologies, and the ability to work in a fast-paced, data-driven environment. Key Responsibilities: Data Engineering Development: Design, develop, and test PySpark-based applications to process, t...

Skill: AWS Glue Experience: 6 to 9 years Location: Kolkata Job description Technical Skills : AWS Glue: 3+ years of hands-on experience in AWS Glue ETL development Python/PySpark: Strong programming skills in Python and PySpark for data transformation AWS Services: Proficiency in S3, Redshift, Athena, Lambda, and EMR Data Formats: Experience with Parquet, Avro, JSON, CSV, and ORC file formats SQL: Advanced SQL skills for data querying and transformation ETL Concepts: Deep understanding of ETL/ELT design patterns and best practices Data Modeling: Knowledge of dimensional modeling, star/snowflake schemas Version Control: Experience with Git/Bitbucket for code management Preferred Skills: Exper...

Abinitio Developer 4+ years Up to 15LPA Trivandrum, Chennai AbInitio,Java,Gde,Unix Immediate to 30 days

Role & Responsibilities Design, build, and maintain data solutions and ETL pipelines using Databricks and Azure Data Factory . Develop and optimize data architectures, data models, and workflows supporting analytics and BI platforms. Implement data quality, validation, and monitoring processes to ensure reliable and accurate data delivery. Collaborate with business, analytics, and product teams to translate requirements into effective data solutions. Provide technical leadership and support throughout the full data lifecycle, from development to production operations. Preferred Candidate Profile 1215 years of experience with strong hands-on expertise in Databricks and Azure Data Factory . Pr...

o 8 years of experience and strong in Power BI Development, strong in SQL, Data Modelling . Banking experience

As an ETL Spark Developer, your primary responsibility will be developing ETL flow from source to Data Lake using Pentaho and Spark. You will also engage with the client to understand their requirements and write complex SQL statements. Key Responsibilities: - Develop ETL flow from source to Data Lake using Pentaho and Spark - Engage with the client to understand their requirements - Write complex SQL statements Qualifications Required: - Bachelor's degree in Computer Science or related field - 3 to 5 years of experience in ETL development - Knowledge of Data warehouse concepts - Proficiency in SQL and PL/SQL Kindly note that the company's single point of contact for this position is the Hum...

Project description We are seeking an expert with deep proficiency as a Platform Engineer, possessing experience in data engineering. This individual should have a comprehensive understanding of both data platforms and software engineering, enabling them to integrate the platform effectively within an IT ecosystem. Responsibilities Manage and optimize data platforms (Databricks, Palantir). Ensure high availability, security, and performance of data systems. Provide valuable insights about data platform usage. Optimize computing and storage for large-scale data processing. Design and maintain system libraries (Python) used in ETL pipelines and platform governance. Optimize ETL Processes Enhan...

About The Role Project Role : Data Management Practitioner Project Role Description : Maintain the quality and compliance of an organizations data assets. Design and implement data strategies, ensuring data integrity and enforcing governance policies. Establish protocols to handle data, safeguard sensitive information, and optimize data usage within the organization. Design and advise on data quality rules and set up effective data compliance policies. Must have skills : Data Architecture Principles Good to have skills : NA Minimum 12 year(s) of experience is required Educational Qualification : any graduate Summary :As a Data Management Practitioner, you will be responsible for maintaining ...

About The Role The role plays a key role in designing and maintaining data models that align with the organization's business requirements, enhance data quality, and facilitate efficient data processing and analysis. About The Role - Grade Specific The role involves providing strategic leadership, overseeing data modeling activities, ensuring data modeling governance and compliance, collaborating with stakeholders, and driving continuous improvement in data modeling practices. They play a critical role in shaping the organization's data architecture, promoting data quality, and supporting effective data management and decision-making processes. Skills (competencies)

About The Role Project Role : Data Platform Engineer Project Role Description : Assists with the data platform blueprint and design, encompassing the relevant data platform components. Collaborates with the Integration Architects and Data Architects to ensure cohesive integration between systems and data models. Must have skills : Data Modeling Techniques and Methodologies Good to have skills : NA Minimum 7.5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Platform Engineer, you will assist with the data platform blueprint and design, encompassing the relevant data platform components. Your typical day will involve collaborating w...

About The Role Project Role : Data Platform Engineer Project Role Description : Assists with the data platform blueprint and design, encompassing the relevant data platform components. Collaborates with the Integration Architects and Data Architects to ensure cohesive integration between systems and data models. Must have skills : Python (Programming Language) Good to have skills : NA Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Platform Engineer, you will assist with the data platform blueprint and design, encompassing the relevant data platform components. Your typical day will involve collaborating with Integration...

About The Role Skill required: Data Management - AWS Architecture Designation: Data Eng, Mgmt & Governance Analyst Qualifications: BE/BTech Years of Experience: 3 to 5 years What would you do? Data & AIIn this role, you will be responsible for designing, developing, implementing, and managing distributed applications and systems on the AWS platform. You will be responsible for ETL development, data analysis, technical design, and testing on AWS environment. What are we looking for? AWS Snowflake (Platform) Adaptable and flexible Strong analytical skills Written and verbal communication Agility for quick learning Ability to work well in a team Roles and Responsibilities: In this role you are ...

Software Engineer (COE Retail - India) Job Description: Hands-on technical role to support US, India and Canada based engineering and audit teams through client data conversion and the development, delivery and support of audit tools, audit data and reports. Ideal candidate combines experience with Microsoft Access application development (VBA), project management, handling of very large datasets (preferably SQL server) and business understanding to mine data and automate workflows focused on identifying anomalies and errors in our clients business transactions whilst possessing excellent written and verbal communication skills. Essential Functions: Perform complex data mining, forensic anal...

7+ years of experience in ETL development and data engineering. Snowflake and SQL (advanced query optimization, stored procedures, data modeling), experience in ETL tools , understanding of data warehousing concepts and data integration frameworks .

Required Skills and Experience: 3- 8 years of Experience of Database Technologies: Strong proficiency in Snowflake and SQL Server. Core Languages: Advanced SQL skills for data querying and manipulation, along with solid programming skills in Python for data processing and automation. Version Control: Demonstrable experience with Git and GitHub for code management and collaboration. Data Fundamentals: Solid understanding of data warehousing concepts, data modeling, and ETL/ELT development processes. Problem-Solving: Ability to analyze complex data-related issues and develop effective solutions. CI/CD: Familiarity with Continuous Integration/Continuous Deployment (CI/CD) pipelines and practice...

In This Role, Youll Get To Develop, test, and maintain robust ETL processes to extract, transform, and load data from various sources into data warehouses Participate in design and code reviews to ensure high-quality deliverables Provide insights and recommendations based on data What Youll Need To Succeed 4+ years of experience as a ETL Developer or Data Engineer, with demonstrated ability to apply strong logical thinking and problem-solving skills to real-world data challenges Advanced proficiency in Python, with a strong ability to write clean, efficient, and logical code Knowledge of data warehousing concepts and data modeling Advanced SQL skills, including the ability to write complex q...

As a Lead - Data Engineering at Lera Technologies, you will play a crucial role in driving data-driven transformation for key client engagements. Here is a breakdown of what you can expect in this role: Role Overview: You will be responsible for owning the data strategy, architecture, and engineering roadmap for key client engagements. Your main duties will include: - Leading the design and development of scalable, secure, and high-performance data pipelines, marts, and warehouses - Mentoring a team of data engineers and collaborating with BI/reporting teams and solution architects - Overseeing data ingestion, transformation, consolidation, and validation across cloud and hybrid environments...

The CDP ETL & Database Engineer will specialize in architecting, designing, and implementing solutions that are sustainable and scalable. The ideal candidate will understand CRM methodologies, with an analytical mindset, and a background in relational modeling in a Hybrid architecture. The candidate will help drive the business towards specific technical initiatives and will work closely with the Solutions Management, Delivery, and Product Engineering teams. The candidate will join a team of developers across the US, India & Costa Rica. Responsibilities: ETL Development The CDP ETL C Database Engineer will be responsible for building pipelines to feed downstream data They will be able to ana...

SUMMARY Job Summary We are seeking an experienced Ab Initio Developer to join our team in Pune. As an Application Developer, you will play a key role in designing, building, and configuring applications to meet business process and application requirements. With a strong focus on collaboration, problem-solving, and knowledge sharing, you will contribute to the overall success of our projects by leveraging your expertise in application development. Location: Pune Experience: 6+ years Responsibilities Collaborate with team members to understand project needs and develop application features Ensure that solutions align with business objectives and are delivered on time Engage in problem-solving...

The CDP ETL & Database Engineer will specialize in architecting, designing, and implementing solutions that are sustainable and scalable. The ideal candidate will understand CRM methodologies, with an analytical mindset, and a background in relational modeling in a Hybrid architecture. The candidate will help drive the business towards specific technical initiatives and will work closely with the Solutions Management, Delivery, and Product Engineering teams. The candidate will join a team of developers across the US, India & Costa Rica. Responsibilities : ETL Development The CDP ETL C Database Engineer will be responsible for building pipelines to feed downstream data They will be able to an...

The CDP ETL & Database Engineer will specialize in architecting, designing, and implementing solutions that are sustainable and scalable. The ideal candidate will understand CRM methodologies, with an analytical mindset, and a background in relational modeling in a Hybrid architecture.The candidate will help drive the business towards specific technical initiatives and will work closely with the Solutions Management, Delivery, and Product Engineering teams. The candidate will join a team of developers across the US, India & Costa Rica. Responsibilities : ETL Development The CDP ETL C Database Engineer will be responsible for building pipelines to feed downstream data They will be able to ana...

As a Specialist Data Engineer at Colgate-Palmolive, you will be a key member of the Global Information Technology organization. Your role will involve managing and developing solutions for data repositories, pipelines, and analytical tools to deliver actionable insights for the business partners. You will play a lead role in technology deployments and be responsible for the evolution of technology across the global footprint. **Key Responsibilities:** - Excitedly demonstrate technology to solve complex data problems - Build data applications on the Google Cloud Platform and integrate with various data sources/tools - Design, develop, and maintain a world-class data warehouse and analytics ar...

Role Overview: As a Freelance Data Engineer at ThreatXIntel, your main responsibilities will include designing, developing, and maintaining ETL/ELT pipelines using Java and Pyspark. You will be tasked with building and optimizing data processing workflows on Databricks and Azure cloud platforms. Additionally, you will design SQL queries for data extraction, transformation, and analysis, and deploy containerized workloads using Kubernetes. Collaborating with teams to integrate data pipelines with Power BI dashboards and utilizing Git for version control and CI/CD best practices will be crucial aspects of your role. You will also be responsible for monitoring and troubleshooting production dat...

Req ID: 342228 We are currently seeking a ETL HVR Developer to join our team in Chennai, Tamil Ndu (IN-TN), India (IN). 5+ years of hands-on experience with HVR Design and manage real-time data replication pipelines using HVR Integrate diverse sources (ERP, Salesforce, databases) into cloud platforms (Snowflake, Azure). Monitor replication jobs and resolve latency or performance issues. Hands on in Connector monitoring, sync failure resolution, data consistency validation, Data consistency monitoring, quality validation procedures and exception handling Experience in Channel health monitoring, replication lag resolution, connectivity management, Performance analysis, resource scaling and thr...

The Solution Architect Data Engineer will design, implement, and manage data solutions for the insurance business, leveraging expertise in Cognos, DB2, Azure Databricks, ETL processes, and SQL. The role involves working with cross-functional teams to design scalable data architectures and enable advanced analytics and reporting, supporting the company's finance, underwriting, claims, and customer service operations. Key Responsibilities: Data Architecture & Design: Design and implement robust, scalable data architectures and solutions in the insurance domain using Azure Databricks, DB2, and other data platforms Data Integration & ETL Processes: Lead the development and optimization of ETL pi...