668 Elt Jobs

Technical Skill set: Having 3-5 years of experience in implementing Big Data solution in Cloud environments. Hands-on in implenting Big data solution using Airflow DAG,Spark,Python,Hive,Trino,S3 Bucket,etc Having experience Cloud Data platform like SnowFlake , Databricks is a plus. Knowledge of Financial domain-Credit Card industry is a plus. Responsibilites: Creating an ELT Data pipelines using python script and Airflow DAG. Optimizing the Data pipelines by configuring the Spark system resources Debug an existing Microsoft BI ETLs and understand business logic and convert in to big data pipeline using Airflow DAG. Able to interact with business partners to understand the requirements and pr...

The Value You Deliver The associate would help the team in designing and building a best-in-class data solutions using very diversified tech stack. Strong experience of working in large teams and proven technical leadership capabilities Knowledge of Enterprise level implementations like Data warehouse, Automated solutions. Ability to negotiate, influence and work with business peers and management. Ability to develop and drive a strategy as per the needs of the team Good to have: Programming knowledge. The Skills that are Key to this role Technical / Behavioural Bachelor's degree in computer science or equivalent technology field. 7+ years experience, preferable within financial services and...

Job Description: 8+ Yrs total experience in IT/Data Engineering projects & 5+ years of relevant experience- Strong coding skills in - Python, SQL, ADF, Databricks (PySpark, Delta live table, Live/structural data streaming, Unity Catalog, Performance Tuning of DLT pipelines with high volume of data processing , Cost Optimization of Databricks when DLT runs in live streaming on Photon, Serverless, non serverless)The candidate should be responsible, take ownership, self driven, dedication to achieve timeline. Should have great problem solving and analytical/reasoning capability,Technical skill with good mindset and behaviour is important good hands-on programming / scripting knowledge in Python...

Position Responsibilities: Contribute to the design, build, and upkeep of data architectures in standard databases and data warehouses Translate stakeholder requirements into data models for acquisition and implementation Write Python code for ETL/ELT tasks, data validation, and automation Build and operate simple, repeatable data pipelines across multi- and hybrid-cloud environments Develop and support basic data access APIs to enable reliable data consumption Prepare curated datasets and features to support data scientists analysis and modeling Create collection frameworks for structured and unstructured data; address low-complexity data issues Implement data quality checks, monitoring, an...

Role Proficiency: Act creatively to develop applications and select appropriate technical options optimizing application development maintenance and performance by employing design patterns and reusing proven solutions account for others' developmental activities Outcomes: Interpret the application/feature/component design to develop the same in accordance with specifications. Code debug test document and communicate product/component/feature development stages. Validate results with user representatives; integrates and commissions the overall solution Select appropriate technical options for development such as reusing improving or reconfiguration of existing components or creating own solu...

Role & responsibilities Job Description Analytics Engineer (Looker + BigQuery) Location: India ( Remote ) Experience Required: Minimum 5 years About the Role We are looking for a highly skilled Analytics Engineer/ Data Analyst / BI Developer with deep expertise in Looker and Google BigQuery to join our growing data team. This role will play a key part in designing scalable data models, building efficient SQL queries, and creating impactful dashboards and reporting solutions. You will collaborate closely with business and product teams to deliver analytics that drive informed decision-making across the organization. Key Responsibilities Design, develop, and maintain LookML models in Looker to...

Languages: Proficiency in Python, Shell, and Perl Cloud Expertise: Hands-on experience with AWS (S3, Lambda, Glue, EC2, RDS, etc) Data & ETL: Strong background in ETL/ELT processes, data modeling, and performance tuning Call/whatsapp on 9350514090 Required Candidate profile Database: Deep understanding of PL/SQL and relational database systems. Monitoring & Observability: Practical experience with Datadog API Development Version Control & CI/CD: Experience with gitlab

Your Role IT experience with a minimum of 5+ years of experience in creating data warehouses, data lakes, ETL/ELT, data pipelines on cloud. Has data pipeline implementation experience with any of these cloud providers - AWS, Azure, GCP. preferably - Life Sciences Domain Experience with cloud storage, cloud database, cloud Data ware housing and Data Lake solutions like Snowflake, Big query, AWS Redshift, ADLS, S3. Experience with cloud storage, cloud database, cloud Data ware housing and Data Lake solutions like Snowflake, Big query, AWS Redshift, ADLS, S3. Experience in using cloud data integration services for structured, semi structured and unstructured data such as Azure Databricks, Azure...

Job Summary We are seeking a skilled Azure Data Engineer with 4 years of overall experience , including at least 2 years of hands-on experience with Azure Databricks (Must) . The ideal candidate will have strong expertise in building and maintaining scalable data pipelines and working across cloud-based data platforms. Key Responsibilities Design, develop, and optimize large-scale data pipelines using Azure Data Factory, Azure Databricks, and Azure Synapse. Implement data lake solutions and work with structured and unstructured datasets in Azure Data Lake Storage (ADLS). Collaborate with data scientists, analysts, and engineering teams to design and deliver end-to-end data solutions. Develop...

Job Summary We are seeking a skilled Azure Data Engineer with 4 years of overall experience , including at least 2 years of hands-on experience with Azure Databricks (Must) . The ideal candidate will have strong expertise in building and maintaining scalable data pipelines and working across cloud-based data platforms. Key Responsibilities Design, develop, and optimize large-scale data pipelines using Azure Data Factory, Azure Databricks, and Azure Synapse. Implement data lake solutions and work with structured and unstructured datasets in Azure Data Lake Storage (ADLS). Collaborate with data scientists, analysts, and engineering teams to design and deliver end-to-end data solutions. Develop...

Key Skills & Competencies Advanced SQL development (joins, CTEs, window functions, optimization) Experience with ETL/ELT processes and tools Data modeling (dimensional and normalized Familiarity with version control (e.g., Git) and CI/CD practices Understanding of DWH architectures and data integration patterns Ability to work with large datasets and performance-tune queries Platform-agnostic mindset with readiness to adapt to Azure or AWS

Job Summary As a Microsoft Fabric Data Engineer/Developer, you will play a vital role in designing, developing, and implementing robust and scalable data solutions within the Microsoft Fabric ecosystem. You will collaborate closely with data architects, business stakeholders, and cross-functional teams to transform raw data into actionable insights, driving informed decision-making across the organization. If you are passionate about data engineering, possess a strong technical background, and excel in collaborative environments, we invite you to join our growing data team. Career Level - IC2 Responsibilities Microsoft Fabric Development : Design, develop, and deploy end-to-end data solution...

We are currently seeking a Digital Solution Architect Sr. Advisor to join our team in Bengaluru, India, Karntaka (IN-KA), India (IN). Key Responsibilities: Design data platform architectures (data lakes, lakehouses, DWH) using modern cloud-native tools (e.g., Databricks, Snowflake, BigQuery, Synapse, Redshift). Architect data ingestion, transformation, and consumption pipelines using batch and streaming methods. Enable real-time analytics and machine learning through scalable and modular data frameworks. Define data governance models, metadata management, lineage tracking, and access controls. Collaborate with AI/ML, application, and business teams to identify high-impact use cases and optim...

Primary skills:ETL/ELT pipelines using DBT and AWS Redshift. Secondary skills :Proficiency in SQL and scripting languages like Python or Shell

Position Overview: The Microsoft Cloud Data Engineer role is ideal for a highly capable and motivated Microsoft Cloud Data Engineer to design, build, and maintain cloud-based data solutions using Microsoft Azure technologies. This role is key for developing robust, scalable, and secure data pipelines and supporting analytics workloads that power business insights and data-driven decision-making. Key Responsibilities: Design and implement ETL/ELT pipelines using Azure Data Factory, Azure Synapse Analytics, Azure Databricks, and Azure Data Lake Storage. Develop and manage data integration workflows to ingest data from multiple sources including APIs, on-prem systems, and cloud services. Optimi...

Position Overview: The Databricks Data Engineer role is ideal for a skilled and motivated Databricks Data Engineer to design, build, and optimize data pipelines and analytics solutions on the Databricks Lakehouse Platform. This role is ideal for candidates who have experience with big data technologies and a passion for building robust data systems. Key Responsibilities: Develop and maintain scalable data pipelines using Databricks and Apache Spark (primarily with PySpark). Build and manage Delta Lake tables and optimize them for analytics and machine learning workloads. Integrate data from diverse sources including APIs, cloud storage, databases, and streaming platforms like Kafka. Transfor...

Introduction to the Role: Are you passionate about unlocking the power of data to drive innovation and transform business outcomes? Join our cutting-edge Data Engineering team and be a key player in delivering scalable, secure, and high-performing data solutions across the enterprise. As aData Engineer, you will play a central role in designing and developing modern data pipelines and platforms that support data-driven decision-making and AI-powered products. With a focus onPython,SQL,AWS,PySpark, andDatabricks, you'll enable the transformation of raw data into valuable insights by applying engineering best practices in a cloud-first environment. We are looking for a highly motivated profess...

Skills - Snowflake, Apache Airflow, Terraform , DBT, Git, SQL, Spark and Python , Data Warehousing, CIi/CD Pipelines Key Responsibilities: Design, implement, and optimize data pipelines and workflows using Apache Airflow Develop incremental and full-load strategies with monitoring, retries, and logging Build scalable data models and transformations in dbt, ensuring modularity, documentation, and test coverage Develop and maintain data warehouses in Snowflake Ensure data quality, integrity, and reliability through validation frameworks and automated testing Tune performance through clustering keys, warehouse scaling, materialized views, and query optimization. Monitor job performance and reso...

About The Role Project Role : Cloud Platform Engineer Project Role Description : Designs, builds, tests, and deploys cloud application solutions that integrate cloud and non-cloud infrastructure. Can deploy infrastructure and platform environments, creates a proof of architecture to test architecture viability, security and performance. Must have skills : AWS Analytics Good to have skills : NA Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Cloud Platform Engineer, you will engage in the design, construction, testing, and deployment of cloud application solutions that seamlessly integrate both cloud and non-cloud infrastructu...

Role Description: As a Data Engineering Lead, you will play a crucial role in overseeing the design, development, and maintenance of our organization's data architecture and infrastructure. You will be responsible for designing and developing the architecture for the data platform that ensures the efficient and effective processing of large volumes of data, enabling the business to make informed decisions based on reliable and high-quality data. The ideal candidate will have a strong background in data engineering, excellent leadership skills, and a proven track record of successfully managing complex data projects. Responsibilities: Data Architecture and Design: - Design and implement scala...

As a Data Engineer at our company, your role will involve building large scale, highly available, fault-tolerant data analytics platforms & data pipelines that support advanced analytics like modeling and machine learning. You will work in a fully agile environment, ensuring timely delivery with high quality. Collaboration with business and data science teams is key to designing and developing products. You will independently own components, review design documents, provide design guidance, and champion data engineering best practices. Key Responsibilities: - Build large scale, fault-tolerant data analytics platforms & data pipelines - Work in an agile environment to deliver high-quality res...

Role Overview: In this role at Kimberly-Clark, you will play a pivotal part in designing and building analytics solutions to facilitate informed decision-making. Your primary responsibility will be to design, develop, and maintain analytics solutions working closely with various R&D and DTS technology teams. By leveraging your professional expertise and talent, you will contribute to delivering better care for billions of people worldwide. Key Responsibilities: - Collaborate with engineering and architecture teams to identify, collect, and harmonize data from various sources. - Design and develop ETL (Extract, Transform, Load) and ELT (Extract, Load, Transform) pipelines using technologies s...

Job description Develop EL/ELT/ETL pipelines to make data available in BigQuery analytical data store from disparate batch, streaming data sources for the Business Intelligence and Analytics teams. • Hands on experience in Pyspark needed - Data Engineer role. • Work with on-prem data sources (Hadoop, SQL Server), understand the data model, business rules behind the data and build data pipelines (with GCP, Informatica) for one or more business verticals. This data will be landed in GCP Big Query. • Build cloud-native services and APIs to support and expose data-driven solutions. • Partner closely with our data scientists to ensure the right data is made available in a timely manner to deliver...

SUMMARY Job Role: Senior Database Engineer Location: Hyderabad Start Date: As soon as possible Key Responsibilities: Build data pipelines for optimal extraction, transformation, and loading from various data sources using SQL and cloud database technologies. Work with stakeholders (Executive, Product, Data, Design teams) to support data-related technical issues. Collaborate with data and analytics experts to enhance data system functionality. Assemble large, complex data sets meeting business requirements. Analyze and improve existing SQL code for performance, security, and maintainability. Design and implement internal process improvements (automation, scalability). Unit test databases and ...

SUMMARY About the Role We are seeking a highly skilled and experienced Hands-on Palantir Architect to join our dynamic team. In this pivotal role, you will be responsible for the end-to-end design, development, and implementation of complex data solutions on the Palantir platform. The ideal candidate is not only a seasoned architect but also a proficient developer who can dive deep into code, build robust data pipelines, and create powerful applications that deliver critical insights. Key Responsibilities Architect and Design: Lead the technical design and architecture of solutions on the Palantir platform, ensuring scalability, performance, and security. Hands-on Development: Actively parti...