924 Elt Jobs - Page 11

Primary Responsibilities: Support the full data engineering lifecycle including research, proof of concepts, design, development, testing, deployment, and maintenance of data management solutions Utilize knowledge of various data management technologies to drive data engineering projects Lead data acquisition efforts to gather data from various structured or semi-structured source systems of record to hydrate client data warehouse and power analytics across numerous health care domains Leverage combination of ETL/ELT methodologies to pull complex relational and dimensional data to support loading DataMarts and reporting aggregates Eliminate unwarranted complexity and unneeded interdependenci...

7+ years of experience in data engineering or equivalent technical role. 5+ years of hands-on experience with AWS Cloud Development and DevOps. Strong expertise in SQL , data modeling , and ETL/ELT pipelines . Deep experience with Oracle (PL/SQL, performance tuning, data extraction). Proficiency in Python and/or Scala for data processing tasks. Strong knowledge of cloud infrastructure (networking, security, cost optimization). Experience with infrastructure as code (Terraform). Familiarity with CI/CD pipelines and DevOps tooling (e.g., Jenkins, GitHub Actions). Roles and Responsibilities Data Engineering & Architecture Design, build, and maintain scalable data pipelines and data products. De...

Project description Our client is a leading global Financial markets data provider runs a number of change programs to deliver of high-quality software that connects Financial Markets across the globe in a real-time, high frequency and low-latency data management chain. The projects are technically challenging in a very engaging environment making the most of cutting-edge technologies. Responsibilities Design, build, and maintain scalable ETL/ELT data pipelines to support analytics, reporting, and machine learning use cases. Develop and optimize data models and warehouse structures in Snowflake to ensure high performance and reliability. Collaborate with data analysts, data scientists, and b...

Project description Our client is a leading global Financial markets data provider runs a number of change programs to deliver of high-quality software that connects Financial Markets across the globe in a real-time, high frequency and low-latency data management chain. The projects are technically challenging in a very engaging environment making the most of cutting-edge technologies. Responsibilities Design, build, and maintain scalable ETL/ELT data pipelines to support analytics, reporting, and machine learning use cases. Develop and optimize data models and warehouse structures in Snowflake to ensure high performance and reliability. Collaborate with data analysts, data scientists, and b...

Job summary: Analytics Team at Grant Thornton INDUS Marketing are seeking a skilled and motivated Microsoft Fabric Engineer. In the given role, you will be responsible for designing, implementing, and maintaining solutions within the Microsoft Fabric ecosystem. Your expertise will contribute to the optimization of enterprise data processes, analytics workflows, and system integrations, ensuring the delivery of high-performance, scalable, and secure solutions. Key responsibilities: Design, implement, and maintain solutions leveraging Microsoft Fabric services (e.g., Power BI, Synapse Analytics, Azure Data Factory, Data Lake) Develop and manage robust data pipelines for ETL/ELT processes withi...

Role Overview: You will be working as an Analytics Engineer at unifyCX, bridging the gap between data analysis and data engineering. Your main responsibilities will revolve around transforming raw data into clean, reliable data sets, building data models, and enabling stakeholders to derive meaningful insights for decision-making processes. Key Responsibilities: - Design, develop, and maintain scalable data pipelines and ELT processes to convert raw data into usable formats. - Create and optimize data models for analytical and operational purposes. - Collaborate with data analysts, data scientists, and other stakeholders to understand data requirements and provide high-quality data solutions...

Technical Skill set: Having 3-5 years of experience in implementing Big Data solution in Cloud environments. Hands-on in implenting Big data solution using Airflow DAG,Spark,Python,Hive,Trino,S3 Bucket,etc Having experience Cloud Data platform like SnowFlake , Databricks is a plus. Knowledge of Financial domain-Credit Card industry is a plus. Responsibilites: Creating an ELT Data pipelines using python script and Airflow DAG. Optimizing the Data pipelines by configuring the Spark system resources Debug an existing Microsoft BI ETLs and understand business logic and convert in to big data pipeline using Airflow DAG. Able to interact with business partners to understand the requirements and pr...

The Value You Deliver The associate would help the team in designing and building a best-in-class data solutions using very diversified tech stack. Strong experience of working in large teams and proven technical leadership capabilities Knowledge of Enterprise level implementations like Data warehouse, Automated solutions. Ability to negotiate, influence and work with business peers and management. Ability to develop and drive a strategy as per the needs of the team Good to have: Programming knowledge. The Skills that are Key to this role Technical / Behavioural Bachelor's degree in computer science or equivalent technology field. 7+ years experience, preferable within financial services and...

Job Description: 8+ Yrs total experience in IT/Data Engineering projects & 5+ years of relevant experience- Strong coding skills in - Python, SQL, ADF, Databricks (PySpark, Delta live table, Live/structural data streaming, Unity Catalog, Performance Tuning of DLT pipelines with high volume of data processing , Cost Optimization of Databricks when DLT runs in live streaming on Photon, Serverless, non serverless)The candidate should be responsible, take ownership, self driven, dedication to achieve timeline. Should have great problem solving and analytical/reasoning capability,Technical skill with good mindset and behaviour is important good hands-on programming / scripting knowledge in Python...

Position Responsibilities: Contribute to the design, build, and upkeep of data architectures in standard databases and data warehouses Translate stakeholder requirements into data models for acquisition and implementation Write Python code for ETL/ELT tasks, data validation, and automation Build and operate simple, repeatable data pipelines across multi- and hybrid-cloud environments Develop and support basic data access APIs to enable reliable data consumption Prepare curated datasets and features to support data scientists analysis and modeling Create collection frameworks for structured and unstructured data; address low-complexity data issues Implement data quality checks, monitoring, an...

Role Proficiency: Act creatively to develop applications and select appropriate technical options optimizing application development maintenance and performance by employing design patterns and reusing proven solutions account for others' developmental activities Outcomes: Interpret the application/feature/component design to develop the same in accordance with specifications. Code debug test document and communicate product/component/feature development stages. Validate results with user representatives; integrates and commissions the overall solution Select appropriate technical options for development such as reusing improving or reconfiguration of existing components or creating own solu...

Role & responsibilities Job Description Analytics Engineer (Looker + BigQuery) Location: India ( Remote ) Experience Required: Minimum 5 years About the Role We are looking for a highly skilled Analytics Engineer/ Data Analyst / BI Developer with deep expertise in Looker and Google BigQuery to join our growing data team. This role will play a key part in designing scalable data models, building efficient SQL queries, and creating impactful dashboards and reporting solutions. You will collaborate closely with business and product teams to deliver analytics that drive informed decision-making across the organization. Key Responsibilities Design, develop, and maintain LookML models in Looker to...

Languages: Proficiency in Python, Shell, and Perl Cloud Expertise: Hands-on experience with AWS (S3, Lambda, Glue, EC2, RDS, etc) Data & ETL: Strong background in ETL/ELT processes, data modeling, and performance tuning Call/whatsapp on 9350514090 Required Candidate profile Database: Deep understanding of PL/SQL and relational database systems. Monitoring & Observability: Practical experience with Datadog API Development Version Control & CI/CD: Experience with gitlab

Your Role IT experience with a minimum of 5+ years of experience in creating data warehouses, data lakes, ETL/ELT, data pipelines on cloud. Has data pipeline implementation experience with any of these cloud providers - AWS, Azure, GCP. preferably - Life Sciences Domain Experience with cloud storage, cloud database, cloud Data ware housing and Data Lake solutions like Snowflake, Big query, AWS Redshift, ADLS, S3. Experience with cloud storage, cloud database, cloud Data ware housing and Data Lake solutions like Snowflake, Big query, AWS Redshift, ADLS, S3. Experience in using cloud data integration services for structured, semi structured and unstructured data such as Azure Databricks, Azure...

Job Summary We are seeking a skilled Azure Data Engineer with 4 years of overall experience , including at least 2 years of hands-on experience with Azure Databricks (Must) . The ideal candidate will have strong expertise in building and maintaining scalable data pipelines and working across cloud-based data platforms. Key Responsibilities Design, develop, and optimize large-scale data pipelines using Azure Data Factory, Azure Databricks, and Azure Synapse. Implement data lake solutions and work with structured and unstructured datasets in Azure Data Lake Storage (ADLS). Collaborate with data scientists, analysts, and engineering teams to design and deliver end-to-end data solutions. Develop...

Job Summary We are seeking a skilled Azure Data Engineer with 4 years of overall experience , including at least 2 years of hands-on experience with Azure Databricks (Must) . The ideal candidate will have strong expertise in building and maintaining scalable data pipelines and working across cloud-based data platforms. Key Responsibilities Design, develop, and optimize large-scale data pipelines using Azure Data Factory, Azure Databricks, and Azure Synapse. Implement data lake solutions and work with structured and unstructured datasets in Azure Data Lake Storage (ADLS). Collaborate with data scientists, analysts, and engineering teams to design and deliver end-to-end data solutions. Develop...

Key Skills & Competencies Advanced SQL development (joins, CTEs, window functions, optimization) Experience with ETL/ELT processes and tools Data modeling (dimensional and normalized Familiarity with version control (e.g., Git) and CI/CD practices Understanding of DWH architectures and data integration patterns Ability to work with large datasets and performance-tune queries Platform-agnostic mindset with readiness to adapt to Azure or AWS

Job Summary As a Microsoft Fabric Data Engineer/Developer, you will play a vital role in designing, developing, and implementing robust and scalable data solutions within the Microsoft Fabric ecosystem. You will collaborate closely with data architects, business stakeholders, and cross-functional teams to transform raw data into actionable insights, driving informed decision-making across the organization. If you are passionate about data engineering, possess a strong technical background, and excel in collaborative environments, we invite you to join our growing data team. Career Level - IC2 Responsibilities Microsoft Fabric Development : Design, develop, and deploy end-to-end data solution...

We are currently seeking a Digital Solution Architect Sr. Advisor to join our team in Bengaluru, India, Karntaka (IN-KA), India (IN). Key Responsibilities: Design data platform architectures (data lakes, lakehouses, DWH) using modern cloud-native tools (e.g., Databricks, Snowflake, BigQuery, Synapse, Redshift). Architect data ingestion, transformation, and consumption pipelines using batch and streaming methods. Enable real-time analytics and machine learning through scalable and modular data frameworks. Define data governance models, metadata management, lineage tracking, and access controls. Collaborate with AI/ML, application, and business teams to identify high-impact use cases and optim...

Primary skills:ETL/ELT pipelines using DBT and AWS Redshift. Secondary skills :Proficiency in SQL and scripting languages like Python or Shell

Position Overview: The Microsoft Cloud Data Engineer role is ideal for a highly capable and motivated Microsoft Cloud Data Engineer to design, build, and maintain cloud-based data solutions using Microsoft Azure technologies. This role is key for developing robust, scalable, and secure data pipelines and supporting analytics workloads that power business insights and data-driven decision-making. Key Responsibilities: Design and implement ETL/ELT pipelines using Azure Data Factory, Azure Synapse Analytics, Azure Databricks, and Azure Data Lake Storage. Develop and manage data integration workflows to ingest data from multiple sources including APIs, on-prem systems, and cloud services. Optimi...

Position Overview: The Databricks Data Engineer role is ideal for a skilled and motivated Databricks Data Engineer to design, build, and optimize data pipelines and analytics solutions on the Databricks Lakehouse Platform. This role is ideal for candidates who have experience with big data technologies and a passion for building robust data systems. Key Responsibilities: Develop and maintain scalable data pipelines using Databricks and Apache Spark (primarily with PySpark). Build and manage Delta Lake tables and optimize them for analytics and machine learning workloads. Integrate data from diverse sources including APIs, cloud storage, databases, and streaming platforms like Kafka. Transfor...

Introduction to the Role: Are you passionate about unlocking the power of data to drive innovation and transform business outcomes? Join our cutting-edge Data Engineering team and be a key player in delivering scalable, secure, and high-performing data solutions across the enterprise. As aData Engineer, you will play a central role in designing and developing modern data pipelines and platforms that support data-driven decision-making and AI-powered products. With a focus onPython,SQL,AWS,PySpark, andDatabricks, you'll enable the transformation of raw data into valuable insights by applying engineering best practices in a cloud-first environment. We are looking for a highly motivated profess...

Skills - Snowflake, Apache Airflow, Terraform , DBT, Git, SQL, Spark and Python , Data Warehousing, CIi/CD Pipelines Key Responsibilities: Design, implement, and optimize data pipelines and workflows using Apache Airflow Develop incremental and full-load strategies with monitoring, retries, and logging Build scalable data models and transformations in dbt, ensuring modularity, documentation, and test coverage Develop and maintain data warehouses in Snowflake Ensure data quality, integrity, and reliability through validation frameworks and automated testing Tune performance through clustering keys, warehouse scaling, materialized views, and query optimization. Monitor job performance and reso...

About The Role Project Role : Cloud Platform Engineer Project Role Description : Designs, builds, tests, and deploys cloud application solutions that integrate cloud and non-cloud infrastructure. Can deploy infrastructure and platform environments, creates a proof of architecture to test architecture viability, security and performance. Must have skills : AWS Analytics Good to have skills : NA Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Cloud Platform Engineer, you will engage in the design, construction, testing, and deployment of cloud application solutions that seamlessly integrate both cloud and non-cloud infrastructu...