5.0 - 9.0 years

0 Lacs

chennai, tamil nadu

On-site

Role Overview: As an offshore Techlead with Databricks engineer experience, your primary responsibility will be to lead the team from offshore. You will develop and maintain a metadata-driven generic ETL framework for automating ETL code and design, build, and optimize ETL/ELT pipelines using Databricks (PySpark/SQL) on AWS. In addition, you will be responsible for ingesting data from various structured and unstructured sources (APIs, RDBMS, flat files, streaming) and developing robust data pipelines for batch and streaming data using Delta Lake and Spark Structured Streaming. Your role will also involve implementing data quality checks, validations, and logging mechanisms, optimizing pipeli...

Posted 1 month ago

AI Match Score

Apply

ETL Databricks with AWS(PySpark/SQL) Virtusa

3.0 - 7.0 years

0 Lacs

chennai, tamil nadu

On-site

As a Data Engineer, you will be responsible for developing and maintaining a metadata-driven generic ETL framework to automate ETL code. Your primary tasks will include designing, building, and optimizing ETL/ELT pipelines using Databricks (PySpark/SQL) on AWS. You will be required to ingest data from a variety of structured and unstructured sources such as APIs, RDBMS, flat files, and streaming services. In this role, you will also develop and maintain robust data pipelines for both batch and streaming data utilizing Delta Lake and Spark Structured Streaming. Implementing data quality checks, validations, and logging mechanisms will be essential to ensure data accuracy and reliability. You ...

Posted 3 months ago

AI Match Score

Apply

ETL Databricks (PySpark/SQL) - Architect Virtusa

5.0 - 9.0 years

0 Lacs

chennai, tamil nadu

On-site

As an offshore Techlead with Databricks engineer experience, your primary responsibility will be to lead the team from offshore. You will be tasked with developing and maintaining a metadata-driven generic ETL framework for automating ETL code. This includes designing, building, and optimizing ETL/ELT pipelines using Databricks (PySpark/SQL) on AWS. Your role will involve ingesting data from various structured and unstructured sources such as APIs, RDBMS, flat files, and streaming. Moreover, you will be expected to develop and maintain robust data pipelines for both batch and streaming data using Delta Lake and Spark Structured Streaming. Implementing data quality checks, validations, and lo...

Posted 3 months ago

AI Match Score

Apply

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.