ADF Technical Lead

Tata Consultancy Services

8 - 13 years

27 - 37 Lacs

hyderabad bengaluru delhi / ncr

Posted:2 hours ago| Platform:

Apply

Skills Required

azure data factory data bricks sql

Work Mode

Work from Office

Job Type

Full Time

Job Description

Denodo
Azure Databricks
Azure Data Factory
Snowflake
PySpark

Good-to-Have

SQL
Azure Services like Key Vault, Storage Account, IAM, etc.
DevOps
Understanding/Experience of Support Processes
Python

SNResponsibility of / Expectations from the Role 1

Debug mode can be helpful when trying out pipeline code and acts as a tool to test and troubleshoot our code.
Manual Execution is what we do by clicking on the Trigger now option in a pipeline. This is useful if you want to run your pipelines on an ad-hoc basis.
We can schedule our pipelines at predefined times and intervals via a Trigger. As we will see later in this article, there are three types of triggers available in Data Factory.

What types of SQL commands (or SQL subsets) do you know?

Data Definition Language (DDL)
to define and modify the structure of a database.
Data Manipulation Language (DML)
to access, manipulate, and modify data in a database.
Data Control Language (DCL)
to control user access to the data in the database and give or revoke privileges to a specific user or a group of users.
Transaction Control Language (TCL)
to control transactions in a database.
Data Query Language (DQL)
to perform queries on the data in a database to retrieve the necessary information from it.

Is Snowflake an ETL tool?

RDDs are low-level APIs that lack a schema and offer control over the data. They are immutable collections of objects
DataFrames are high-level APIs built on top of RDDs optimized for performance but are not safe-type. They organize structured and semi-structured data into named columns.
Datasets combine the benefits of RDDs and DataFrames. They are high-level APIs that provide safe-type abstraction. They support Python and Scala and provide compile-time type checking while being faster than DataFrames.

More Jobs at Tata Consultancy Services

Tcs Hiring For GRC , Pan India

Pune, Bengaluru, Mumbai (All Areas)

7 - 12 yrs

INR 9 - 19 Lacs

Java / Spring boot with API Developer

Pune

5 - 10 yrs

INR 9 - 19 Lacs

SAP PP and QM Consultant

Pune

4 - 9 yrs

INR 8 - 18 Lacs

SAP BTP Consultant

Pune

4 - 9 yrs

INR 9 - 19 Lacs

Customer Service Associate

Pune

1 - 6 yrs

INR 1 - 5 Lacs

Mock Interview

Practice Video Interview with JobPe AI

Start Job-Specific Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.