Data Team Lead

Company Description

No. 23 & 24, Third Floor, AMR Tech Park-4, Hosur Road, near Oxford College, Bommanahalli, Bangalore 560068.

Role Description

Job Description:

Total Experience: 10+

Relevant experience in Azure data engineering:   3 years.

Relevant experience in SSIS: 6 + years

Relevant experience in SQL : 6+ years.

Mandatory Skills: SQL Server 2016 , SSIS, T-SQL, Data Factory, Azure Data Lake Storage, Azure SQL databases

Good to have: Databricks, PySpark/Scala/SparkSQL

JD:

• Expertise in writing T-SQL Queries, Dynamic-queries, sub-queries and complex joins for generating Complex Stored Procedures, Triggers, User-defined Functions, Views and Cursors.
• Monitoring of Jobs and carry out root cause analysis of failures and fix issues where required
• Experience in using SSIS tools like Import and Export Wizard, Package Installation, and SSIS Package Designer.
• Experience in importing/exporting data between different sources like SQL Server/CSV/Excel/text etc. using SSIS/DTS utility.
• Experience in creating configuration files to deploy the SSIS packages across all environments.
• Designed SSIS Packages to transfer data from flat files to SQL Server using Business Intelligence Development Studio.
• Extensively used SSIS transformations such as Lookup, Derived column, Data conversion, Aggregate, Conditional split, SQL task, Script task and Send Mail task etc.
• Used Execution Plan, SQL Profiler and Database Engine Tuning Advisor to optimize queries and enhance the performance of databases
•  Experience in addressing Issues/Tickets resolution (JIRA )
• Execute database related deployments
• Understand business objectives and processes to effectively convert to technical requirements
• Very good communication skills – both written and verbal
• Self-driven, with an eye to find opportunity for innovation and optimization

• Worked with transactional, temporal, time series, and structured and unstructured data.
• Experience in developing ADF pipeline for data ingestion/integration frameworks capable of processing structured, semi-structured & unstructured data sets in batch & real-time
• Good development knowledge on Control flow and data flow activities.
• Must have strong knowledge on developing data driven ADF pipelines .
• Strong knowledge on logic apps , Azure function and Key vault.
• Strong SQL knowledge (query performance, tuning etc.) as well as understanding of     database structure.
• Good knowledge on creating Azure data factory triggers.
• Must have experience in support activities like job monitoring, handling production fixing, status updation to various stake holders.