VITS Consulting Corp

Job Description Job Characteristics: Demonstrates full use and application of data engineering principles to integrate, model, and automate data pipelines and data systems. The employee should demonstrate mastering of skills across following data engineering areas: development of data integration pipelines between data systems, data security, ETL and ELT, quality engineering activities and data operation engineering. Education/Work Experience Typically requires a degree and 5-8 years experience; OR no degree and 9-12 years combined education and equivalent work experience (typically 1 year experience = 1 year education). Independence Level/Reports to: Applies advanced knowledge of job area typically obtained through advanced education and work experience. Leads projects/research with moderate complexity. May provide coaching and review the work of lower-level professionals. Normally reports to Data Engineering Manager. Required Qualifications 3+ Years professional experience in a data Engineer/analyst role or similar. At least 5+ year of Development experience in ADF V2 . At least 1 years of Experience with Spark (PySpark and other python data libraries), Spark Scala is also fine. At least 1 years of experience in T-SQL, creating complex store procedures, triggers etc. Should have used Azure DevOps extensively as part of projects Should have worked on at least 1 project involving hybrid cloud implementation. Should have worked on Azure Data Bricks, SQL Database, Azure SQL Database, Azure Data warehouse and should be comfortable with data warehousing concepts. Should have worked on Azure Logic Apps , Azure Functions for not less than 1 year. Knowledge in creating Power BI Reports & Dashboards. Should have worked on Service Bus, Event Hub. Preferred Qualifications Experience working on Data Migration using ADF will be an advantage. Excellent communication, organizational transformation, and leadership skills Eager to continuously learn and grow