Data Engineer

SJ Group

3 years

0 Lacs

Bangalore Urban Karnataka India

Posted:1 day ago| Platform:

Apply

Skills Required

data design maintenance support integration resolve mapping prototype onboarding software engineering processing analytics azure databricks scripting spark sql database management tuning reporting profiling cataloging governance unity mdm power tableau stack iot kafka virtualization communication

Work Mode

On-site

Job Type

Full Time

Job Description

Profile - Data Engineer

Job Responsibilities

The data engineer responsibilities include design, executing, and managing the data pipelines between source systems and Enterprise Data Platform (EDP). The responsibilities of the engineer are as follows:

Responsible for the maintenance and support of the data platform.
Design, plan and implement modern data pipelines based on industry best practices.
Support data integration activities in both functional and non-functional scenarios
Identify and resolve data, mapping and visualisation problem tickets across IT and business teams.
Expose data to end users through PowerBI
Support proof-of-concepts, prototype on new data integrations and onboarding of new systems.
Document and maintain technical guidelines and documentation
Participate and support annual infrastructure and recovery tests.

Requirements

Degree in Computer Science, Software Engineering or equivalent
Minimum 3 years of working experience as a Data Engineer
Experienced in business processing mapping of data and analytics solutions.
Experienced in Cloud Data Transformation tools such as Azure Data Factory, Databricks and Azure Synapse
Experienced in Azure Data Lake Store Management
Proficient in scripting language such as Py-Spark, SQL-Spark, and T-SQL
Knowledge in data modelling and database management, such as performance tuning of the Enterprise Data Warehouse, Data Mart, and Business Intelligence Reporting environments
Experienced in Azure Dev-Ops processes (including CI/CD)
Ability to conduct data profiling, cataloging and mapping for technical design and construction of technical data flows
Experienced in Data Governance tools like Unity Catalog / Azure Purview, Master Data Management (MDM) and Data Quality tools and processes
Knowledge of business intelligence tools such as Power BI, Tableau, Qlik
Knowledge of Big Data stack such as Azure Event Hub, Azure IoT, Azure HDInsight (Kafka, Spark), Azure Cosmos DB & Azure Stream Analytics are a plus.
Working experience in SSIS, SSAS, and SSRS are a plus
Knowledge in data virtualization concepts using Denodo is a plus
Strong critical thinking, problem solving and communication skills

More Jobs at SJ Group

Quantity Surveyor

Chennai, Tamil Nadu, India

10.0 - 20.0 yrs

Salary: Not disclosed

Electrical Design Engineer

Mumbai, Maharashtra, India

20.0 - 20.0 yrs

Salary: Not disclosed

Dam Design Specialist

Delhi, India

15.0 - 15.0 yrs

Salary: Not disclosed

Landscape BIM Revit + CAD expert

Gurugram, Haryana, India

5.0 - 5.0 yrs

Salary: Not disclosed

3D Visualizer

Gurugram, Haryana, India

8.0 - 8.0 yrs

Salary: Not disclosed

Mock Interview

Practice Video Interview with JobPe AI

Start Job-Specific Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.