Data Engineer

Skills Required:-

Must Have Knowledge of:

• Database technologies

  : Proficiency in SQL (DDL, DML), stored procedures, indexes, query optimization
• MS SQL Server Development (Level : Intermediate)
• Strong Knowledge in Data Structures and Algorithms, Data Modelling
• Working with

  ETL/ELT tools

  : SSIS/Informatica PowerBI environment
• Knowledge in Data Visualization (PowerBI/Excel with SQL)

• Scripting languages

  : Python, PowerShell for automation
• C#/VB.Net (Web Application)
• Experience in IDE : Visual Studio Preferred

Documentation & Process Skills

• System Integration Mapping

  : Ability to create diagrams showing data flows between ERP, CRM, BI, and other systems

• Dependency Documentation

  : Clearly describe:
• Which tables/views/fields are used
• Which processes depend on each integration
• Failure points and fallback procedures

• Change Tracking

  : Maintain versioned documentation when integrations change

• Data Dictionary Maintenance

  : Define terms, field names, and calculation logic

• Business Process Understanding

  : Know the functional reason for each integration (why this data moves)

Personality Traits

• Disciplined & Self-Organized
• Process-Driven
• Detail-Oriented
• Continuous Learner
• Strong analytical skills.
• Proactive and self-motivated approach to work tasks
• Written communication skills for effective documentation
• Ability to effectively prioritize and execute tasks

Experience:

A candidate for this position will must have had a minimum of 2 years in working experience in a MS SQL data related role The candidate must demonstrate successful in managing Datasets and maintaining documentation of the Datbase processes.

General Responsibilities:

1. Prepare clean, consolidated datasets for analytics and reporting

2. Undertake activities for Backup & Restore, Security of Datasets/ Database

3. BI & Report Building on Various reporting tools like Excel, Power BI DAX, SQL, Python, R

4. Data Integration- help Ingest data from ERP, CRM, other systems

5. Uptodate Documentation of all Data Pipelines and Integration processes.

Core Data Engineering Tasks

1. Data Integration

• Extract, transform, and load (ETL/ELT) data from ERP, CRM, and other sources into the central data warehouse or server
• Set up scheduled jobs and monitor for failures

  2

  .

  Database Management

• Maintain and optimize the central database for performance and availability
• Schedule and verify backups
• Manage indexing, partitioning, and archiving of data

  3

  .

  Master Data Synchronization

• Automate or schedule master data updates across systems
• Ensure data integrity between source and target systems

  4.

  Reporting Support

• Provide clean, structured datasets for BI teams
• Build intermediate tables or views to support dashboards and analytics

  5

  .

  Security & Compliance

• Implement access control, encryption, and audit logs
• Follow data governance guidelines

Documentation-Specific Responsibilities

Create and maintain:

• Integration Inventory

  (all current integrations, their purpose, and data flow details)

• Dependency Matrix

  (what breaks if a certain table, API, or field changes)

• Data Flow Diagrams

  (system-to-system visual maps)

• Runbooks

  (step-by-step guides for restarting jobs, troubleshooting failures)
• Work with application owners to validate dependencies
• Update documentation whenever integrations or schema change
• Store documentation in a shared, version-controlled location (e.g., Confluence, SharePoint, Git repo)