Reporting and Data Migration lead

Job Description

Position Overview: We are seeking a skilled and detail-oriented ETL (Extract, Transform, Load) Developer to design, build, and maintain robust data pipelines and workflows. The ETL Developer will play a key role in our data management strategy by ensuring the efficient collection, transformation, and delivery of data from diverse sources to support business intelligence, analytics, and reporting initiatives. Should have idea about kafka and databases like Oracle, Postgres, MongoDB etc.

Key Responsibilities:

1. ETL Design and Development :
   
   
   
   • Design, implement, and maintain ETL processes to extract, transform, and load data from various sources into data warehouses or other storage systems.
   
   
   • Optimize ETL workflows for performance, reliability, and scalability.
   
   
   
   

1. Data Integration :
   
   
   
   • Develop and manage data integration solutions, including integrating structured and unstructured data from multiple sources.
   
   
   • Work with APIs, databases, and flat files to retrieve and process data.
   
   
   
   

1. Data Transformation :
   
   
   
   • Clean, transform, and standardize data to meet business requirements.
   
   
   • Apply data validation, enrichment, and aggregation techniques.
   
   
   
   

1. Data Warehouse Development :
   
   
   
   • Support the design and development of data warehouse schemas, star/snowflake models, and dimensional data structures.
   
   
   • Implement and manage database objects such as tables, views, and stored procedures.
   
   
   
   

1. RDBMS:
   
   
   
   • Must have idea about few RDBMS like Oracle, Postgres etc.
   
   
   
   

1. Kafka:
   
   
   
   • Must have hand of experience in Kafka.
   
   
   • Kafka topics etc.
   
   
   
   

1. Monitoring and Troubleshooting :
   
   
   
   • Monitor ETL processes for failures or inconsistencies and troubleshoot issues as they arise.
   
   
   • Implement error-handling and recovery mechanisms.