Senior/Lead - Data Engineer

As a Data Engineer, you will contribute to cutting-edge global projects and innovative product initiatives, delivering impactful solutions for our Fortune clients. In this role, you will take ownership of the entire data pipeline and infrastructure development lifecyclefrom ideation and design to implementation and ongoing optimization. Your efforts will ensure the delivery of high-performance, scalable, and reliable data solutions. Join us to become a driving force in shaping the future of data infrastructure and innovation, paving the way for transformative advancements in the data ecosystem.

Role & responsibilities

Expertise in Advanced SQL, SSIS, AWS S3, AWS Athena, PySpark and python, Snowflake, Informatica

End-to-end ETL pipeline design, automation, and maintenance using SSIS and AWS cloud services

Development of SQL stored procedures and API query development for data integration

Data extraction and preparation for management and review meetings

Strong in performance optimization, issue debugging, and ensuring efficient data processing

• Data Pipeline Development: Build, maintain, and optimize ETL/ELT pipelines for seamless data flow.

• Data Integration: Consolidate data from various sources into unified systems.

• Database Management: Design and optimize scalable data storage solutions.

• Data Quality Assurance: Ensure data accuracy, consistency, and completeness.

• Collaboration: Work with analysts, scientists, and stakeholders to meet data needs.

• Performance Optimization: Enhance pipeline efficiency and database performance.

• Data Security: Implement and maintain robust data security and governance policies.

• Innovation: Adopt new tools and design scalable solutions for future growth.

• Monitoring: Continuously monitor and maintain data systems for reliability.

• Data Engineers ensure reliable, high-quality data infrastructure for analytics and decision-making.

Preferred candidate profile

Good SQL Expertise

• Proficient in writing and optimizing SQL queries.
• Stored Procedure Development
• Capable of developing new stored procedures.
• Skilled in understanding and analyzing existing procedures.
• Able to debug, troubleshoot, and resolve issues within procedures effectively.
• Analytical and Problem-Solving Skills
• Good analytical skills with the ability to identify and diagnose issues based on specific business scenarios.