Data Engineer

Company Description

R Systems is a digital product engineering company that designs and builds cutting-edge products, platforms, and digital experiences. We help clients across various industries overcome digital challenges, focus on their customers, and achieve higher revenues and operational efficiency. With over 4,300 professionals in 28 offices, we leverage the latest technologies such as cloud, automation, AI, ML, and analytics to drive meaningful impact. Our expertise spans multiple sectors including Telecom, Media, FinTech, InsureTech, and HealthTech, enabling seamless integration of new features through our CI-CD pipeline.

Role Description

This is a full-time hybrid role for a Data Engineer, based in Pune. The Data Engineer will be responsible for designing, building, and maintaining scalable data pipelines and architectures. Daily tasks include data integration from various sources, data cleansing, and performance optimization of the data ecosystem. The role also involves working closely with data scientists and analysts to support their data needs and maintain the reliability and efficiency of our data systems.

Responsibilities:

- Design and implement scalable and efficient data pipelines using Azure Cloud services and Databricks.

- Develop, maintain, and optimize data ingestion processes from multiple sources, ensuring high performance and data quality.

- Utilize Python programming to develop custom scripts and automation for data processing.

- Work with APIs to facilitate interaction between different data systems and applications.

- Collaborate with cross-functional teams to understand data requirements and deliver data solutions that meet business needs.

- Participate in data quality assessments and ensure compliance with data governance practices.

- Leverage CDHUB and Figure (FIG) data to support the financial analytics team in their data initiatives.

Required Skill:

- Proven experience with CDHUB and FIG data, especially in financial contexts.

- Strong proficiency in Python programming and related libraries for data manipulation.

- Hands-on experience with Azure Databricks.

-Should have a strong understanding of Python programming with Pyspark.

- Familiarity with Databricks and its features for data engineering and analytics.

- Understanding of API development and integration.

- Excellent problem-solving skills and the ability to work independently or as part of a team.

- Strong communication skills to effectively articulate technical concepts to non-technical stakeholders.