Data Engineer – Digital Transformation

Summary:

Main Responsibilities:

• Collect, store, process, and analyze large datasets to support strategic decisions.
• Collaborate with global teams to propose and test optimal data solutions.
• Implement data solutions primarily on the Palantir Foundry platform or internal AI solutions.
• Ensure data quality and interpret data-related issues.
• Develop and maintain data pipelines, documentation, and definitions.
• Prepare data for predictive modeling and contribute to functional analysis.
• Stay updated on new technological tools and promote best practices for sustainable data platforms.
• Facilitate knowledge transfer among team members and communicate effectively across departments.
  

Key Requirements:

• 3 to 5 years experience in data mining from varied data sources.
• Proficiency in implementing data flows and automation between data sources.
• Hands-on experience with data processing frameworks such as PySpark and Spark.
• Strong understanding of data quality assurance and problem analysis.
  

Nice to Have:

• Bachelor's or Master's degree in Computer Science or Engineering.
• Experience with Big Data solutions and BI tools.
• Familiarity with Agile software development methodologies.
• Excellent communication and problem-solving skills.
  

Other Details:

• Location: Pune
• Team Structure: Part of the Digital Transformation Organization.
• Key Platform: Primarily Palantir Foundry.