Python/Scala/PySpark Data Engineer

4 - 8 years

5 - 9 Lacs

Bengaluru

Posted:2 months ago| Platform: Naukri logo

Apply

Skills Required

metadata spark Data modeling UDF SCALA Programming Data quality Data warehousing SQL Python

Work Mode

Work from Office

Job Type

Full Time

Job Description

4+ years of experience in Data Warehouse project / ETL / Data Engineering Clear concept of dimensional data modelling(Logical), SCDs, Normalisation and denormalizations. Thoroughly translating the logical models to physical and data flows per the business requirements. Update and optimise the local and metadata models. Could evaluate the implemented data system for the variances, discrepancies and efficiencies Troubleshoot and optimise the existing data flows, models and processing jobs by modularising. Explore ways to enhance the data quality and reliability. Strong in writing UDF Previous knowledge of implementing the DQ framework on Spark would be an added advantage. Good in writing programming using Python/Scala/PySpark is a must. Strong knowledge of spark framework. Data Engineer, Scala, Pyspark - Sql, Python

Mock Interview

Practice Video Interview with JobPe AI

Start Metadata Interview Now
Rarr Technologies
Rarr Technologies

Information Technology

San Francisco

50-100 Employees

839 Jobs

    Key People

  • Jane Doe

    CEO
  • John Smith

    CTO

RecommendedJobs for You