Data Engineer

Position: Data Engineer

Experience: 5 - 10 years

Location: Coimbatore (WFO)

Notice period: Immediate

Job Type: Full time

Skills: Data Engineer, Spark, Scala, Python, Big Data

Job Description:

• Experience in the Big Data technologies (Hadoop, Spark, Nifi, Impala)
  
• 5+ years of hands-on experience designing, building, deploying, testing, maintaining, monitoring, and owning scalable, resilient, and distributed data pipelines.
  
• High proficiency in Scala/Java and Spark for applied large-scale data processing.
  
• Expertise with big data technologies, including Spark, Data Lake, and Hive.
  
• Solid understanding of batch and streaming data processing techniques.
  
• Proficient knowledge of the Data Lifecycle Management process, including data collection, access, use, storage, transfer, and deletion.
  
• Expert-level ability to write complex, optimized SQL queries across extensive data volumes.
  
• Experience on HDFS, Nifi, Kafka.
  
• Experience on Apache Ozone, Delta Tables, Databricks, Axon(Kafka), Spring Batch, Oracle DB
  
• Familiarity with Agile methodologies.
  
• Obsession for service observability, instrumentation, monitoring, and alerting.
  
• Knowledge or experience in architectural best practices for building data lakes.