Big Data Engineer

About Client :-

Our client is a French multinational information technology (IT) services and consulting company, headquartered in Paris, France. Founded in 1967, It has been a leader in business transformation for over 50 years, leveraging technology to address a wide range of business needs, from strategy and design to managing operations.

The company is committed to unleashing human energy through technology for an inclusive and sustainable future, helping organisations accelerate their transition to a digital and sustainable world.

They provide a variety of services, including consulting, technology, professional, and outsourcing services.

Job Details:-

location : Hyderabad

Mode Of Work : Hybrid

Notice Period : Immediate Joiners

Experience : 6-8 yrs

Type Of Hire : Contract to Hire

JOB DESCRIPTION:

1. Strong programming skills in Python and PySpark.
2. Solid understanding of HDFS, Hive, and Spark architecture.
3. Experience with Delta Lake and Apache Iceberg table formats.
4. Proficiency in working with Avro, ORC, and Parquet file formats.
5. Expertise in building scalable ETL workflows and handling large datasets.
6. Familiarity with Hive Metastore, external tables, and partitioning strategies.
7. Knowledge of DML operations over distributed data systems.

Nice to have:

1. Experience with SAS SPDE tables and migration strategiesc.
2. Exposure to Starburst or Databricks platforms.
3. Understanding of modern data lakehouse architectures and query engines.