Big Data Developer

About Client :-

Our client is a French multinational information technology (IT) services and consulting company, headquartered in Paris, France. Founded in 1967, It has been a leader in business transformation for over 50 years, leveraging technology to address a wide range of business needs, from strategy and design to managing operations.

The company is committed to unleashing human energy through technology for an inclusive and sustainable future, helping organisations accelerate their transition to a digital and sustainable world.

They provide a variety of services, including consulting, technology, professional, and outsourcing services.

Job Details:-

location : Gurugram

Mode Of Work : Hybrid

Notice Period : Immediate Joiners

Experience : 8-10 yrs

Type Of Hire : Contract to Hire

JOB DESCRIPTION:

The role of Data Engineer involves leading complex business reengineering development projects and to solve organizational problems through IT solutions using Big Data concepts, Platform tools and software engineering languages as required. Key Responsibilities include: • Designing, developing and implementing solutions to customers organisational problems; • Providing high quality service delivery on engagements; • Designing and developing data reconciliation metadata driven data processing frameworks; Responsibilities and Duties Key Skills/Experience: • Working experience and strong knowledge in Databricks.Knowledge in Cloud Computing – AWS preferably • Knowledge in programming and shell scripting eg. Core/Python/Scala/Java • Knowledge in Hadoop Stack eg. Hive, Spark (Core and Streaming), Kafka, Flink, NIFI; • Knowledge with Github and Jenkins; • Knowledge on stream transform using Spark Streaming or Flink; • Knowledge on change data capture in a big data ecosystem; • Knowledge building real time or batch ingestion and transformation pipelines; Additional skills/responsibilities of this role: • Knowledge on supporting a production service in a DevOps friendly environment; • Knowledge on working in Agile/Scrum teams; • Knowledge on API and cloud-native architecture; • Knowledge on with ‘container’ technology (e.g. Docker, Kubernetes); • Knowledge on wrangling data using library such as Pandas, Scikit-learn or Numpy; • Knowledge on using notebook such as Jupyter or Polyglot; • Knowledge on test-driven development, test automation continuous delivery; • Knowledge on in Java build automation technologies such as Gradle, Maven, Integration with Sonarqube etc.;