Genpact logo

Lead Consultant - DataBricks

4 - 8 years

0 Lacs

hyderabad telangana

Posted:2 weeks ago| Platform: Shine logo

Apply

Skills Required

python scala data engineering sql performance optimization spark hive azure aws gcp adf dynamodb unit testing integration testing dbt docker kubernetes databricks delta lake dbconnect db api 20 databricks workflows orchestration databricks lakehouse sparksql adls s3 lambda cosmosdb asb sqs cloud databases cicd

Work Mode

On-site

Job Type

Full Time

Job Description

As a Lead Consultant- Databricks Developer at Genpact, your role involves solving real-world cutting-edge problems to meet both functional and non-functional requirements. Your primary responsibilities will include: - Maintaining close awareness of new and emerging technologies and their potential application for service offerings and products. - Collaborating with architects and lead engineers to develop solutions that meet functional and non-functional requirements. - Demonstrating knowledge of relevant industry trends and standards. - Showcasing strong analytical and technical problem-solving skills. - Having experience in the Data Engineering domain. Qualifications we seek in you: - Bachelor's Degree or equivalency in CS, CE, CIS, IS, MIS, or an engineering discipline; or equivalent work experience. - Demonstrated knowledge of relevant industry trends and standards. - Strong analytical and technical problem-solving skills. - Excellent coding skills in Python or Scala, preferably Python. - Experience in the Data Engineering domain. - Implementation of at least 2 projects end-to-end in Databricks. - Proficiency in various Databricks components such as Delta lake, dbConnect, db API 2.0, and Databricks workflows orchestration. - Familiarity with Databricks Lakehouse concept and its implementation in enterprise environments. - Ability to create complex data pipelines and good understanding of Data structures & algorithms. - Strong in SQL and spark-sql. - Performance optimization skills to enhance efficiency and reduce costs. - Experience in working on both Batch and streaming data pipelines. - Extensive knowledge of Spark and Hive data processing framework. - Experience with cloud platforms like Azure, AWS, GCP, and common services like ADLS/S3, ADF/Lambda, CosmosDB/DynamoDB, ASB/SQS, Cloud databases. - Proficiency in writing unit test cases and integration tests. - Strong communication skills and experience working in teams of size 5 plus. - Positive attitude towards learning new skills and upskilling existing skills. Preferred Qualifications: - Knowledge of Unity catalog and basic governance. - Understanding of Databricks SQL Endpoint. - Experience with CI/CD to build pipelines for Databricks jobs. - Experience in migration projects for building Unified data platforms. - Familiarity with DBT, docker, and Kubernetes.,

More Jobs at Genpact

Record To Report Manager

Chennai, Hyderabad, Kolkata

7 - 15 yrs
|

INR 7 - 12 Lacs

Record To Report Manager

Noida, Hyderabad

7 - 15 yrs
|

INR 10 - 14 Lacs

Php Full Stack Developer

Hyderabad

4 - 7 yrs
|

INR 9 - 16 Lacs

Senior .NET Fullstack Developer

Hyderabad

10 - 17 yrs
|

INR 22 - 27 Lacs

Process Associate- P&C Insurance

Gurugram, Haryana

Experience: Not specified

|

Salary: Not disclosed

Mock Interview

Practice Video Interview with JobPe AI

Start Python Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

Google Play App Store
coding practice

Enhance Your Python Skills

Practice Python coding challenges to boost your skills

Start Practicing Python Now
Genpact logo
Genpact

Business Consulting and Services

New York NY

RecommendedJobs for You

Genpact logo

Lead Consultant - DataBricks

Genpact

hyderabad, telangana

Genpact logo

Lead Consultant - DataBricks

Genpact

hyderabad, telangana