Databricks consultant

Role: Databricks consultant

Location: PAN India (Cognizant Office)

Exp: 10 to 12 years

Senior Data Engineer: Years for Exp : 10-12 yrs.

Must Have: Python, Databricks, DBT (Data Build Tool), SQL, DAB, Spark, Delta tables,

Nice to have: Collibra DQ, Collibra, Jenkins

Job Description:

• Build and maintain robust data pipelines using Python, Databricks, Spark, DBT, and Delta Lake to transform and deliver high quality analytics-ready datasets.
• Design and implement efficient data models (star, snowflake, and dimensional schemas), choosing normalized or denormalized structures based on performance and use cases.
• Write performant SQL and Databricks notebooks, manage versioning and orchestration, and ensure data quality and lineage across pipelines.
• Leveraging tools Github actions/Jenkins to automate testing, validation, and deployments.
• Implement best practices in data modeling, performance tuning, and scalable architecture and coding practices
• Nice-to-have additions: experience with Autoloader and SAP integration for ingestion workflows, Collibra, Power BI