Data Engineer /Data Scientist

Location: Bng, pune, noida

Minimum Qualifications / Skills:

• Bachelors degree in computer science or related technical field
• 10+ years of experience in data architecture and business intelligence
• 5+ years of experience in developing solutions in distributed technologies such as Hadoop, Spark
• Experience in delivering end-to-end solutions using Azure services Blob Storage, SQL Database,

Event Hubs, Data Factory, Synapse Analytics, and HDInsight

• Experience in programming using Python, Java, or Scala
• Expert in data modeling, metadata management, and data quality
• SQL performance tuning
• Strong interpersonal and multitasking skills with the ability to balance competing priorities
• Excellent communication (verbal and written) and interpersonal skills and an ability to effectively

communicate with both business and technical teams

• An ability to work in a fast-paced ambiguous environment where continuous innovation is

occurring

• Experience with a business intelligence reporting tool

Preferred Qualifications/ Skills

• Experience with Databricks for advanced analytics and data processing
• Understanding of well-architected data pipeline designs
• Expertise in monitoring and fault-tolerant pipeline designs
• Knowledge of cluster configuration for optimal performance
• Ability to create cost-optimal solutions
• Experience in exploratory data analysis (dashboarding, plotting) using machine learning

technologies and algorithms is desirable

• Good knowledge of standard machine learning techniques (like regression, classification,

anomaly detection, forecasting) by using standard machine learning libraries part of Spark,

Python is desirable

• Prior experience in gen AI and related tools and techniques (such as large language models,

prompt engineering) is desirable

• Having a relevant Azure certification (architecture/data/machine learning) is desirable