Senior/Lead Data Engineer

As a Senior/Lead Data Engineer at our company in Mumbai, you will be responsible for the following: - Senior Data Scientist with 6-8 years of IT Experience and atleast 5+ years as a Data Engineer - Kafka integration to Databricks - Structured Streaming concepts including Processing modes, output modes, and checkpointing - Medallion Architecture knowledge (Bronze, Silver, Gold layers) - Experience with Databricks Autoloader - Proficiency in working with large volumes of data - Implementation of performance optimization techniques such as partitioning, caching, and cluster tuning - Client facing experience - Excellent communication skills Qualifications required for this role: - 6-8 years of IT Experience with a focus on Data Engineering - At least 5 years of experience specifically as a Data Engineer - Proficiency in Kafka integration to Databricks - Understanding of Structured Streaming concepts like Processing modes, output modes, and checkpointing - Knowledge of Medallion Architecture (Bronze, Silver, Gold layers) - Hands-on experience with Databricks Autoloader - Ability to work with large volumes of data - Skills in performance optimization techniques such as partitioning, caching, and cluster tuning - Previous client facing experience - Strong communication skills No additional details of the company were provided in the job description. As a Senior/Lead Data Engineer at our company in Mumbai, you will be responsible for the following: - Senior Data Scientist with 6-8 years of IT Experience and atleast 5+ years as a Data Engineer - Kafka integration to Databricks - Structured Streaming concepts including Processing modes, output modes, and checkpointing - Medallion Architecture knowledge (Bronze, Silver, Gold layers) - Experience with Databricks Autoloader - Proficiency in working with large volumes of data - Implementation of performance optimization techniques such as partitioning, caching, and cluster tuning - Client facing experience - Excellent communication skills Qualifications required for this role: - 6-8 years of IT Experience with a focus on Data Engineering - At least 5 years of experience specifically as a Data Engineer - Proficiency in Kafka integration to Databricks - Understanding of Structured Streaming concepts like Processing modes, output modes, and checkpointing - Knowledge of Medallion Architecture (Bronze, Silver, Gold layers) - Hands-on experience with Databricks Autoloader - Ability to work with large volumes of data - Skills in performance optimization techniques such as partitioning, caching, and cluster tuning - Previous client facing experience - Strong communication skills No additional details of the company were provided in the job description.