Lead Data Engineer - Spark/Python

Responsibilities for this position include : - Provides technical leadership in Big Data space (Hadoop Stack like M/R, HDFS, Pig, Hive, HBase, Flume, Sqoop, NoSQL stores like Cassandra, HBase etc) across Fractal and contributes to open source Big Data technologies - Write and tune complex Java, MapReduce, Pig and Hive jobs - Adapt quickly to change in requirements and be willing to work with different technologies if required - Experience leading a Backend/Distributed Data Systems team while remaining hands-on is very important - Lead the effort to build, implement and support the data infrastructure - Manage the business intelligence team and vendor partners, ensuring to prioritize projects according to customer and internal needs, and develops top-quality dashboards using industry best practices - Manage team of data engineers (both full-time associates and/or third party resources) - Own the majority of deliverables for the Big Data team from a delivery perspective - Analyzes and confirms the integrity of source data to be evaluated - Leads in deployment and auditing models and attributes for accuracy Education for Lead Data Engineer : Have a relevant degree such as Bachelor's and Master's Degree in Computer Science, Engineering, Statistics, Education, Technical, Information Technology, Information Systems, Mathematics, Computer Engineering, Management Skills for Lead Data Engineer : Desired skills for lead data engineer include : - Python - Spark - Java - Hive - SQL - Hadoop architecture - Large scale search applications and building high volume data pipelines - Message queuing - NoSQL - Scala Desired experience for lead data engineer includes : - Experience in development utilizing C# .NET 4.5 - Experience in managing a live service that customers depend - Experience in coaching and managing other engineers - Be a team player and enjoy collaboration with other engineers and teams - Experience with software version management systems - Experience with task/bug tracking software Exp : 5-7yrs