Data Engineer

Primary Responsibilities:

• Propose Innovative Solutions for the existing problems of the Product
• Develop and Manage Big Data Platform using Public and Private Cloud infrastructure
• Develop high performing Transactional and Non-Transactional Big Data Platform
• Participate and contribute in Architecture discussion with Senior Architects, Product Owners, Dev and QE Managers.
• Propose Innovative Solutions for the existing problems of Products
• Come up with long term architecture roadmap for the existing products
• Constantly look at security aspects and propose architectural solution for security vulnerabilities
• Propose and implement best in class architectural solution for big and complex systems hosted on cloud infrastructure
• Define and create system architecture design document and discuss different pros and cons of any particular approach with Architecture council
• Develop detailed design specifications, data mapping and data transformation rules as per Product need
• Define, use and communicate design patterns and best practices
• Communicate with internal and external business partners. Should be able to handle Onshore or Offshore model
• Act as the liaison between Business and Developers and project management groups
• Present and evaluate design solutions objectively and facilitate conflict resolution
• Develops pioneering approaches to emerging technology and industry trends
• Comply with the terms and conditions of the employment contract, company policies and procedures, and any and all directives (such as, but not limited to, transfer and/or re-assignment to different work locations, change in teams and/or work shifts, policies in regards to flexibility of work benefits and/or work environment, alternative work arrangements, and other decisions that may arise due to the changing business environment). The Company may adopt, vary or rescind these policies and directives in its absolute discretion and without any limitation (implied or otherwise) on its ability to do so

Qualifications - External

Required Qualifications:

• B. Tech or M. Tech or MCA or equivalent experience
• 7+ years of experience in designing and developing or coding software components in Bigdata, that includes various tools like Map Reduce, Hive, Sqoop, HBase, Spark, Scala, Kafka.
• Solid knowledge in Azure or AWS
• Solid working experience of Java and RDBMS