Skill: Azure Databricks
Experience:
Location: AIA-Gurgaon
Job Summary
As a Sr. Developer you will leverage your expertise in Databricks PySpark and AWS to drive innovative solutions in a hybrid work model. With 6 to 10 years of experience you will collaborate with cross-functional teams to enhance data processing capabilities and contribute to the companys mission of delivering impactful technology solutions.
Responsibilities
- Develop and implement data processing solutions using Databricks and PySpark to optimize data workflows and improve efficiency.
- Collaborate with data engineers and analysts to design scalable data architectures on AWS ensuring seamless integration and performance.
- Analyze complex data sets to identify trends and insights that drive strategic decision-making and business growth.
- Provide technical guidance and support to team members fostering a collaborative and innovative work environment.
- Ensure data quality and integrity by implementing robust data validation and cleansing processes.
- Optimize existing data pipelines and workflows to enhance performance and reduce processing time.
- Conduct code reviews and provide constructive feedback to maintain high coding standards and best practices.
- Stay updated with the latest industry trends and technologies to continuously improve data processing capabilities.
- Participate in agile development processes contributing to sprint planning retrospectives and daily stand-ups.
- Troubleshoot and resolve technical issues related to data processing and AWS infrastructure.
- Document technical specifications and processes to ensure knowledge sharing and continuity.
- Engage with stakeholders to understand business requirements and translate them into technical solutions.
- Contribute to the companys purpose by developing data-driven solutions that have a positive impact on society.
Qualifications
-
- Possess strong experience in Databricks and PySpark with a proven track record of successful project implementations.
- Demonstrate expertise in AWS services particularly in data processing and storage solutions.
- Exhibit excellent problem-solving skills and the ability to analyze complex data sets.
- Have a solid understanding of data architecture and design principles.
- Show proficiency in agile development methodologies and practices.
- Display strong communication skills to effectively collaborate with cross-functional teams.
Certifications Required
AWS Certified Solutions Architect Databricks Certified Associate Developer for Apache Spark