Azure Data Factory

3 - 7 years

0 Lacs

Posted:2 days ago| Platform: Shine logo

Apply

Work Mode

On-site

Job Type

Full Time

Job Description

As a Data Processing Specialist, you will be responsible for developing and maintaining scalable data processing solutions using Databricks SQL and PySpark. Your key responsibilities will include: - Collaborating with cross-functional teams to design and implement Databricks Workflows that streamline data operations and enhance efficiency. - Analyzing Medicare and Medicaid Claims data to identify trends and insights for driving business decisions and improving healthcare outcomes. - Ensuring data integrity and accuracy through robust data validation and quality checks within the Databricks environment. - Optimizing existing data pipelines to enhance performance and reduce processing time for faster decision-making processes. - Providing technical expertise and support to team members, fostering a collaborative environment that encourages knowledge sharing and innovation. - Monitoring and troubleshooting data processing workflows to ensure seamless operations and minimize downtime. - Documenting technical specifications and processes to maintain a comprehensive knowledge base for future reference and training purposes. - Staying updated with the latest advancements in Databricks and PySpark technologies to continuously improve data processing capabilities. - Collaborating with stakeholders to understand business requirements and translating them into technical solutions aligning with company objectives. - Participating in code reviews and providing constructive feedback to maintain high-quality code standards across the team. - Contributing to the development of best practices and guidelines for data processing and analysis within the organization. - Supporting the company's mission by leveraging data insights to improve healthcare services and positively impact society. Qualifications: - Possessing strong expertise in Databricks SQL, Databricks Workflows, and PySpark with a proven track record of successful implementations. - Exhibiting excellent problem-solving skills and the ability to work independently in a hybrid work model. - Showing proficiency in data validation and quality assurance techniques to ensure data accuracy and reliability. - Having strong communication skills to effectively collaborate with cross-functional teams and stakeholders. - Displaying a commitment to continuous learning and staying abreast of industry trends and technological advancements. - Holding a bachelor's degree in Computer Science, Information Technology, or a related field with relevant certifications being a plus.,

Mock Interview

Practice Video Interview with JobPe AI

Start PySpark Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

coding practice

Enhance Your Skills

Practice coding challenges to boost your skills

Start Practicing Now
Cognizant logo
Cognizant

IT Services and IT Consulting

Teaneck New Jersey

RecommendedJobs for You

chennai, tamil nadu, india