Data Architect- Databricks

10 - 14 years

0 Lacs

Posted:2 weeks ago| Platform: Shine logo

Apply

Work Mode

On-site

Job Type

Full Time

Job Description

As a Data Architect specializing in Databricks and Snowflake, your role involves designing and optimizing cloud-native data architectures to support scalable data engineering, advanced analytics, and AI/ML solutions in alignment with business requirements. Your key responsibilities include: - Designing and implementing Lakehouse architectures utilizing Databricks, Delta Lake, and Apache Spark. - Leading the development of data pipelines, ETL/ELT processes, and data integration strategies. - Collaborating with both business and technical teams to establish data architecture standards, governance, and security models. - Optimizing the performance and cost-efficiency of Databricks clusters and jobs. - Providing technical leadership and mentorship to data engineers and developers. - Integrating Databricks with cloud platforms such as Azure, AWS, or GCP, as well as enterprise systems. - Evaluating and recommending tools and technologies to enhance the data ecosystem. - Ensuring compliance with data privacy and regulatory requirements. - Contributing to proposal and pre-sales activities. In terms of qualifications, you are required to have: - Bachelor's degree in computer science, engineering, or a related field. - Demonstrated continued learning through technical certifications or related methods. - Over 10 years of relevant experience in ETL tools. Essential skills for this role include: - Expertise in data engineering, data architecture, or analytics. - Hands-on experience with Databricks, Snowflake, and Apache Spark. - Proficiency in Python, SQL, and PySpark. - Deep understanding of Delta Lake, Lakehouse architecture, and data mesh principles. - Familiarity with Data Governance and Unity Catalog. - Experience with cloud platforms (preferably Azure, with AWS or GCP also acceptable). Desirable skills that would be beneficial for this position are: - Understanding of the CI/CD pipeline. - Working experience with GitHub. - Providing data engineering solutions while balancing architecture requirements, efforts, and specific customer needs with other tools. As a successful candidate, you should possess qualities such as: - Proven problem-solving and troubleshooting abilities with a high degree of adaptability. - Ability to handle multiple tasks effectively, maintain a professional attitude, and work well in a team. - Excellent interpersonal and communication skills with a customer-focused approach and keen attention to detail.,

Mock Interview

Practice Video Interview with JobPe AI

Start Python Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

coding practice

Enhance Your Python Skills

Practice Python coding challenges to boost your skills

Start Practicing Python Now
InfoCepts logo
InfoCepts

Business Consulting and Services

Washington DC VA

RecommendedJobs for You

kolkata, mumbai, new delhi, hyderabad, pune, chennai, bengaluru

Kolkata, Mumbai, New Delhi, Hyderabad, Pune, Chennai, Bengaluru