Cloud Expert: DataBricks + Python

Job Description:  
We are seeking a talented and experienced Cloud Architect with a strong background in Data Bricks and Python to join our team. The ideal candidate will be responsible for designing, deploying, and optimizing cloud-based data solutions that leverage DataBricks for big data analytics. You will collaborate with data engineers and data scientists to implement scalable and efficient data pipelines, ensuring high performance and reliability.

Responsibilities:  
- Design and implement cloud architecture solutions using Databricks for data processing and analytics. - Collaborate with cross-functional teams to gather requirements and translate them into technical specifications. - Develop and maintain ETL processes using Python to streamline data ingestion, transformation, and loading. - Optimize performance and scalability of data solutions in a cloud environment. - Monitor and troubleshoot data pipelines, ensuring data quality and availability. - Stay up-to-date with the latest cloud technologies and best practices to recommend improvements. - Provide technical guidance and support to team members and stakeholders. - Document architecture patterns, best practices, and system components for future reference.

Skills Required:  
- Strong experience in cloud platforms, particularly AWS, Azure, or Google Cloud. - Proficiency in Data Bricks for big data processing and analytics. - Advanced knowledge of Python, especially in data manipulation and ETL processes. - Familiarity with data modeling, data warehousing, and database technologies. - Understanding of distributed computing concepts and best practices. - Excellent problem-solving skills and the ability to work in a fast-paced environment. - Strong communication and collaboration abilities.

Tools Required:  
- Data Bricks - Python - Apache Spark - SQL - Cloud platforms (AWS, Azure, Google Cloud) - Data visualization tools (Tableau, Power BI, or similar) - Version control systems (Git) - CI/CD tools for deployment automation