Azure Databricks

You will be joining our team as an experienced Databricks Engineer. Your primary responsibility will involve designing, developing, and implementing big data solutions using Databricks and Apache Spark. This role requires collaborating with cross-functional teams to gather requirements and design effective big data solutions. You will be tasked with developing and maintaining Databricks notebooks, jobs, and workflows, as well as troubleshooting and resolving any big data processing issues that may arise. Additionally, optimizing Databricks solutions for performance, scalability, and cost-effectiveness will be a key part of your role. Ensuring seamless integration of big data solutions with other teams and maintaining technical documentation are also crucial aspects of this position. To excel in this role, you should have 6-12 years of experience in big data engineering and development. Strong proficiency in Databricks and Apache Spark is essential, along with experience in utilizing big data technologies like Hadoop, Hive, and Kafka. A solid understanding of data structures, algorithms, and database design principles is required. Familiarity with cloud-based big data platforms such as AWS or Azure is preferred. The ideal candidate will possess strong analytical and problem-solving skills, as well as excellent communication and interpersonal abilities. Key Skills: database design, data structures, analytical skills, algorithms, Databricks, communication skills, Apache Spark, Hadoop, AWS, problem-solving, Hive, Kafka, Azure, interpersonal skills.,