Job
Description
Job Description: As a Senior Databricks Developer with 8-10 years of experience, you will be responsible for designing, developing, and optimizing data pipelines, ETL processes, and scalable data solutions on the Databricks platform. Your role will involve utilizing your strong data engineering skills, cloud integration experience, and ability to work with diverse data sources to deliver efficient and reliable data solutions. Key Responsibilities: - Design, develop, and optimize data pipelines and ETL processes using Databricks (Spark, Delta Lake). - Build and maintain scalable and reliable data solutions on the Databricks platform. - Develop and deploy Spark applications using Scala or Python. - Optimize Spark code for performance and efficiency. - Implement data ingestion, transformation, and loading processes. - Design and implement data lake solutions. - Implement data quality checks and monitoring to ensure accuracy and integrity. - Work with various data sources (relational databases, NoSQL databases, APIs, streaming data). Cloud Integration & Security: - Integrate Databricks with AWS, Azure, or GCP. - Manage and optimize cloud resources related to Databricks deployments. - Implement cloud security best practices for data solutions. Collaboration & Data Insights: - Work closely with data scientists and analysts to understand data requirements. - Collaborate with cross-functional teams to enable data-driven decision-making. Qualifications Required: - 8-10 years of overall software engineering experience. - Proven expertise in building and deploying data pipelines. - Strong proficiency in Spark (Scala or Python). - Deep understanding of Databricks architecture and features. - Experience with data engineering concepts and techniques. - Knowledge of cloud platforms (AWS, Azure, GCP). - Strong understanding of data warehousing and data lake concepts. - Proficiency in SQL for querying and data manipulation. Additional Company Details: This job role requires you to have skills in Databricks, Spark, SQL, and Cloud Platform. Familiarity with data visualization tools like Tableau and Power BI, as well as experience with real-time data processing and streaming frameworks, would be advantageous. Job Description: As a Senior Databricks Developer with 8-10 years of experience, you will be responsible for designing, developing, and optimizing data pipelines, ETL processes, and scalable data solutions on the Databricks platform. Your role will involve utilizing your strong data engineering skills, cloud integration experience, and ability to work with diverse data sources to deliver efficient and reliable data solutions. Key Responsibilities: - Design, develop, and optimize data pipelines and ETL processes using Databricks (Spark, Delta Lake). - Build and maintain scalable and reliable data solutions on the Databricks platform. - Develop and deploy Spark applications using Scala or Python. - Optimize Spark code for performance and efficiency. - Implement data ingestion, transformation, and loading processes. - Design and implement data lake solutions. - Implement data quality checks and monitoring to ensure accuracy and integrity. - Work with various data sources (relational databases, NoSQL databases, APIs, streaming data). Cloud Integration & Security: - Integrate Databricks with AWS, Azure, or GCP. - Manage and optimize cloud resources related to Databricks deployments. - Implement cloud security best practices for data solutions. Collaboration & Data Insights: - Work closely with data scientists and analysts to understand data requirements. - Collaborate with cross-functional teams to enable data-driven decision-making. Qualifications Required: - 8-10 years of overall software engineering experience. - Proven expertise in building and deploying data pipelines. - Strong proficiency in Spark (Scala or Python). - Deep understanding of Databricks architecture and features. - Experience with data engineering concepts and techniques. - Knowledge of cloud platforms (AWS, Azure, GCP). - Strong understanding of data warehousing and data lake concepts. - Proficiency in SQL for querying and data manipulation. Additional Company Details: This job role requires you to have skills in Databricks, Spark, SQL, and Cloud Platform. Familiarity with data visualization tools like Tableau and Power BI, as well as experience with real-time data processing and streaming frameworks, would be advantageous.
