Data bricks Engineer

Company Description

CALTEK Solutions Inc. is a leading provider of high-quality, results-driven IT services and consulting, founded in 2013. Headquartered in Fremont, CA, with business operations in Canada and India, CALTEK Solutions Inc. offers software development, data analytics, and management services. Our primary client sectors include Software, Wireless Telecom, Retail, Financial, Pharma, and Life Sciences, where we focus on bringing people and processes together to achieve optimal results.

7-12 years of experience in data engineering, with expertise in Databricks and Apache Spark

- Strong programming skills in languages like Python, Scala, or Java

- Experience with cloud platforms (AWS, Azure, GCP) and data storage solutions

- Strong understanding of data modeling, ETL processes, and data warehousing

- Excellent problem-solving skills, with ability to troubleshoot complex data issues

- Strong communication and collaboration skills

Design, develop, and maintain scalable data pipelines using Databricks and Apache Spark

- Collaborate with data scientists and analysts to understand data requirements and deliver high-quality data solutions

- Optimize data processing performance, identifying and resolving bottlenecks

- Ensure data quality, integrity, and security across various data sources

- Implement data governance and compliance best practices

- Mentor junior data engineers and contribute to team's growth

s.