Senior Data Engineer/ Architect

As a Senior Data Engineer at Enable Data Incorporated, you will be a key player in designing, developing, and maintaining scalable and efficient data solutions in the cloud. Leveraging your expertise in cloud technologies, Spark, and Databricks, you will collaborate with cross-functional teams to gather data requirements, design and implement data processing pipelines, and ensure data quality and integrity. Your role will involve optimizing data infrastructure for clients and providing advanced analytics insights. If you are passionate about using cutting-edge technologies to solve complex data challenges, this is the perfect opportunity for you. **Key Responsibilities:** - Design, develop, and maintain scalable and robust data solutions in the cloud using Apache Spark and Databricks. - Gather and analyze data requirements from business stakeholders to identify data-driven insights. - Build and optimize data pipelines for ingestion, processing, and integration using Spark and Databricks. - Ensure data quality, integrity, and security throughout the data lifecycle. - Collaborate with teams to design and implement data models, schemas, and storage solutions. - Optimize data processing and analytics performance by tuning Spark jobs and leveraging Databricks features. - Provide technical guidance to junior data engineers and developers. - Stay updated with emerging trends in cloud computing, big data, and data engineering. **Qualifications Required:** - Bachelor's or Master's degree in computer science, engineering, or related field. - 10+ years of experience in Data Engineering or similar roles focusing on cloud-based data solutions. - Strong expertise in cloud platforms like Azure or AWS. - Proficiency in Apache Spark and Databricks for large-scale data processing. - Experience in data processing pipelines design and implementation. - Knowledge of SQL, relational, and NoSQL databases. - Experience with data integration, ETL processes, and tools like Apache Airflow. - Understanding of data modeling, schema design, governance, and compliance. - Excellent problem-solving, communication, and collaboration skills. - Relevant certifications in cloud platforms, Spark, or Databricks are a plus.,