Job
Description
Mode: Hybrid Please find the details below: Required Skills : Python, spark/pyspark, Hive, Databricks, SQl, Airflow/ Github, AWS Data Engineer We are seeking an experienced Data Engineer to join our team. As a Data Engineer, you will be responsible for designing, implementing, and maintaining data pipelines, ETL processes, and data infrastructure. The ideal candidate should have a strong background in Python, Spark, SQL, and Databricks. Responsibilities: Design, develop, and maintain data pipelines to extract, transform, and load data from various sources into our data lake or data warehouse. Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and ensure data quality. Optimize and tune data processing workflows for performance and scalability. Implement data governance and security best practices. Troubleshoot and resolve data-related issues. Monitor and maintain data infrastructure, ensuring high availability and reliability. Stay up-to-date with industry trends and emerging technologies in data engineering. Qualifications: Bachelors degree in Computer Science, Engineering, or a related field. 4+ years of experience as a Data Engineer. Strong proficiency in Python for data processing and ETL. Experience with Apache Spark for distributed data processing. Proficiency in SQL for querying and manipulating data. Hands-on experience with Databricks or similar cloud-based data platforms. Familiarity with data modeling, data warehousing, and data lake concepts. Excellent problem-solving skills and attention to detail. Strong communication and collaboration skills. If you are passionate about data engineering and enjoy working in a dynamic environment, we encourage you to apply!
