Lead Data Engineer

As a Lead Data Engineer in our organization, you will play a crucial role in the data engineering team focused on on-premise solutions. Your responsibilities will include: - Designing, developing, and maintaining robust, scalable, and high-performance data pipelines and integration solutions. - Managing and optimizing data storage in Hadoop Distributed File System (HDFS). - Designing and implementing data workflows using Apache NiFi for data ingestion, transformation, and distribution. - Collaborating with cross-functional teams to understand data requirements and deliver efficient solutions. - Ensuring data quality, governance, and security standards are met within the on-premise infrastructure. - Monitoring and troubleshooting data pipelines to ensure optimal performance and reliability. - Automating data workflows and processes to enhance system efficiency. Qualifications required for this role: - Bachelor's degree in computer science, Software Engineering, or a related field. - 6+ years of experience in data engineering or a related field. - Strong programming skills in Python and SQL. - Hands-on experience with the Hadoop ecosystem (HDFS, Hive, etc.). - Proficiency in Apache NiFi for data ingestion and flow orchestration. - Experience in data modeling, ETL development, and data warehousing concepts. - Strong problem-solving skills and ability to work independently in a fast-paced environment. - Good understanding of data governance, data security, and best practices in on-premise environments. If you are exploring new opportunities in a development role, we would love to connect with you. Apply here: [Apply here](https://surl.li/zuztce),