Hadoop Developer

As a Hadoop Developer, you will be responsible for developing a semantic model in the data lake to centralize transformation workflows currently managed in Qlik. Your expertise in data modeling, ETL pipeline development, and performance optimization will play a crucial role in enabling seamless data consumption for analytics and reporting purposes. Your key responsibilities will include translating Qlik-specific transformation logic into Hadoop/Impala-based processing, developing modular and reusable transformation layers to enhance scalability and flexibility, optimizing the semantic layer for high performance, and ensuring seamless integration with dashboarding tools. Additionally, you will design and implement ETL pipelines using Python to streamline data ingestion, transformation, and storage processes. Collaboration with data analysts, BI teams, and business stakeholders will be essential to align the semantic model with reporting requirements. Furthermore, you will be responsible for monitoring, troubleshooting, and enhancing data processing workflows to ensure reliability and efficiency. The ideal candidate for this position will possess strong experience in Hadoop, Impala, and distributed data processing frameworks. Proficiency in Python for ETL pipeline development and automation is required, along with a good command of SQL and performance tuning for large-scale datasets. Knowledge of data modeling principles and best practices for semantic layers, familiarity with Qlik transformation logic, and the ability to translate it into scalable processing are also essential. Additionally, familiarity with big data performance tuning and optimization strategies, strong problem-solving skills, and the ability to work in a fast-paced environment are key qualifications for this role. If you have the required skills and qualifications and are interested in this opportunity, please forward your updated resume to vidhya@thinkparms.in.,