Data Engineer

Role Overview: As an Apache Superset Data Engineer, you will play a crucial role in the design, development, and maintenance of scalable data pipelines and analytics infrastructure. Your primary focus will be on data visualization and dashboarding using Apache Superset, bridging the gap between data engineering and business intelligence. By creating intuitive dashboards and reports, you will empower stakeholders to access accurate and actionable insights efficiently. Key Responsibilities: - Create, customize, and maintain interactive dashboards in Apache Superset to support key performance indicators (KPIs), experimentation, and business insights. - Collaborate with analysts, BI teams, and business users to gather requirements and deliver effective visualizations. - Conduct data validation, feature engineering, and exploratory data analysis to ensure data accuracy and integrity. - Analyze A/B test results and provide insights to inform business strategies. - Establish and maintain standards for statistical testing, data validation, and analytical workflows. - Integrate Superset with various database systems such as MySQL or PostgreSQL and manage associated drivers and connections. - Ensure secure, scalable, and high-performing Superset deployments. Qualification Required: - Proven expertise in building dashboards and visualizations using Apache Superset. - Strong command of SQL, experience with relational databases. - Proficiency in Python (or Java) for data manipulation. - Solid understanding of data modeling, ETL/ELT pipelines, and data warehousing principles. - Bachelor's degree in Computer Science, Engineering, or a related field. - Minimum of 3 years of relevant experience. Additional Details: Communication is vital in this role, as you will need to clearly convey findings and recommendations to both technical and non-technical stakeholders. Problem-solving skills, attention to data quality and detail, and the ability to simplify complex technical concepts for non-technical audiences are essential. Nice-to-have qualifications include familiarity with cloud platforms like AWS and ECS.,