Data Engineer-II

As a Data Engineer-II at TMRW House of Brands in Bengaluru, Karnataka, your role involves creating, implementing, and operating robust and scalable data pipelines for business intelligence and machine learning. You will be responsible for developing and maintaining core data framework and key infrastructures. Your key responsibilities include: - Creating and supporting the ETL pipeline to ensure correct data flow from existing and new sources to the data warehouse. - Designing the Data Warehouse and data modeling for efficient and cost-effective reporting. - Collaborating with data analysts, data scientists, and other data consumers to manage the data warehouse table structure and optimize it for reporting. - Defining and implementing Data Governance processes related to data discovery, lineage, access control, and quality assurance. - Performing code reviews and QA for data imported by various processes. Qualifications required for this role include: - 3-5 years of experience in data engineering. - At least 3+ years of experience in data infrastructure space with expertise in big data technologies like Hive, Spark, Pyspark (Batch and Streaming), Airflow, Redshift, and Delta Lake. - Experience in product-based companies or startups. - Strong understanding of data warehousing concepts and the data ecosystem. - Design/Architecture experience in architecting, developing, and maintaining solutions in AWS. - Experience in building and managing data pipelines, especially from business applications using APIs. - Previous experience in Databricks is a plus. - Working knowledge of BI Tools like Metabase and Power BI is beneficial. - Experience in architecting systems for data access is advantageous. Join TMRW House of Brands as a Data Engineer-II and be a part of a dynamic team focused on leveraging data for business intelligence and machine learning.,