Senior Data Engineer

What You''ll Do

You will be part of our Data Platform & Product Insights data engineering team. As part of this agile team, you will work in our cloud native environment to

• Build & support data ingestion and processing pipelines in cloud. This will entail extraction, load and transformation of big data from a wide variety of sources, both batch & streaming, using latest data frameworks and technologies
• Partner with product team to assemble large, complex data sets that meet functional and non-functional business requirements, ensure build out of Data Dictionaries/Data Catalogue and detailed documentation and knowledge around these data assets, metrics and KPIs.
• Warehouse this data, build data marts, data aggregations, metrics, KPIs, business logic that leads to actionable insights into our product efficacy, marketing platform, customer behaviour, retention etc.
• Build real-time monitoring dashboards and alerting systems.
• Coach and mentor other team members.

Who you are

• 6 to 8 years of experience in Big Data and Data Engineering.
• Strong knowledge of advanced SQL, data warehousing concepts and DataMart designing.
• Have strong programming skills in SQL, Python etc.
• Experience in design and development of data pipeline, ETL/ELT process on-premises/cloud.
• Experience in one of the Cloud providers GCP, Azure, AWS.
• Experience with relational SQL and NoSQL databases, including Postgres.
• Experience workflow management tools: AWS data pipeline, Google Cloud Composer etc.
• Experience with Distributed Versioning Control environments such as GIT, Azure DevOps
• Building Docker images and fetch/promote and deploy to Production. Integrate Docker container orchestration framework, config Maps, deployments using terraform.
• Should be able to convert business queries into technical documentation.
• Strong problem solving and communication skills.
• Bachelors or an advanced degree in Computer Science or related engineering discipline.

Good to have some exposure to

• Exposure to any Business Intelligence (BI) tools like Tableau, Dundas, Power BI etc.
• Agile software development methodologies.
• Working in multi-functional, multi-location teams

Hybrid Model: twice a week work from office

Shift Time: 12 pm to 9 pm IST .