Lead Data Engineer

Job Title: Senior Data Engineer

Location: Navi Mumbai

Experience: 6+ years

What you’ll do…

• Be a key member of our Technology Consulting team helping our clients in addressing their business challenges by participating in designing and developing their customer data analytics solutions.
• Analyse business/functional requirements, review the cloud-based solution architecture for ETL projects and develop the technical cloud-based architecture and design.
• Work on the data from latest channels and avenues of customer interaction (e.g. cloud based/mobile solutions/social media/web logs along with the traditional data sources like CRM, Marketing automation) to derive customer insight and analytics.
• Design, build and test the cloud-based integration solution in collaboration with onsite/offshore team members. Deploy the solution on a high-availability shared service cloud-based production environment.
• Perform code reviews and ensure that the solution is aligned to pre-defined architectural standards, guidelines, best practices, and meet the quality standards.

You’ll do it using…

• Expertise of data integration methodologies with experience on different cloud-based data integration technologies such as DBT / Azure Data Factory / Google Cloud Data Fusion and Databricks utilizing techniques on data pipelines, APIs, Microservices within GCP and/or Azure.
• Experience of programming languages (Python) pertaining to data engineering.
• Experience working with cloud-based SQL/NoSQL databases, data warehouses and data lakes like Snowflake, Azure Data Lake Storage (ADLS), Google Cloud Storage (GCS), Azure Synapse Analytics, and Google BigQuery.
• Expertise on GCP and/or Azure platforms and components including Google BigQuery, Cloud Functions, Cloud Dataflow, Cloud Storage, Azure Synapse Analytics, Azure Functions, Azure Data Factory, and Azure Data Lake Storage (ADLS).