Lenskart - Data Engineer - ETL/Python

As a Data Engineer, you will be responsible for building and maintaining scalable ETL/ELT data pipelines using Python and cloud-native tools. You will design and optimize data models and queries on Google BigQuery for analytical workloads. Additionally, you will develop, schedule, and monitor workflows using orchestration tools like Apache Airflow or Cloud Composer. Your role will involve ingesting and integrating data from multiple structured and semi-structured sources such as MySQL, MongoDB, APIs, and cloud storage. It will be essential to ensure data integrity, security, and quality through validation, logging, and monitoring systems. Collaboration with analysts and data consumers to understand requirements and deliver clean, usable datasets will also be a key aspect of your responsibilities. Moreover, you will implement data governance, lineage tracking, and documentation as part of platform hygiene. You should possess 1 to 7 years of experience in data engineering or backend development. Strong experience with Google BigQuery and GCP (Google Cloud Platform) is a must-have skill for this role. Proficiency in Python for scripting, automation, and data manipulation is essential. A solid understanding of SQL and experience with relational databases like MySQL is required. Experience working with MongoDB and semi-structured data (e.g., JSON, nested formats), exposure to data warehousing, data modeling, and performance tuning, as well as familiarity with Git-based version control and CI/CD practices are also preferred skills for this position.,