Lead Data Engineer

Job Description

Job Title: Senior Data Engineer Experience: 10+ Years Location: Pune, India (Work from Office) Industry: EV / Automotive / Tech Employment Type: Full-time Job Summary: We are looking for a Senior Data Engineer with 10+ years of experience in data engineering, data pipeline development, and big data technologies. The ideal candidate will play a key role in designing, building, and maintaining scalable data solutions, ensuring data availability, integrity, and security for business insights. Key Responsibilities: Design, develop, and maintain highly scalable data pipelines for ingesting, processing, and analyzing large datasets. Optimize data models for efficient storage and retrieval in cloud-based and on-premises environments. Develop and maintain ETL/ELT processes using modern tools and frameworks. Work closely with data scientists, analysts, and business stakeholders to ensure data availability and quality. Implement data governance, security, and compliance best practices. Monitor system performance, troubleshoot issues, and optimize data workflows. Evaluate and recommend new technologies to improve data processing capabilities. Ensure smooth data integration across various systems, APIs, and third-party platforms. Required Skills & Experience: 10+ years of experience in Data Engineering with expertise in handling large-scale datasets. Proficiency in SQL, Python, and Spark for data processing and transformation. Strong experience with Cloud Platforms (AWS, Azure, or GCP) for data engineering solutions. Expertise in Big Data technologies such as Hadoop, Apache Spark, Kafka, and Snowflake. Hands-on experience with ETL/ELT development and workflow automation tools like Apache Airflow, dbt, or similar. Experience with data warehousing concepts and solutions like Redshift, BigQuery, or Snowflake. Strong knowledge of data modeling, data architecture, and database design (relational and NoSQL). Experience working with real-time streaming data and processing frameworks like Apache Kafka or Flink. Familiarity with CI/CD pipelines for data engineering solutions. Strong problem-solving skills and ability to work in a fast-paced environment. Nice-to-Have Skills: Knowledge of Machine Learning and AI-driven data solutions. Experience with Graph Databases and Time-Series Databases. Familiarity with DataOps methodologies. Education & Certifications: Bachelor's or Masters degree in Computer Science, Engineering, or a related field. Relevant certifications in Cloud Data Engineering (AWS, Azure, GCP) are a plus.