Data Engineer

Job Description

Job Title: Data Engineer Location: [Gurugram Experience: [3-8 years] Job Type: [Full-time ] About the Role We are looking for a skilled Data Engineer to join our team. The ideal candidate will have hands-on experience designing, building, and maintaining scalable data pipelines using PySpark, SQL, and cloud technologies like AWS and Snowflake. You will work closely with data scientists, analysts, and other stakeholders to deliver reliable, high-performance data solutions. Key Responsibilities Design, develop, and optimize scalable ETL/ELT pipelines using PySpark and SQL for processing large datasets. Build and maintain data warehouses and data lakes on Snowflake and AWS. Implement data ingestion, transformation, and integration from diverse sources. Collaborate with cross-functional teams to understand data requirements and deliver solutions. Monitor and troubleshoot pipeline performance, ensuring data quality and reliability. Automate data workflows and optimize data storage for cost and efficiency. Stay up-to-date with industry best practices and emerging technologies in data engineering. Required Skills & Qualifications Strong experience with PySpark for big data processing and ETL pipeline development. Proficient in writing complex SQL queries and optimizing them for performance. Hands-on experience with AWS services such as S3, Glue, Lambda, EC2, and Redshift. Expertise in designing and managing data warehousing solutions using Snowflake . Familiarity with data modeling, schema design, and data governance. Experience with version control systems (e.g., Git) and CI/CD pipelines. Strong problem-solving skills and attention to detail. Excellent communication and collaboration skills. Preferred Qualifications Experience with orchestration tools like Apache Airflow. Knowledge of Python scripting beyond PySpark. Understanding of data security and compliance standards. Experience with containerization tools like Docker and Kubernetes. Education Bachelors or Master’s degree in Computer Science, Engineering, Information Systems, or a related field.