Data Engineer

5.0 years

0.0 Lacs P.A.

Chennai, Tamil Nadu, India

Posted:1 week ago| Platform: Linkedin logo

Apply Now

Skills Required

dataetlpythonsqldesignprocessingrelationalpostgresqloraclestorageretrievalloggingmonitoringengineeringcodedatabasetuningqueryoptimizationazureawsgcppysparkdeploymentautomation

Work Mode

On-site

Job Type

Full Time

Job Description

Responsibilities Develop and optimize ETL workflows using Python and SQL. Design and implement scalable data pipelines for processing various data sources. Work with relational databases (e.g., PostgreSQL, Oracle) to ensure efficient data storage and retrieval. Optimize SQL queries and Python scripts for performance and maintainability. Implement robust error handling, logging, and monitoring for data processing pipelines. Collaborate with cross-functional teams to integrate and manage data sources. Requirements 5+ years of experience in Data Engineering. Expert-level Python and SQL skills – ability to write efficient, scalable, and maintainable code. Strong experience in designing ETL processes and working with large datasets. Solid understanding of database performance tuning and query optimization. Experience with data modeling and schema design. Familiarity with cloud storage solutions (Azure, AWS, or GCP). Strong problem-solving skills and ability to work independently. Nice to have: Experience with PySpark, orchestrators and knowledge of CI/CD for deployment process automation. Show more Show less

IT Services and IT Consulting
Newark Delaware +6

RecommendedJobs for You

Hyderabad, Pune, Bengaluru