Python Data Engineering

Job Description

About The Opportunity A leading player in the data engineering sector, we specialize in developing and implementing robust data solutions that drive business intelligence and optimize data workflows. Our focus is on harnessing the power of Python to architect data pipelines that empower organizations to make data-driven decisions. Role & Responsibilities Design, develop, and maintain efficient and reliable data pipelines using Python and associated frameworks. Implement ETL processes to extract, transform, and load data from various sources into structured formats. Optimize existing data flows and troubleshoot data pipeline issues to enhance performance and reliability. Collaborate with data analysts and scientists to understand business requirements and translate them into technical solutions. Document and maintain data engineering best practices, ensuring clean code and adherence to industry standards. Monitor data quality and implement testing strategies to ensure the integrity of data across pipelines. Skills & Qualifications Must-Have Proficiency in Python programming, with a strong understanding of data structures and algorithms. Hands-on experience in building and managing data pipelines. Solid understanding of SQL and experience with relational databases. Familiarity with data modeling and schema design principles. Experience with API integration for data sourcing and consumption. Preferred Experience with cloud platforms such as AWS, Azure, or Google Cloud. Knowledge of data visualization tools to represent data insights effectively. Understanding of Linux scripting for data manipulation tasks. Benefits & Culture Highlights Dynamic work environment fostering innovation and continuous learning. Collaborative team culture with opportunities for professional growth. Attractive compensation package and performance-based incentives. Skills: cloud platforms (aws, azure, google cloud),numpy,pandas,cloud services,sql,data pipeline management,data modeling,data visualization,linux scripting,python,data engineering,api integration Show more Show less