Job
Description
Job Description: We are looking for a highly skilled and experienced Data Engineer with 4โ6 years of hands-on experience in designing and implementing robust, scalable data pipelines and infrastructure. The ideal candidate will be proficient in SQL and Python and have a strong understanding of modern data engineering practices. You will play a key role in building and optimizing data systems, enabling data accessibility and analytics across the organization, and collaborating closely with cross-functional teams including Data Science, Product, and Engineering. Key Responsibilities: ยท Design, develop, and maintain scalable ETL/ELT data pipelines using SQL and Python ยท Collaborate with data analysts, data scientists, and product teams to understand data needs ยท Optimize queries and data models for performance and reliability ยท Integrate data from various sources, including APIs, internal databases, and third-party systems ยท Monitor and troubleshoot data pipelines to ensure data quality and integrity ยท Document processes, data flows, and system architecture ยท Participate in code reviews and contribute to a culture of continuous improvement Required Skills: ยท 4โ6 years of experience in data engineering, data architecture, or backend development with a focus on data ยท Strong command of SQL for data transformation and performance tuning ยท Experience with Python (e.g., pandas, Spark, ADF) ยท Solid understanding of ETL/ELT processes and data pipeline orchestration ยท Proficiency with RDBMS (e.g., PostgreSQL, MySQL, SQL Server) ยท Experience with data warehousing solutions (e.g., Snowflake, Redshift, BigQuery) ยท Familiarity with version control (Git), CI/CD workflows, and containerized environments (Docker, Kubernetes) ยท Basic Programming Skills ยท Excellent problem-solving skills and a passion for clean, efficient data systems Preferred Skills: ยท Experience with cloud platforms (AWS, Azure, GCP) and services like S3, Glue, Dataflow, etc. ยท Exposure to enterprise solutions (e.g., Databricks, Synapse) ยท Knowledge of big data technologies (e.g., Spark, Kafka, Hadoop) ยท Background in real-time data streaming and event-driven architectures ยท Understanding of data governance, security, and compliance best practices ยท Prior experience working in agile development environment Educational Qualifications: Bachelor's degree in Computer Science, Information Technology, or a related field. Show more Show less
