Data Engineer

Job Title: Data Engineer

Role Overview:

We are seeking a skilled and motivated Data Engineer to design, develop, and maintain scalable data pipelines that process and transform large volumes of structured and unstructured data. The ideal candidate will have a strong background in data engineering, cloud technologies, and data architecture, and will collaborate closely with data scientists, analysts, and business teams to deliver high-quality data solutions.

Key Responsibilities:

• Design and implement scalable data pipelines for processing structured and unstructured data.
• Build and maintain ETL/ELT workflows for data ingestion from diverse sources including APIs, databases, files, and cloud platforms.
• Ensure data quality, integrity, and governance across all data pipelines.
• Collaborate with cross-functional teams to understand and fulfill data requirements.
• Optimize data workflows for performance and reliability.

Required Skill Set:

Programming & Data Engineering:

• Python, PySpark, SQL
• CI/CD practices

Streaming & Orchestration:

• Kafka
• GCP Composer / Apache Airflow

Cloud Tools:

• Google Cloud Platform (Dataproc, BigQuery, Looker)

Data Architecture:

• Data Warehousing
• Data Modeling