Data Engineer

Requirements

Data Engineering & Analytics

• Design and maintain robust ETL pipelines for structured and unstructured data
• Develop and optimize data lakes and warehouses using platforms such as Databricks, Azure Synapse, Snowflake, BigQuery, or Redshift
• Ensure data quality, governance, and performance optimization across systems
• Implement both batch and real-time data processing solutions using Spark, Kafka, or Hadoop
• Translate business requirements into data models, metrics, and dashboards
• Build interactive dashboards and visualizations using Power BI, Tableau, or Looker
• Conduct exploratory data analysis and develop reports using Python and SQL
• Collaborate with data science teams to prepare and deliver structured data for AI/ML models
  

Collaboration & Documentation

• Work closely with engineering, product, and business teams to align on key KPIs and analytics requirements
• Document data workflows, models, and analysis outputs for transparency and reuse
  

Required Skills & Expertise

• Programming: Proficiency in Python (Pandas, NumPy, PySpark) and SQL
• ETL & Workflow Orchestration: Hands-on experience with Airflow, dbt, Azure Data Factory
• Data Platforms: Deep understanding of Databricks, Synapse, Snowflake, BigQuery, Redshift, and cloud storage systems (S3, ADLS, GCS)
• Big Data Technologies: Working knowledge of Spark, Hadoop, and Kafka
• Visualization Tools: Expertise in Power BI, Tableau, or Looker
• Cloud Ecosystems: Experience with AWS, Azure, or GCP
• Strong foundation in data modeling (Star/Snowflake schemas) and query optimization
• Analytical mindset with a focus on solving business problems using data
  

Preferred / Good-to-Have Skills

• Experience with MLOps and machine learning pipelines (Databricks, Azure ML)
• Exposure to API-based integrations and microservices data flows
• Familiarity with CI/CD, Git, and DevOps practices
• Understanding of data security, compliance, and governance frameworks (GDPR, HIPAA)
• Strong communication skills with the ability to simplify complex data insights for business stakeholders