Technical Manager - Data Engineering at Zuci Systems

Technical Manager, Data Engineering

Location

Experience

Employment

Role Description:

Responsibilities

• Define and champion the strategic direction for data engineering, staying abreast of industry trends and emerging technologies.
  
• Lead, mentor, and develop a high-performing team of data engineers, fostering a culture of technical excellence, innovation, and continuous learning.
  
• Design, implement, and maintain scalable, reliable, and secure data pipelines and infrastructure. Ensure data quality, integrity, and accessibility.
  
• Oversee the end-to-end delivery of data engineering projects, ensuring timely completion, adherence to best practices, and alignment with business objectives.
  
• Partner closely with pre-sales, sales, marketing, Business Intelligence, Data Science, and other departments to understand data needs, propose solutions, and support resource deployment for active data projects.
  
• Evaluate, recommend, and implement new data engineering tools, platforms, and methodologies to enhance capabilities and efficiency.
  
• Identify and address performance bottlenecks in data systems, ensuring optimal data processing and storage.
  

Tools & Technologies

• Cloud Platforms

  : AWS (S3, Glue, EMR, Redshift, Athena, Lambda, Kinesis), Azure (Data Lake Storage, Data Factory, Databricks, Synapse Analytics), Google Cloud Platform (Cloud Storage, Dataflow, Dataproc, BigQuery).

• Big Data Frameworks

  : Apache Spark, Apache Flink, Apache Kafka, HDFS

• Data Warehousing/Lakes:

  Snowflake, Databricks Lakehouse, Google BigQuery, Amazon Redshift, Azure Synapse Analytics.

• ETL/ELT Tools

  : Apache Airflow, Talend, Informatica, DBT, Fivetran, Stitch.

• Data Modeling

  : Star Schema, Snowflake Schema, Data Vault.

• Databases

  : PostgreSQL, MySQL, MongoDB, Cassandra, DynamoDB.

• Programming Languages:

  Python (Pandas, PySpark), Scala, Java.

• Containerization/Orchestration

  : Docker, Kubernetes.

• Version Control

  : Git.