Data Engineer

Sundew is a leading digital transformation firm with an 18-year legacy of excellence. We specialize in digital strategy, application development, and engineering, utilizing MEAN, MERN, and LAMP stacks, with PHP Laravel as our primary proficiency. As we continue to expand, we are seeking a skilled and experienced Data Engineer to design and optimize data pipelines, support data-driven initiatives, and contribute to the growth of our organization.

Roles and Responsibilities:

• Data Pipeline Development:

  Design, develop, and maintain scalable data pipelines to support ETL (Extract, Transform, Load) processes using tools like Apache Airflow, AWS Glue, or similar.

• Database Management:

  Design, optimize, and manage relational and NoSQL databases (such as MySQL, PostgreSQL, MongoDB, or Cassandra) to ensure high performance and scalability.

• SQL Development:

  Write advanced SQL queries, stored procedures, and functions to extract, transform, and analyze large datasets efficiently.

• Cloud Integration:

  Implement and manage data solutions on cloud platforms such as AWS, Azure, or Google Cloud, utilizing services like Redshift, BigQuery, or Snowflake.

• Data Warehousing:

  Contribute to the design and maintenance of data warehouses and data lakes to support analytics and BI requirements.

• Programming and Automation:

  Develop scripts and applications in Python or other programming languages to automate data processing tasks.

• Data Governance:

  Implement data quality checks, monitoring, and governance policies to ensure data accuracy, consistency, and security.

• Collaboration:

  Work closely with data scientists, analysts, and business stakeholders to understand data needs and translate them into technical solutions.

• Performance Optimization:

  Identify and resolve performance bottlenecks in data systems and optimize data storage and retrieval.

• Documentation:

  Maintain comprehensive documentation for data processes, pipelines, and infrastructure.

• Stay Current:

  Keep up-to-date with the latest trends and advancements in data engineering, big data technologies, and cloud services.

Required Skills and Qualifications:

• Technical Skills:

• Proficiency in SQL and relational databases (PostgreSQL, MySQL, etc.).
• Experience with NoSQL databases (MongoDB, Cassandra, etc.).
• Strong programming skills in Python; familiarity with Java or Scala is a plus.
• Experience with data pipeline tools (Apache Airflow, Luigi, or similar).
• Expertise in cloud platforms (AWS, Azure, or Google Cloud) and data services (Redshift, BigQuery, Snowflake).
• Knowledge of big data tools like Apache Spark, Hadoop, or Kafka is a plus.

• Data Modeling:

  Experience in designing and maintaining data models for relational and non-relational databases.

• Analytical Skills:

  Strong analytical and problem-solving abilities with a focus on performance optimization and scalability.

• Soft Skills:

• Excellent verbal and written communication skills to convey technical concepts to non-technical stakeholders.
• Ability to work collaboratively in cross-functional teams.

• Education:

  Bachelor’s or Master’s degree in Computer Science, Information Technology,

Data Engineering, or a related field.

• Certifications (Preferred):

  AWS Certified Data Analytics, Google Professional Data Engineer, or similar.

• Mindset:

  Eagerness to learn new technologies and adapt quickly in a fast-paced environment.