Data Science Engineer

RoleData Science EngineerDivision/BusinessGro Digital Platforms Limited

• Design, build, and maintain scalable and efficient data pipelines for structured and unstructured data.
• Develop ETL processes to ingest data from various sources, ensuring data quality, consistency, and security.
• Work closely with data scientists and analysts to prepare data for analytics and machine learning applications.
• Manage and optimize data warehouses, data lakes, and real-time data streaming environments.
• Python skills are a must-have for building and maintaining robust data pipelines and automating tasks.
• Experience with frameworks like FastAPI is a plus, as it enhances the ability to build high-performance, scalable APIs for data integration and real-time processing.
• Knowledge of LLM (Large Language Models) is a plus, with the ability to leverage these technologies for enhanced data solutions.
• Implement data governance, cataloging, and lineage strategies across systems.
• Monitor data pipeline health and perform root cause analysis on any issues.
• Collaborate with cross-functional teams to understand data requirements and deliver actionable solutions.
• Promote best practices for data management, engineering, and automation within the team.
• Support data migration, transformation, and integration between platforms.
• Stay current with emerging technologies and trends in big data, analytics, and cloud ecosystems

Skills and Qualifications:

• Bachelors degree in Computer Science, Engineering, or a related field. A Masters degree is preferred.
• At least 2+ years of experience in data engineering or analytics engineering.
• Proficiency in SQL and experience with relational databases such as PostgreSQL or MySQL.
• Experience with NoSQL databases such as MongoDB, Terra.
• Strong knowledge of big data tools and platforms (e.g, Kafka Spark, Airflow).
• Expertise in data pipeline orchestration tools such as Apache Airflow.
• Experience with data modeling, warehousing, and performance tuning.
• Familiarity with analytics and BI tools like Metabase or Power BI.
• Strong programming skills in Python or Scala for data processing tasks.
• Understanding of data security, privacy regulations (e.g., GDPR), and best practices.
• Excellent problem-solving, analytical, and communication skills.
• Exposure to machine learning pipelines or experience supporting data science teams is a plus.