What you will do
Role Description:
We are seeking an experienced Data Engineer for the development and implementation of our data strategy. The ideal candidate possesses a strong blend of technical expertise and data-driven problem-solving skills. As a Data Engineer, you will play a crucial role in building, and optimizing our data pipelines and platforms in a SAFE Agile product team.
Roles & Responsibilities:
- Contribute to the design, development, and implementation of data pipelines, ETL/ELT processes, and data integration solutions.
- Deliver for data pipeline projects from development to deployment, managing, timelines, and risks.
- Ensure data quality and integrity through rigorous testing and monitoring.
- Leverage cloud platforms (AWS preferred) to build scalable and efficient data solutions.
- Work closely with product team, and stakeholders to understand data requirements.
- Adhere to data engineering best practices and standards.
- Experience developing in an Agile development environment, and comfortable with Agile terminology and ceremonies.
- Familiarity with code versioning using GIT, Jenkins and code migration tools.
- Exposure to Jira or Rally.
- Stay up to date with the latest data technologies and trends.
What we expect of you
Basic Qualifications:
- Master's degree / bachelors degree in computer science STEM majors with 5 to 9 years of Information Systems experience
Must-Have Skills (Not more than 3 to 4):
- Demonstrated hands-on experience with cloud platforms (AWS, Azure, GCP)
- Proficiency in Python, PySpark, SQL. Hands on experience with ETL performance tuning.
- Development knowledge in Databricks.
- Good analytical and problem-solving skills to address complex data challenges.
Good-to-Have Skills:
- Experienced with data modeling and performance tuning for both OLAP and OLTP databases
- Experienced working with Apache Spark, Apache Airflow
- Experienced with software engineering best-practices, including but not limited to version control (Git, Subversion, etc.), CI/CD (Jenkins, Maven etc.), automated unit testing, and Dev Ops
- Familiarity with SQL/NOSQL database, vector database for large language models
- Familiarity with prompt engineering, model fine tuning
Professional Certifications (please mention if the certification is preferred or mandatory for the role):
- AWS Certified Data Engineer (preferred)
- Databricks Certification (preferred)
- Any SAFe Agile certification (preferred)
Soft Skills:
- Skilled in breaking down problems, documenting problem statements, and estimating efforts.
- Effective communication and interpersonal skills to collaborate with cross-functional teams.
- Excellent analytical and troubleshooting skills.
- Strong verbal and written communication skills
- Ability to work effectively with global, virtual teams
- High degree of initiative and self-motivation.
- Team-oriented, with a focus on achieving team goals
