Data Engineer

Title: Data Engineer

Location: Remote, India

Experience: 3 to 6 yrs

Responsibilities:

• Work as part of a team to develop and implement procedures for secure and effective data management.
• Implement data definitions, data mappings, and provide support across ongoing integration activities.
• Work collaboratively with our Product Owners and Software Engineering teams to understand and define application and platform data requirements.
• Demonstrate an in-depth understanding of database structures and principles.
• Be an advocate for the work done by the team and share achievements both at a technical and business level with the wider technology group.
• Translate non-technical requirements to technical requirements
• Provide clean, transformed data ready for analysis
• Maintain data documentation and definitions
• Train business users on how to use data visualisation tools

Required Technical Knowledge:

• 3-5 Years of Experience. Good working knowledge of AWS data analytics services (Kinesis, Redshift, DataDog)
• Experience with scripting languages such as Python
• Familiar with serverless, event-driven technology such as AWS Lambda
• Experience with AWS S3 bucket and AWS Glue
• Must have used Python for data processing. Building data, processing and data quality checks.
• Experience working with both SQL and NoSQL databases
• Familiar working with Gitlab CI/CD to support the deployment of applications across cloud infrastructure
• Good working knowledge of JIRA and Confluence
• Familiar working with cloud log management and monitoring data platforms
• Good understanding of Terraform
• The ability and appetite to learn and use a wide variety of open-source technologies and tools