Category: TechnologyLocation:Shuru is a self-managed technology team specializing in accelerating visions through product, technology, and AI leadership. With a focus on bespoke execution, we deliver impactful solutions that are scalable and designed for success. At Shuru, we deliver mobile solutions that meet and exceed customer expectations. Our collaborative and fast-paced environment encourages creativity and innovation.We are seeking a highly skilled Senior Data Engineer to join our engineering team. This role requires a hands-on professional who will design, build, and maintain robustdata pipelines that power our product, analytics and machine learning initiatives. You'll work closely with cross-functional teams to ensure data quality, reliability, andaccessibility across our platform.
Responsibilities
- Design and implement scalable data pipelines for ingestion, validation, cleanup, and normalization
- Build and maintain ETL/ELT processes to support both batch and real-time data processing
- Develop data quality frameworks and monitoring systems to ensure data integrity
- Optimize pipeline performance and troubleshoot data flow issues Deploy and manage data infrastructure on AWS and GCP platforms
- Implement Infrastructure as Code (IaC) using Terraform for reproducible
- deployments
- Design and maintain data lakes, data warehouses, and streaming architectures
- Ensure security, compliance, and cost optimization across cloud resources
- Implement event-driven architectures using technologies like Kafka, Kinesis, or Pub/Sub
Requirements
Technical Skills5+ years of experience in data engineering or related fieldHands-on experience with data pipeline development and maintenanceStrong proficiency in Python, SQL, and at least one other programming language(Java, Scala, Go)Extensive experience with AWS services (S3, Redshift, EMR, Kinesis, Lambda, Glue)Solid experience with GCP services (BigQuery, Dataflow, Pub/Sub, Cloud Storage)Proven experience with Infrastructure as Code using TerraformStrong background in streaming technologies (Apache Kafka, Amazon Kinesis, Google Pub/Sub)Data Technologies
- Experience with data processing frameworks (Apache Spark, Apache Beam, Airflow)
- Proficiency with data warehousing solutions (Redshift, BigQuery, Snowflake)
- Knowledge of NoSQL databases (MongoDB, Cassandra, DynamoDB)
- Familiarity with containerization (Docker, Kubernetes)
- Experience with monitoring and observability tools (CloudWatch, Stackdriver, Datadog)
Benefits
Benefits:
- Competitive salary and benefits package.
- Opportunity to work with a team of experienced product and tech leaders.
- A flexible work environment with remote working options.
- Continuous learning and development opportunities.
- Chance to make a significant impact on diverse and innovative projects
Details
