Data Engineer

TechMango Technology Services is a leading software development company founded in 2014, specializing in delivering strategic solutions aligned with business partners" technological needs. Recognized as the Best Offshore Software Development Company in India, TechMango operates in the USA, UAE, and India, offering high-quality and cost-efficient services while fostering long-term client relationships. TechMango is currently seeking a Technical GCP Data Engineer with expertise in real-time streaming data architectures to join their team. As a Technical GCP Data Engineer, your role will involve designing, building, and optimizing data pipelines in the Google Cloud Platform (GCP) environment. The ideal candidate will have a strong architectural vision and be hands-on in building scalable, low-latency streaming data pipelines using Pub/Sub, Dataflow (Apache Beam), and BigQuery. **Key Responsibilities:** - Architect and implement end-to-end streaming data solutions on GCP using Pub/Sub, Dataflow, and BigQuery. - Design real-time ingestion, enrichment, and transformation pipelines for high-volume event data. - Collaborate with stakeholders to understand data requirements and translate them into scalable designs. - Optimize streaming pipeline performance, latency, and throughput. - Build and manage orchestration workflows using Cloud Composer (Airflow). - Drive schema design, partitioning, and clustering strategies in BigQuery for real-time and batch datasets. - Define SLAs, monitoring, logging, and alerting for streaming jobs using Cloud Monitoring, Error Reporting, and Stackdriver. - Ensure robust security, encryption, and access controls across all data layers. - Collaborate with DevOps for CI/CD automation of data workflows using Terraform, Cloud Build, and Git. - Document streaming architecture, data lineage, and deployment runbooks. **Required Skills & Experience:** - 5+ years of experience in data engineering or architecture. - 2+ years of hands-on GCP data engineering experience. - Strong expertise in Google Pub/Sub, Dataflow (Apache Beam), BigQuery, Cloud Composer (Airflow), and Cloud Storage (GCS). - Solid understanding of streaming design patterns, exactly-once delivery, and event-driven architecture. - Deep knowledge of SQL and NoSQL data modeling. - Experience with monitoring and performance tuning of streaming jobs. - Experience using Terraform or equivalent for infrastructure as code. - Familiarity with CI/CD pipelines for data workflows. TechMango offers a dynamic work environment and the opportunity to work with cutting-edge technologies in digital transformation solutions. For more information, visit their website at [TechMango](https://www.techmango.net).,