Sr. System Engineer-IMS

Job Summary

Band ‿ U3 Location ‿ HYD JD ‿ see below Roles and Responsibilities: Develop and maintain data pipelines and data storage solutions using GCP. Experience in Google Cloud Platform including but not limited to BigQuery, Cloud Storage, Cloud Composer, Dataflow, Pub/Sub, Cloud Functions and IAM. Developing DAGs in Apache Airflow using various Operators. Implementing data integration solutions using GCP services. Maintain ETLs operating on a variety of sources. Hands On with advanced SQL on BiqQuery Data Warehousing and ability to execute queries quickly. Knowledge in CI/CD is desirable. Proficiency in Python programming and Unix scripting. Knowledgeable in CICD processes ‿ GitHub, cloud build, terraform etc. Development and implementation of data security and privacy measures to protect sensitive data. Handling real time data and API based ingestion. Knowledge of data warehousing and data modeling concepts. Collaborate within the development and the testing teams to implement solutions that meet business requirements. Write and maintain technical documentation wherever necessary. Strong analytical and problem solving skills. Good communication and collaboration skills. Experience working in Agile/Scrum environments. Model Deployment and Management: Deploy machine learning models on Google Cloud's Vertex AI platform, managing model versions and ensuring robust model lifecycle management. Infrastructure as Code (IAC): Utilize Terraform to define and provision GCP infrastructure components required for machine learning workloads, ensuring infrastructure consistency and version control. Pipeline Automation: Design, develop, and maintain automated ML pipelines that encompass data preprocessing, model training, evaluation, and deployment using Terraform and other relevant tools. Monitoring and Optimization: Implement comprehensive monitoring and alerting solutions for both ML models and underlying infrastructure. Continuously optimize ML workloads for cost efficiency and performance.