Data Engineer

Strong on programming languages like Python, Java
Must have one cloud hands-on experience (GCP preferred)Must have: Experience working with DockersMust have: Environments managing (e.g venv, pip, poetry, etc.)Must have: Experience with orchestrators like Vertex AI pipelines, Airflow, etcMust have: Data engineering, Feature Engineering techniquesProficient in either Apache Spark or Apache Beam or Apache FlinkMust have: Advance SQL knowledgeMust be aware of Streaming concepts like Windowing , Late arrival , Triggers etcShould have hands-on experience on Distributed computingShould have working experience on Data Architecture designShould be aware of storage and compute options and when to choose whatShould have good understanding on Cluster Optimisation/ Pipeline Optimisation strategiesShould have exposure on GCP tools to develop end to end data pipeline for various scenarios (including ingesting data from traditional data bases as well as integration of API based data sources).Should have Business mindset to understand data and how it will be used for BI and Analytics purposes.Should have working experience on CI/CD pipelines, Deployment methodologies, Infrastructure as a code (eg. Terraform)Good to have, Hands-on experience on KubernetesGood to have Vector based Database like QdrantExperience in Working with GCP tools like:Storage : CloudSQL , Cloud Storage, Cloud Bigtable, Bigquery, Cloud Spanner, Cloud DataStore, Vector databaseIngest : Pub/Sub, Cloud Functions, AppEngine, Kubernetes Engine, Kafka, Micro servicesSchedule : Cloud Composer, AirflowProcessing: Cloud Dataproc, Cloud Dataflow, Apache Spark, Apache FlinkCI/CD : Bitbucket+Jenkinjs / Gitlab ,Infrastructre as a tool : Terraform

Locations : Mumbai, Delhi / NCR, Bengaluru , Kolkata, Chennai, Hyderabad, Ahmedabad, Pune, Remote