Gcp Data Engineer Tata Consultancy Services

7.0 - 10.0 years

0 Lacs

Pune, Chennai, Bengaluru

Work from Office

As a GCP data engineer the colleague should be able to designs scalable data architectures on Google Cloud Platform, using services like Big Query and Dataflow. They write and maintain code (Python, Java), ensuring efficient data models and seamless ETL processes. Quality checks and governance are implemented to maintain accurate and reliable data. Security is a priority, enforcing measures for storage, transmission, and processing, while ensuring compliance with data protection standards. Collaboration with cross-functional teams is key for understanding diverse data requirements. Comprehensive documentation is maintained for data processes, pipelines, and architectures. Responsibilities extend to optimizing data pipelines and queries for performance, troubleshooting issues, and proactively monitoring data accuracy. Continuous learning is emphasized to stay updated on GCP features and industry best practices, ensuring a current and effective data engineering approach. Experience - Proficiency in programming languages: Python, Pyspark - Expertise in data processing frameworks: Apache Beam (Data Flow) - Active experience on GCP tools and technologies like Big Query, Dataflow, Cloud Composer , Cloud Spanner, GCS, DBT etc., - Data Engineering skillset using Python, SQL - Experience in ETL (Extract, Transform, Load) processes - Knowledge of DevOps tools like Jenkins, GitHub, Terraform is desirable. Should have good knowledge on Kafka (Batch/ streaming) - Understanding of Data models and experience in performing ETL design and build, database replication using Message based CDC - Familiarity with cloud storage solutions - Strong problem-solving abilities in data engineering challenges - Understanding of data security and scalability - Proficiency in relevant tools like Apache Airflow Desirables Knowledge of data modelling and database design Good understanding of Cloud Security Proven practical experience of using the Google Cloud SDK to deliver APIs and automation Crafting continuous integration and continuous delivery/deployment tooling pipelines (Jenkins/Spinnaker)

Posted 3 months ago

Apply

Java Developer Steady Rabbit

6.0 - 9.0 years

0 Lacs

bengaluru

Work from Office

Java Developer Location -Bangalore Exp -6-9 Years OpenQualification -BE/B.Tech/ME/M.Tech Responsibilities and Duties: Design, develop and maintain backend infrastructure, workflows, and services for enabling easy to use solutions for Customer Support organizations within service providers. Develop solutions to support onboarding, partner integrations, managing, collecting, and analyzing data from large scale deployment of home networks and make them available as actionable insights. Work closely with Cloud product owners to understand, analyze product requirements, provide feedback, and deliver a complete solution. Technical leadership of software design in meeting requirements of service stability, reliability, scalability, and security Participate and drive technical discussions within engineering group in all phases of the SDLC: review requirements, produce design documents, participate in peer reviews, produce test plans, support QA team, provide internal training and support TAC team. Support test strategy and automation in both end-to-end solution and functional testing. Customer facing engineering role in debugging and resolving field issues. Qualifications: 6+ years of highly technical, hands-on software engineering experience Strong background in designing and developing event-based / pub-sub workflows & data ingestion solutions. Proficiency and hands on experience with Kafka at scale (or similar) desired. Good understanding of Layer 2 Independent and Self driven and works in a Team. Strong, creative problem-solving skills and ability to abstract and share details to create meaningful articulation. Ability to drive technical discussions across x-functional teams. Proficient in design and implementation of microservices-based, API/Endpoint architectures and Layer 3 protocols. Working experience of any of the workflow technology like Air Flow or Camunda. Good understanding of implementation and deployment of Cloud based solutions (preferably GCP) Strong background in transactional databases and good understanding and experience with no-SQL datastores. Expert in Java. Proficiency in other languages like Go, Python, NodeJS/JavaScript a plus. Organized and goal-focused, ability to deliver in a fast-paced environment.

Posted Date not available

Apply

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.