GCP Data Engineer

4 - 8 years

0 Lacs

Posted:1 day ago| Platform: Shine logo

Apply

Work Mode

On-site

Job Type

Full Time

Job Description

As a Data Engineer at this company, your role will involve providing business analytics support to the Management team. You will be responsible for analyzing business results and conducting studies to gather relevant data. Additionally, you will design, build, and maintain data pipelines and ETL processes using Python as part of larger data platform projects. Collaboration with data scientists, analysts, and other stakeholders to understand data requirements and ensure data quality will be a key aspect of your responsibilities. Optimizing database performance, implementing data governance and security measures, monitoring data pipelines, troubleshooting issues, and developing documentation for data processes and workflows are also part of your duties. Key Responsibilities: - Provide business analytics support to the Management team - Analyze business results and conduct studies to collect relevant data - Design, build, and maintain data pipelines and ETL processes using Python - Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and ensure data quality - Optimize database performance, including indexing, partitioning, and query optimization - Implement data governance and security measures to protect sensitive data - Monitor data pipelines, troubleshoot issues, and perform data validation - Develop and maintain documentation for data processes and workflows Qualifications Required: - Proficiency in Python for data processing and scripting - Strong SQL knowledge and experience with relational databases (e.g., MySQL, PostgreSQL, SQL Server) - Understanding of data modeling, data warehousing, and data architecture - Experience with cloud platforms (e.g., AWS, Azure, Google Cloud) and their data services - Proficiency in working with GCP, especially BigQuery and Google Cloud Storage (GCS) - Version control skills using Git In addition to the key responsibilities and qualifications, it is a must-have for the candidate to possess expertise in Data Engineering, GCP (specifically BigQuery, GCS, Dataflow, Airflow), Python, SQL (MySQL/Postgres SQL/SQL), Data Modeling, Data Warehousing, Data Architecture, and Git. These skills are essential for success in this role.,

Mock Interview

Practice Video Interview with JobPe AI

Start Python Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

coding practice

Enhance Your Python Skills

Practice Python coding challenges to boost your skills

Start Practicing Python Now

RecommendedJobs for You

pune, maharashtra, india