Data Engineer:
Location: Chennai, India or Hyderabad, India Workplace Type: Hybrid
About the Role:
We are seeking a highly motivated and experienced Data Engineer to join our dynamic team. In this role, you will be responsible for designing, building, and maintaining our data infrastructure on Google Cloud Platform (GCP). You will work closely with data scientists, analysts, and other engineers to ensure the availability, reliability, and scalability of our data pipelines. The ideal candidate will have a strong background in Python programming, GCP services, and data warehousing concepts. You should be comfortable working in a fast-paced environment and have a passion for solving complex data challenges. This position offers an excellent opportunity to contribute to a growing organization and make a significant impact on our data-driven decision-making processes. You will be involved in the full lifecycle of data projects, from requirements gathering to deployment and monitoring. We are looking for someone who is proactive, detail-oriented, and has excellent communication skills. If you are a talented Data Engineer with a passion for GCP and Python, we encourage you to apply.
Key Responsibilities:
- Design, develop, and maintain data pipelines using Python and GCP services (e.g., Dataflow, Dataproc, BigQuery).
- Build and maintain data warehouses and data lakes on GCP.
- Implement data quality checks and monitoring to ensure data accuracy and reliability.
- Collaborate with data scientists and analysts to understand their data needs and provide solutions.
- Optimize data pipelines for performance and scalability.
- Automate data ingestion, transformation, and loading processes.
- Develop and maintain documentation for data pipelines and data models.
- Troubleshoot and resolve data-related issues.
- Stay up-to-date with the latest GCP services and data engineering best practices.
- Participate in code reviews and contribute to the improvement of our data engineering processes.
Required Skills & Qualifications:
- Bachelor's degree in Computer Science, Engineering, or a related field.
- 5-7 years of experience in data engineering.
- Strong proficiency in Python programming.
- Extensive experience with GCP services, including Dataflow, Dataproc, BigQuery, Cloud Storage, and Cloud Functions.
- Experience with data warehousing concepts and technologies.
- Experience with data modeling and ETL processes.
- Strong understanding of SQL and database technologies.
- Experience with data quality and data governance principles.
- Excellent problem-solving and analytical skills.
- Strong communication and collaboration skills.
- Ability to work independently and as part of a team.
- Experience with version control systems (e.g., Git).
Additional Information:
This position is based in Chennai or Hyderabad and requires candidates who are available to join within an immediate to 20-day notice period. We offer a competitive salary and benefits package, as well as opportunities for professional growth and development. We are an equal opportunity employer and value diversity at our company. We do not discriminate on the basis of race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, or disability status. We are committed to creating an inclusive environment for all employees. The role may require occasional travel to other company locations or client sites. We encourage candidates from all backgrounds to apply. We are looking for someone who is passionate about data and is eager to contribute to our team's success. If you are a highly motivated and skilled Data Engineer, we encourage you to submit your application today.