Job
Description
As a Data Engineer at CLOUDSUFI, you will play a crucial role in building, maintaining, and optimizing data pipelines and infrastructure on Google Cloud Platform (GCP). Your responsibilities will include designing scalable data pipelines, developing data warehousing solutions, managing data workflows, writing SQL queries, developing Python scripts, collaborating with data scientists, and ensuring data quality and accuracy. Key Responsibilities: - Design, develop, and maintain scalable and reliable data pipelines using Dataform or DBT. - Build and optimize data warehousing solutions on Google BigQuery. - Develop and manage data workflows using Apache Airflow. - Write complex and efficient SQL queries for data extraction, transformation, and analysis. - Develop Python-based scripts and applications for data processing and automation. - Collaborate with data scientists and analysts to understand their data requirements and provide solutions. - Implement data quality checks and monitoring to ensure data accuracy and consistency. - Optimize data pipelines for performance, scalability, and cost-effectiveness. - Contribute to the design and implementation of data infrastructure best practices. - Troubleshoot and resolve data-related issues. - Stay up-to-date with the latest data engineering trends and technologies, particularly within the Google Cloud ecosystem. Qualifications: - Bachelor's degree in Computer Science, a related technical field, or equivalent practical experience. - 3-4 years of experience in a Data Engineer role. - Strong expertise in SQL (preferably with BigQuery SQL). - Proficiency in Python programming for data manipulation and automation. - Hands-on experience with Google Cloud Platform (GCP) and its data services. - Solid understanding of data warehousing concepts and ETL/ELT methodologies. - Experience with Dataform or DBT for data transformation and modeling. - Experience with workflow management tools such as Apache Airflow. - Excellent problem-solving and analytical skills. - Strong communication and collaboration skills. - Ability to work independently and as part of a team. Preferred Qualifications: - Google Cloud Professional Data Engineer certification. - Knowledge of data modeling techniques (e.g., dimensional modeling, star schema). - Familiarity with Agile development methodologies. In addition to the technical qualifications, we also value behavioral competencies in our team members. You should have experience working with US/Europe based clients in onsite/offshore delivery models, excellent communication skills, strong problem-solving abilities, collaborative mindset, passion for complex problem-solving, effective task prioritization, time management skills, and the ability to work in a matrix organization structure. As a Data Engineer at CLOUDSUFI, you will play a crucial role in building, maintaining, and optimizing data pipelines and infrastructure on Google Cloud Platform (GCP). Your responsibilities will include designing scalable data pipelines, developing data warehousing solutions, managing data workflows, writing SQL queries, developing Python scripts, collaborating with data scientists, and ensuring data quality and accuracy. Key Responsibilities: - Design, develop, and maintain scalable and reliable data pipelines using Dataform or DBT. - Build and optimize data warehousing solutions on Google BigQuery. - Develop and manage data workflows using Apache Airflow. - Write complex and efficient SQL queries for data extraction, transformation, and analysis. - Develop Python-based scripts and applications for data processing and automation. - Collaborate with data scientists and analysts to understand their data requirements and provide solutions. - Implement data quality checks and monitoring to ensure data accuracy and consistency. - Optimize data pipelines for performance, scalability, and cost-effectiveness. - Contribute to the design and implementation of data infrastructure best practices. - Troubleshoot and resolve data-related issues. - Stay up-to-date with the latest data engineering trends and technologies, particularly within the Google Cloud ecosystem. Qualifications: - Bachelor's degree in Computer Science, a related technical field, or equivalent practical experience. - 3-4 years of experience in a Data Engineer role. - Strong expertise in SQL (preferably with BigQuery SQL). - Proficiency in Python programming for data manipulation and automation. - Hands-on experience with Google Cloud Platform (GCP) and its data services. - Solid understanding of data warehousing concepts and ETL/ELT methodologies. - Experience with Dataform or DBT for data transformation and modeling. - Experience with workflow management tools such as Apache Airflow. - Excellent problem-solving and analytical skills. - Strong communication and collaboration skills. - Ability to work independently and as part of a team. Preferred Qualifications: - Google Cloud Professional Data Enginee
