Data Engineer

As a Data Engineer at GreyOrange, you will be responsible for designing, developing, and maintaining ETL pipelines to ensure efficient data flow for high-scale data processes. Your primary focus will be on managing and optimizing data storage and retrieval in Google BigQuery, while ensuring performance efficiency and cost-effectiveness. Additionally, you will be setting up quick analytics dashboards using tools like Metabase, Looker, or any other preferred platform. Collaboration with internal analysts and stakeholders, including customers, is key in understanding data needs and implementing robust solutions. You will play a crucial role in monitoring, troubleshooting, and resolving data pipeline issues to maintain data integrity and availability. Implementing data quality checks and maintaining data governance standards across the ETL processes will also be part of your responsibilities. Automation will be a significant aspect of your role, where you will develop scripts for repetitive tasks and optimize manual processes. Documenting the entire analytics implementation and data structures will ensure a guide for all users. Staying updated with industry best practices and emerging technologies in data engineering and cloud-based data management is essential. In addition to the responsibilities, the following requirements are necessary for this role: - 4+ years of experience as a Data Engineer or in a similar role - Strong experience with ETL tools and frameworks such as Apache Airflow, Dataflow, Estuary - Proficiency in SQL and extensive experience with Google BigQuery - Setting up analytics dashboards using tools like Looker, Metabase - Knowledge of data warehousing concepts and best practices - Experience with cloud platforms, particularly Google Cloud Platform (GCP) - Strong analytical and problem-solving skills focusing on cost optimization in cloud environments - Familiarity with Python or other scripting languages for automation and data processing - Excellent communication skills and the ability to work collaboratively in a team environment - Experience with data modeling and schema design As a Data Engineer at GreyOrange, you will have the opportunity to provide guidance and mentorship to junior data engineers and data analysts when needed.,