Data Engineer

As a Data Engineer with 2-5 years of experience, you will be based in Hyderabad and will be expected to possess expertise in SQL. You should be proficient in tools such as Data bricks, Snowflake, DBT, Python, and AWS. You should also have familiarity with Github, VS Code, Linux CLI, and file formats like CSV and Parquet. Knowledge of data visualization tools like Tableau or Power BI and experience with Agile methodologies will be an added advantage. Your primary responsibilities will include building and maintaining batch data pipelines across the advanced analytics platform. You will be required to design, develop, and orchestrate highly robust and scalable ETL/ELT pipelines. Optimizing codebase and performing Spark optimizations for Big Data use cases will also be part of your duties. Additionally, you will be responsible for developing and deploying monitoring and testing strategies for data products. Collaboration with stakeholders and advanced analytics business partners to understand business needs and translate requirements into scalable data engineering solutions is crucial. You will also need to work closely with data scientists to prepare data for model development and production. Collaborating with data visualization and reporting application developers to ensure the sustainability of production applications and reports will also be part of your role.,