ETL Data Engineer Sivarsa Technologies LLP

6.0 - 10.0 years

0 Lacs

pune, maharashtra

On-site

As an ETL Data Engineer with 6-9 years of experience, you will be responsible for collaborating with analysts and data architects to develop and test ETL pipelines using SQL and Python in Google BigQuery. Your primary role will involve performing related data quality checks, implementing validation frameworks, and optimizing BigQuery queries for performance and cost-efficiency. It is essential that you are available for full-time engagement and possess the following technical requirements: - SQL (Advanced level): You should have a strong command of complex SQL logic, including window functions, CTEs, pivot/unpivot, and proficiency in stored procedure/SQL script development. Experience in writing maintainable SQL for transformations is crucial. - Python for ETL: Your expertise should extend to writing modular and reusable ETL logic using Python, along with familiarity with JSON manipulation and API consumption. - Google BigQuery: Hands-on experience in developing within the BigQuery environment is required. You should have an understanding of partitioning, clustering, and performance tuning within BigQuery. - ETL Pipeline Development: You must be experienced in developing ETL/ELT pipelines, data profiling, validation, quality/health check, error handling, logging, and notifications. Nice-to-have skills include experience with the Google BigQuery platform and knowledge of CI/CD practices for data workflows. This role is full-time and permanent, offering benefits such as cell phone reimbursement, health insurance, paid time off, and provident fund. The work schedule is during the day shift, and the work location is in person in Noida, Pune, or Chennai.,

Posted 6 days ago

Apply

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.