Senior Data Engineer

Job Description

A Senior Data Engineer specializing in Python, SQL, dbt, and Databrick Job Title: Senior Data Engineer Shift: 2.30 PM to 11.30 PM Location: Chennai/Bengaluru (Hybrid) Certification is added advantage Responsibilities: Design, develop, and maintain scalable ETL/ELT pipelines using dbt and Databricks. Optimize SQL queries for efficient data processing and analytics. Implement data modeling best practices to support business intelligence and reporting needs. Ensure data integrity, security, and governance across various platforms. Collaborate with data scientists, analysts, and business teams to understand data requirements. Monitor and troubleshoot data pipelines to ensure reliability and performance. Work with cloudbased data warehouses and big data technologies to manage large datasets. Automate data workflows using Python and integrate with various APIs. Qualifications: 5+ years of experience in data engineering or a related field. Strong proficiency in Python for data processing and automation. Expertise in SQL for querying and managing relational databases. Hands-on experience with dbt for data transformation and modeling. Familiarity with Databricks and Apache Spark for big data processing.Experience with cloud platforms like AWS, Azure, or GCP. Knowledge of CI/CD pipelines for data deployment. Strong problem-solving skills and ability to optimize data workflows. Brief note from client- He/she will be working on multiple projects to ingest data and create production-grade data pipelines. Currently, Need to ingest data from Verint Cloud using their APIs into Databricks. Also have a need to create data pipelines (using Python, SQL, dbt) to create data products for Financial reporting. The exact projects may change over time, depending on the timing of the new hire. Client is looking for a senior data engineer who is technically proficient and requires minimal hand-holding. He/she would be expected to troubleshoot and solve problems on their own, and produce high quality data products. Hope that gives you a good idea. Also, he/she would be required to have a good workday overlap with our team. I Client is expecting that resource can work till around 2 pm US Central Time