Sr.Data Engineer

Job Description

What to expect in your journey • Lead the scaling and optimization of data environments, including distributed and real-time systems, and enable self-service data visualization capabilities for users. • Demonstrate advanced expertise in SQL, Python, and quality assurance (QA) processes to maintain data integrity and performance. • Leverage machine learning techniques (preferred but not required) to enhance data-driven insights and solutions. • Design and implement cloud-based and SaaS data warehouses, such as Snowflake or Databricks, and develop efficient ETL/ELT pipelines for seamless data processing. • Build and integrate data platforms that support business intelligence (BI), analytics, data science initiatives, and real-time applications across the organization. • Utilize data cataloging tools like Alation, and apply API scripting to automate data discovery and metadata management processes. • Adhere to Software Development Lifecycle (SDLC) best practices, including source code management with Git, implementing continuous integration and deployment (CI/CD), and following test-driven development methodologies. • Exhibit strong communication skills and take initiative in leading and driving projects with precision, ensuring timely and accurate delivery. What you bring to the table • Minimum 8 years of experience as a Data Engineer in a global organization. • Bachelors Degree in IT. Technical Skills: • Advanced proficiency in SQL and Python. • Strong experience with QA processes, data validation, and troubleshooting. • Solid understanding of ETL/ELT processes and building scalable data pipelines. • Expertise in cloud-based data warehousing platforms, particularly Snowflake, and SaaS platforms. • Familiarity with data catalog tools like Alation, and proficiency in API scripting for automation and metadata management. • Strong experience in designing and implementing data warehouse architectures and ensuring seamless data integration. • Knowledge of machine learning concepts is a plus. Where will you work: Remote Shift Timings: 7.30PM to 4.30AM