Job
Description
Senior Data Engineer As a Senior Data Engineer, you will play a crucial role in designing, developing, and maintaining the data architecture and infrastructure necessary for efficient and scalable data processing. Leveraging your expertise in data technologies and software engineering, you will collaborate with cross-functional teams to ensure the reliability, performance, and accessibility of our data systems. Your responsibilities will encompass everything from data modeling and ETL processes to optimizing data pipelines and implementing best practices for data governance and security. Key Responsibilities: Data Architecture Design: Design, develop, and maintain scalable data architectures that support the storage, processing, and analysis of large volumes of data. Data Pipeline Development: Develop robust and efficient ETL processes and data pipelines to ingest, transform, and load data from various sources into the data warehouse or other storage systems. Data Modeling: Design and implement data models that facilitate efficient querying and analysis, ensuring data integrity, accuracy, and consistency. Performance Optimization: Optimize database queries & data processing workflows to improve performance, scalability, and reliability. Monitoring and Maintenance: Monitor data pipelines and systems for performance issues and troubleshoot problems as they arise and ensure the reliability and availability of data systems. Data Governance and Security: Knowledge on data governance policies and security measures to ensure compliance with regulatory requirements and protect sensitive data is a plus. Tool Evaluation and Implementation: Evaluate new technologies and tools to enhance the data infrastructure and recommend appropriate solutions based on business needs and technical requirements. Documentation: Document data architecture, processes, and workflows to facilitate knowledge sharing and ensure the sustainability of data solutions. Mentorship and Leadership: Provide guidance and mentorship to junior team members, sharing best practices, and fostering a culture of continuous learning and improvement. Required Qualifications: Bachelor's or Master's degree in Computer Science, Engineering, or a related field. Proven total experience (8-10 years) and at least 7 years in a similar role as a data engineer, with a focus on designing and implementing scalable data solutions. Proficiency in programming languages such as Python, or Scala, T-SQL and experience with data processing frameworks like Apache Spark Strong SQL skills and experience with relational databases (MSSQL, MySQL, etc.) Experience with AWS cloud platform and proficiency in cloud-based data services - AWS Redshift & Databricks is a must. Expertise in ETL tools like SSIS. Working knowledge on cloud ELT services like AWS Glue, Azure Data Factory is a plus. Working knowledge on non-relational/NoSQL databases is a plus Knowledge of data warehousing concepts, dimensional modeling, and data warehouse design patterns. Familiarity with DevOps practices and tools for continuous integration and deployment (CI/CD). Excellent problem-solving skills and the ability to analyze complex data systems and workflows. Strong communication skills and the ability to collaborate effectively with cross-functional teams. Experience with big data technologies such as Hadoop, Apache Kafka, or Apache HBase is a plus. Can start ASAP or within 30 days. Education / Certifications: Bachelor's/College Degree in Engineering (Computer/Telecommunication), Computer Science/Information Technology, or equivalent. Work Location / Work Schedule / Travel: Chennai TaskUs Office Day Shift Schedule Onsite Setup How We Partner To Protect You: TaskUs will neither solicit money from you during your application process nor require any form of payment in order to proceed with your application. Kindly ensure that you are always in communication with only authorized recruiters of TaskUs. DEI: In TaskUs we believe that innovation and higher performance are brought by people from all walks of life. We welcome applicants of different backgrounds, demographics, and circumstances. Inclusive and equitable practices are our responsibility as a business. TaskUs is committed to providing equal access to opportunities. If you need reasonable accommodations in any part of the hiring process, please let us know. We invite you to explore all TaskUs career opportunities and apply through the provided URL https://www.taskus.com/careers/ .
