TM D&A Platform Engineer

• We are seeking a seasoned Senior Data Analytics Architect/Developer with exceptional expertise in backend development, solution architecture, and data analytics
• The ideal candidate will possess handson experience in analysing solutions and proposing suitable architectures for realtime use cases and batch inferencing
• You should have a strong background in suggesting onpremises/edge architectures, handson development experience in backend systems and web analytics, and extensive knowledge in building scalable solutions through cloud architecture
• Additionally, have experience in data lake design with Medallion architecture, ETL tools orchestration using AWS Glue or Azure ADF, implementing Data quality frameworks, devising QA testing strategies, building MLOps for data science projects, working with the data science modelbuilding lifecycle, Designing Data Catalogs such as Unity Catalogs for data sharing, and handson DevOps experience for CI/CD pipelines using AWS CodeCommit or Azure Repository

Key Responsibilities:

• Must have led the architectural design and development of robust data platforms and backend solutions
• Solution Architecture: Understand complex solutions and recommend appropriate architectures for scaling realtime use cases and batch inferencing
• OnPrem/Edge Architecture: Propose and implement onpremises/edge architectures tailored for specific use cases, ensuring seamless integration and optimal performance
• BackEnd Development Web Analytics: Lead handson development of robust backend solutions and employ web analytics to enhance user experiences
• Cloud Architecture: Leverage strong cloud architecture skills to design and build scalable solutions using Azure, Databricks, and AWS
• Design, develop, and deploy cloudnative applications and services using modern cloud platforms, such as AWS, Azure, or Google Cloud Platform
• Data Lake Design: Design and optimise data lake solutions using Medallion architecture, enabling efficient storage, retrieval, and processing of vast datasets
• Write clean, efficient, and maintainable code in languages such as Java, Python(PySpark), or C#, following best practices and design patterns
• ETL Tools Orchestration: Orchestrate data workflows and ETL processes using AWS Glue or Azure ADF, ensuring smooth data integration and transformation
• Data Quality Framework: Develop and maintain a robust data quality framework, incorporating data validation, cleansing, and enrichment processes
• QA Testing Strategy: Implement comprehensive QA testing strategies, including unit testing, integration testing, and performance testing, to validate solution functionality and reliability
• MLOps: Build MLOps pipelines and frameworks for data science projects, enabling seamless model deployment, monitoring, and automation using Azure Machine Learning, Azure Databricks or MLFlow
• Data Science Model Building Lifecycle: Contribute to the data science modelbuilding lifecycle, collaborating effectively with data scientists to integrate models into production systems
• Data Catalog and Unity Catalog: Work with data catalogs and Unity catalogs for efficient data sharing and management
• DevOps for CI/CD: Handson experience in setting up and managing CI/CD pipelines using AWS CodeCommit or Azure Repository
• Mentor and guide junior developers, providing technical leadership, code reviews, and support in their professional growth
• Qualifications and Skills: Bachelors or Masters degree in Computer Science, Information Technology, or a related field
• 46 years of handson experience in solution architecture, backend development, web analytics, cloud architecture (Azure, Databricks, AWS), data lake design, ETL tools orchestration, data quality frameworks, QA testing strategies, MLOps, data science model building lifecycle, and data catalog management
• Proficiency in programming languages in Python with a strong focus on backend technologies and frameworks
• Midlevel expertise in cloud design, including experience with containerization technologies (Docker, Kubernetes) and serverless computing
• Advanced understanding of data science concepts and tools, providing a significant advantage
• Demonstrated leadership skills, with the ability to guide and mentor junior team members effectively
• Solid grasp of the software development lifecycle, version control, and agile methodologies
• Exceptional problemsolving abilities and a proactive attitude in a fastpaced environment
• Outstanding communication skills, both written and verbal, with the ability to collaborate effectively with team members and stakeholders
• Handson experience with AWS Glue, Azure ADF, Azure Databricks, and other relevant tools in the Azure and AWS ecosystems
• Familiarity with big data technologies, such as Apache Hadoop, Apache Spark, or Apache Kafka
• Experience with containerization technologies, such as Docker and container orchestration tools like Kubernetes
• Expertise in QA testing strategies, including automated testing tools and frameworks
• Excellent problemsolving skills, attention to detail, and ability to work in a fastpaced environment
• Strong communication skills and ability to collaborate effectively in a team setting

Technical Skills: