Data Engineering & Analytics Architect

As a Data Engineering & Analytics Architect at Programmers.io, your role involves leading and solutionizing large-scale data modernization projects on the Azure platform. With 15+ years of experience, you will be responsible for designing, architecting, and delivering cutting-edge data solutions. Here are the key responsibilities you will undertake: - **Leadership & Strategy:** - Act as the primary advisor to customers, understanding their problem statements and recommending tailored strategies for data modernization and analytics. - Lead cross-functional teams to design and implement scalable data platforms aligned with business objectives. - Drive discussions with executive stakeholders to ensure alignment of solutions with organizational goals. - Mentor and coach teams on best practices, emerging trends, and new technologies in data engineering and analytics. - Manage stakeholder expectations by communicating technical solutions in business terms and ensuring project delivery meets deadlines and budgets. - **Solution Design & Architecture:** - Architect end-to-end data solutions on the Azure platform, including data lakes, warehouses, and real-time analytics. - Develop enterprise-grade data models, schemas, and frameworks to support ingestion, transformation, and advanced analytics. - Define and implement scalable, secure, and high-performance architectures using Azure Synapse Analytics, Azure Data Factory, Azure Data Lake, and Azure SQL Data Warehouse. - Integrate AI capabilities into the data ecosystem, leveraging tools such as Azure Machine Learning, Databricks, and Cognitive Services for advanced analytics and insights. - Ensure robust data governance, compliance, and security practices are embedded in all designs. - **Implementation & Optimization:** - Lead the development of ETL/ELT pipelines for large-scale data processing, transformation, and storage. - Optimize data pipelines, queries, and infrastructure to ensure reliability, scalability, and performance. - Automate data quality checks and validations to maintain high data integrity. - Monitor, troubleshoot, and resolve issues across data platforms. - **AI & Advanced Analytics:** - Implement machine learning pipelines for predictive and prescriptive analytics using Azure Machine Learning and Databricks. - Leverage Azure Cognitive Services to enable AI-powered functionalities such as natural language processing (NLP) and computer vision within data platforms. - Drive the adoption of AI-based anomaly detection, forecasting, and recommendation systems within the data ecosystem. - **Collaboration & Documentation:** - Work closely with business stakeholders, analysts, and engineers to ensure alignment of solutions with business goals. - Document all technical designs, including data architectures, data flows, and system integrations. - Create and maintain comprehensive documentation such as system diagrams, data dictionaries, and operational playbooks to ensure maintainability and scalability. In addition, Programmers.io is a global technology services company empowering clients through innovative solutions in data engineering, cloud transformation, and AI/ML. With a workforce of over 1,000 professionals, a commitment to growth, and a focus on impactful projects, you will experience a collaborative, innovation-driven environment. Join us in Hyderabad or Jaipur, India, with a flexible hybrid work model to shape the future of data engineering and analytics. If you are experienced in Azure Services, AI/ML, ETL, Python, SQL, and Pyspark, and ready to lead cutting-edge data projects, we encourage you to apply and be a part of our dynamic team at Programmers.io.,