Data Engineering & Analytics Architect

As a Data Engineering & Analytics Architect at Programmers.io, you will be responsible for leading and solutionizing large-scale data modernization projects on the Azure platform. With your 15+ years of experience, you will play a crucial role in designing, architecting, and delivering cutting-edge data solutions. Your strategic thinking and hands-on approach will be key in integrating AI-driven insights into data platforms. Here's what your role will involve: - **Leadership & Strategy** - Act as the primary advisor to customers, understanding their problem statements and recommending tailored strategies for data modernization and analytics. - Lead cross-functional teams to design and implement scalable data platforms aligned with business objectives. - Drive discussions with executive stakeholders to ensure solutions align with organizational goals. - Mentor and coach teams on best practices, emerging trends, and new technologies in data engineering and analytics. - Manage stakeholder expectations by communicating technical solutions in business terms and ensuring project delivery meets deadlines and budgets. - **Solution Design & Architecture** - Architect end-to-end data solutions on the Azure platform, including data lakes, warehouses, and real-time analytics. - Develop enterprise-grade data models, schemas, and frameworks to support ingestion, transformation, and advanced analytics. - Define and implement scalable, secure, and high-performance architectures using Azure Synapse Analytics, Azure Data Factory, Azure Data Lake, and Azure SQL Data Warehouse. - Integrate AI capabilities into the data ecosystem using tools like Azure Machine Learning, Databricks, and Cognitive Services for advanced analytics and insights. - Ensure robust data governance, compliance, and security practices are embedded in all designs. - **Implementation & Optimization** - Lead the development of ETL/ELT pipelines for large-scale data processing, transformation, and storage. - Optimize data pipelines, queries, and infrastructure for reliability, scalability, and performance. - Automate data quality checks and validations to maintain high data integrity. - Monitor, troubleshoot, and resolve issues across data platforms. - **AI & Advanced Analytics** - Implement machine learning pipelines for predictive and prescriptive analytics using Azure Machine Learning and Databricks. - Leverage Azure Cognitive Services for AI-powered functionalities such as natural language processing (NLP) and computer vision within data platforms. - Drive the adoption of AI-based anomaly detection, forecasting, and recommendation systems. - **Collaboration & Documentation** - Work closely with business stakeholders, analysts, and engineers to ensure solutions align with business goals. - Document all technical designs, including data architectures, data flows, and system integrations. - Create and maintain comprehensive documentation such as system diagrams, data dictionaries, and operational playbooks. **Required Skills & Experience:** - Expertise in designing and implementing enterprise-scale data solutions using Azure services - Experience with AI frameworks and platforms - Strong experience in ETL/ELT processes, data modeling, and pipeline optimization - Deep knowledge of Azure platform services - Proficiency in Python, SQL, Spark, and other relevant programming languages - Proven leadership abilities and stakeholder management skills - Understanding of data compliance and governance practices - Hands-on experience with BI tools and integration platforms At Programmers.io, a global technology services company, you will have the opportunity to work on impactful projects with top-tier clients in a collaborative, innovation-driven environment. Join us in shaping the future of data engineering and analytics in Hyderabad or Jaipur, India. If you are ready to leverage your skills in Azure Services, AI/ML, ETL, Python, SQL, and Pyspark to make a difference, apply now by sending your resume to anjali.shah@programmers.io.,