Technical LeadII - Data Engineering & Analytics
We are seeking an experienced Data Engineer/Analyst to join our innovative team at Sentient Scripts. This role combines technical expertise in data engineering and analytics with leadership responsibilities. The successful candidate will design, develop, and maintain data pipelines and analytical models, with a focus on Generative AI and Large Language Models (LLMs), while also leading a team of interns to support in-house Research and Development (R&D) projects. With a strong background in Python, open-source models, and analytical frameworks, you will drive data-driven insights and advance our cutting-edge R&D initiatives. Key Responsibilities: - Design, build, and optimize scalable data pipelines to process structured and unstructured data for analytical, Generative AI, and LLM-based applications. - Develop and implement analytical models, Generative AI solutions, and LLM workflows using Python, open-source frameworks, and libraries. - Collaborate with cross-functional teams to define data requirements and deliver actionable insights from complex datasets, including those powering AI-driven systems. - Lead, mentor, and manage a team of interns, providing technical guidance, project oversight, and fostering a collaborative learning environment. - Conduct hands-on development for in-house R&D projects, exploring innovative data solutions, Generative AI use cases, and LLM integrations. - Ensure data quality, integrity, and security across all systems and processes, particularly for AI model training and deployment. - Document workflows, processes, and technical specifications to support knowledge sharing and scalability. - Stay updated on industry trends, open-source tools, and advancements in Generative AI, LLMs, data engineering, and analytics to enhance team capabilities. - BI Visualisation in powerBI/tableau Required Qualifications: - 5-7 years of professional experience in data engineering, data analysis, or a related role. - Proficiency in Python programming for data processing, analysis, and model development, including Generative AI and LLM applications. - Hands-on experience with open-source data tools and frameworks and LLM ecosystems. - Strong knowledge of analytical modeling techniques, including statistical analysis, machine learning, Generative AI, and data visualization. - BI Visualisation in powerBI/tableau - Experience working with relational and non-relational databases (e.g., SQL, PostgreSQL, MongoDB). - Proven ability to lead and mentor junior team members or interns, with excellent communication and organizational skills. - Familiarity with version control systems (e.g., Git) and cloud platforms (e.g., AWS, GCP, Azure) is a plus. - Problem-solving mindset with a passion for innovation and R&D in AI technologies. Preferred Skills: - Experience with large-scale data processing and distributed systems for AI model training and deployment. - Knowledge of Generative AI techniques and LLM fine-tuning, deployment, and optimization. - Ability to translate business needs into technical solutions, particularly for AI-driven outcomes. What We Offer: - Opportunity to work on groundbreaking R&D projects with real-world impact, including Generative AI and LLM innovations. - A collaborative and dynamic work environment with a focus on growth and learning.Experience - 5 Years to 8 Years
