Job
Description
At Technoidentity, we're looking for a seasoned Technical Lead - Python,SQL to lead the design, development, and optimization of both batch and real-time data systems that power critical business operations and product innovation. you'll work closely with a diverse team of engineers, product managers, and data scientists to build scalable, high-performance data solutions that fuel data-driven decisions across the organization. Key Responsibilities Architect and productionize scalable data infrastructure to support real-time and batch data processing needs across the company. Ensure system reliability, performance, and data quality through robust monitoring, testing, and validation practices. Design, implement, and optimize data models to ensure efficient storage, retrieval, and analytics performance. Collaborate cross-functionally with product, engineering, data science, and ML teams to understand data needs and deliver integrated, scalable solutions. Tune and operationalize data pipelines and machine learning models, optimizing them for efficiency and impact. Build strong relationships with partner engineering teams to ensure seamless data integration and platform support. Contribute to the long-term data strategy, architecture decisions, and roadmap planning for the organization. Provide mentorship and technical guidance to team members, promoting engineering best practices and continuous learning. Your Expertise 8+ years of experience in data engineering or a related field, with a Bachelor/ Masterdegree in Computer Science , Electrical Engineering, or a related discipline . Deep expertise in building and maintaining distributed data platforms using technologies like Apache Spark, Kafka, Flink, or HBase . Strong proficiency in Java, Scala, or Python , with solid SQL skills and experience with complex data processing pipelines. Proven experience in architecting and optimizing large-scale batch and real-time data systems in production environments. Deep understanding of data modeling , data warehousing , and working with both relational (eg, PostgreSQL, MySQL) and columnar (eg, Redshift, BigQuery ) databases. Experience in collaborating with cross-functional teams and translating business needs into scalable technical solutions. Strong analytical mindset with a focus on data governance , quality , and system performance . Excellent communication and influencing skills able to convey technical ideas clearly to both technical and non-technical stakeholders. Exposure to integrating machine learning models into data pipelines (preferred but not required ). Demonstrated leadership and mentoring abilities, with a passion for developing team capabilities and driving engineering excellence. Open-minded and innovative, with a continuous drive to explore new tools, technologies, and practices in data engineering.
