Senior Manager-Technology

Purpose/Objective

We are looking for a highly skilled Data Engineer with minimum 8-12 years of experience to join our growing data team. The ideal candidate will have strong hands-on experience with Databricks and a solid foundation in machine learning. They will play a key role in designing, building, and deploying data pipelines and predictive models, including recommendation systems and forecasting solutions.

Key Responsibilities of Role

- Develop, optimize, and maintain scalable data pipelines using Databricks (PySpark/SQL). - Collaborate with data scientists to build, train, and deploy machine learning models for use cases such as recommendation engines and time series forecasting. - Work with large data sets to prepare and process structured and unstructured data for analytics and ML. - Implement and maintain CI/CD pipelines for model deployment and versioning. - Collaborate with cross-functional teams to gather requirements and deliver data-driven solutions. - Optimize query performance and manage data storage efficiently on the Lakehouse architecture.

Technical Competencies

professional experience in data engineering or ML engineering roles.,Strong proficiency with Databricks, Apache Spark (PySpark), and SQL.,Hands-on experience in building and deploying ML models, especially recommendation systems and forecasting models.,Proficiency in Python and machine learning libraries (e.g., scikit-learn, TensorFlow, or PyTorch),Experience with Delta Lake, MLflow, and cloud platforms (AWS/Azure/GCP),Familiarity with MLOps practices and version control tools (e.g., Git)

Qualifications and Experience

Preferably BE/BTech/BIT/MCA/BCA 8-12 years of experience