Data Engineer (Azure)

Position Summary

Key Responsibilities

Data Engineering:

• Design, develop, and maintain data pipelines using PySpark and modern orchestration tools (Airflow, Prefect, or Dagster).
• Manage large volumes of structured/unstructured data across multiple sources and formats.
• Implement robust ELT processes, transformations, and mappings to ensure data quality and consistency.
• Build and optimize data marts and analytical layers to support BI and advanced analytics.
• Work with Microsoft Azure Fabric and related Azure services (Data Factory, Synapse, Data Lake, Power BI).
• Ensure scalability, reliability, and security of the data platform following best practices.
• Collaborate with analysts, data scientists, and stakeholders to deliver high-quality solutions.
• Monitor, troubleshoot, and optimize pipeline performance.
• Document data workflows and architecture for cross-team visibility.
  

(Optional) Data Science & AI

• Fine-tune and customize LLMs (OpenAI, Hugging Face, LLaMA) for business use cases.
• Build and maintain data pipelines for ML training, evaluation, and monitoring.
• Deploy models in containerized environments (Docker) and manage lifecycle using MLOps best practices (MLflow, DVC).
• Integrate AI capabilities into products in collaboration with engineering teams.
• Evaluate model performance, latency, and cost in production environments.
  

Required Qualifications

• The person should hold a Bachelor’s or Master’s degree in Computer Science.
• The person must have strong proficiency with PySpark and distributed data processing frameworks.
• The person should have experience with data pipeline orchestration tools (e.g., Airflow, Prefect, Dagster).
• The person should be experienced in working with Microsoft Azure Fabric and the Azure ecosystem (Data Factory, Synapse, Data Lake, Power BI).
• The person should be proficient in SQL and comfortable working with relational and non-relational databases.
• The person should have a solid understanding of data modeling, data warehousing, and ELT principles.
• The person must have strong coding skills in Python and familiarity with version control systems (Git).
• The person should have knowledge of data governance, security, and compliance frameworks.
• The person should be familiar with streaming data frameworks (Kafka, Event Hubs).
  

Good to Have

• 4+ years in Data Engineering or ML/Data Science roles.
• Hands-on experience with LLMs, NLP models, or foundational model APIs.
• Experience with ML libraries (Transformers, LangChain, scikit-learn, Pandas).
• Familiarity with containerized deployment (Docker) and scalable ML infrastructure.
• Experience with vector databases (Pinecone, Weaviate, Qdrant).
• Knowledge of model-serving frameworks (FastAPI, Triton, Ray Serve).
• Exposure to GPU infrastructure for distributed model training.
• Experience with CI/CD, automated testing, and infrastructure as code.
  

About Aumni

• Aumni, established in 2016, is a Software Services Company that partners with Product companies to build and manage their dedicated teams in India.
• So, while you are working for a services company, you are working within a product team and growing with them.
• These are not projects but product development, and we have long term (open ended) contracts with our clients. When our clients sign up with us, they are looking at a multi-year relationship. Most of our clients have been with 6,8,9 years.
• We do not move people across client teams and there is no concept of bench.
• At Aumni, we believe in quality work, and we truly believe that Indian talent is at par with global talent from US or Europe.
• We are 350+ and growing
  

Benefits Of Working At Aumni

• Our award winning culture reminds us of our engineering days.
• Medical insurance (including Parents), Life and disability insurance
• 24 leaves + 10 public holidays + leaves for Hospitalisation, maternity, paternity and bereavement.
• On site Gym, TT, Carrom, Foosball and Pool
• Hybrid work culture
• Fitness group / rewards
• Aumni Premier League, Aumni's Got Talent, Friday Socials, Annual parties, treks.
  

Aumni Values

BE BOLD

• Dare to innovate, challenge the norm and take ownership. Growth comes from courage.
  

BE TRUE

• Act with integrity and transparency - in every task, every decision and every interaction.
  

BE KIND

• Respect people, embrace diversity and support our culture of empathy and high collaboration.
  

BE YOU

• Bring your authentic self to work. Have fun working, celebrate individuality and create space for everyone to thrive.