SENIOR DATA ENGINEER with PYTHON

Company Overview

Soft Elevation has fronted our client’s goals by transforming their ideas into functional products. From IoT and Blockchain, to IoT and Big Data, to Custom Web Development, to Bespoke Mobile App Development, to UI/UX design there is no technology we have left in the raw. Our team of specialist Tech experts can remold from scratch a raw idea into a functional and seamless solution that packs a punch and generate value for 100+ service and product-based enterprises and startups. We are a global player in the world of software and development solutions, working with the new-fangled, futuristic technologies and app development, with an experience of serving a global base of clients not limited to US, Europe, Asian markets, and not to say the oceanic from Australia, and New Zealand. We enable SMBs to be the market trailblazers by delivering leading-edge custom software on a competitive budget overlay. We have made up a name for being an experienced software development company with a nimbleness to deliver top-notch service from the early conception stage to a fully functioning product, including ongoing tech support, as a single solution.

Our software is designed to automate the dispatching process, allowing transportation providers to manage schedules, assign drivers, and track vehicles in real-time. With our customizable billing and reporting features, users can easily manage their finances and gain valuable insights into their operations.

What you’ll be doing:

• Design, build, and maintain scalable data pipelines and backend frameworks for high-volume data ingestion.

• Develop robust ETL processes to integrate data from diverse sources (APIs, relational databases, file systems).

• Optimize data workflows for performance, scalability, and reliability.

• Collaborate with backend and AI/ML teams to integrate data-driven features into production systems.

• Implement data validation, quality checks, and monitoring across pipelines.

• Contribute to architecture discussions and drive best practices in data engineering.

• Stay current with emerging technologies in Python, data engineering, and AI integration.

Tech we’re using:

• Python (FastAPI, Pandas, NumPy, Pydantic)

• Distributed systems and frameworks: Spark, Dask, Airflow

• Data tools: Databricks, Delta Lake, dbt

• Databases: SQL & NoSQL systems, query optimization, and data modeling

• Cloud platforms: Azure (preferred), AWS, GCP

• Streaming & caching: Redis, Kafka

• CI/CD, containerization, and orchestration tools (Docker, Kubernetes)

• Version control & collaboration: Git, Jira, Confluence

What we’re looking for:

• 5+ years of backend or data engineering experience with strong Python expertise.

• Proven experience in building and managing data pipelines and ETL processes.

• Hands-on experience with large-scale datasets and distributed data systems.

• Familiarity with AI integration, ML pipelines, and cloud-based environments.

• Strong problem-solving, communication, and collaboration skills with a focus on clean, high-quality code.

Job Types: Full-time, Permanent

Pay: ₹3,000,000.00 - ₹4,000,000.00 per year

Work Location: In person