51 Polars Jobs

Job Purpose : We are seeking a highly skilled ETL Data Engineer to re-engineer our existing data pipelines to extract data from a new data source (PostgreSQL / CURA system) instead of the current Microsoft SQL Server (CRM persistence store), while preserving the existing load patterns to Elasticsearch and MongoDB. The engineer will ensure this migration has zero impact on data quality, system performance, or end-user experience. Key Responsibilities : Analyze existing ETL pipelines and their dependencies on Microsoft SQL Server as source systems. Design and implement modifications to repoint ETL extractions from PostgreSQL (CURA) while preserving the current transformations and load logic in...

As a Balance Sheet Analytics Developer in the Treasury ALM team at Citi, you will play a key role in designing and optimizing analytics tools to support Citis NIR/NIM forecasting, balance sheet planning, and rate risk assessments. Your technical expertise in Python, Treasury, IRRBB, and ALM concepts will be essential in developing scalable, high-performance libraries for production use. Key Responsibilities: - Develop and maintain Python-based analytics libraries for NIR/NIM modeling and IRRBB simulations - Optimize data pipelines using vectorized operations, memory-efficient structures, and just-in-time compilation (e.g. Cython) - Collaborate with Treasury, Risk, and Finance teams to integr...

As a Python Developer at SoftProdigy, you will be responsible for designing, developing, and maintaining scalable backend applications and data pipelines. Your work will include a variety of projects such as internal tools, data-driven solutions, and AI/ML integrations. Key Responsibilities: - Develop and maintain robust Python backend applications using frameworks like FastAPI, Flask, or Django. - Design and implement APIs, microservices, and serverless functions to integrate with external systems and data sources. - Build and optimize data pipelines and workflows using libraries such as Pandas, Polars, NumPy. - Configure and manage cloud infrastructure (AWS, GCP, Azure) using best practice...

Strong in Python and experience with Jupyter notebooks, Python packages like polars, pandas, numpy, scikit-learn, matplotlib, etc. Must have: Experience with machine learning lifecycle, including data preparation, training, evaluation, and deployment Must have: Hands-on experience with GCP services for ML & data science Must have: Experience with Vector Search and Hybrid Search techniques Must have: Experience with embeddings generation using models like BERT, Sentence Transformers, or custom models Must have: Experience in embedding indexing and retrieval (e.g., Elastic, FAISS, ScaNN, Annoy) Must have: Experience with LLMs and use cases like RAG (Retrieval-Augmented Generation) Must have: U...

As a Data Engineer with 7 years of experience, you will be responsible for designing, building, and optimizing scalable data pipelines. Your expertise in Python, DBT, and Spark will be crucial in transforming complex data into actionable insights. Key Responsibilities: - Design, develop, and maintain efficient ETL pipelines and workflows. - Build and optimize data models and transformations using DBT. - Perform large-scale distributed data processing with Apache Spark. - Ensure data quality, consistency, and performance across systems. - Collaborate with analytics and business teams to enable data-driven decisions. Qualifications Required: - Strong programming skills in Python for data proce...

Role Summary We are seeking a Senior Full Stack Engineer to lead design and development of a cloud-native data platform (cfapp). The platform ingests large datasets, applies complex transformation rules, and integrates with marketplaces and SaaS systems. You will work across backend services, frontend applications, AWS infrastructure, and production deployment. Responsibilities Build backend services with Python (FastAPI) and integrate high-performance logic using Rust/Polars. Develop frontend dashboards and rule editors with SolidJS/React, TypeScript, TailwindCSS. Manage AWS infrastructure (S3, Cognito, Lambda/EventBridge, IAM, Terraform) for scalable deployments. Design and expose REST/Gra...

Role Overview: As the Team Lead of Data Engineering, you will be responsible for driving the design, development, and optimization of data engineering pipelines and services with a strong software engineering mindset. Your role will also involve fostering growth and collaboration within the team, mentoring junior colleagues, and refining processes to maintain excellence. If you are eager to have a lasting impact both technically and as a team leader, we are excited to meet you. Key Responsibilities: - Utilize very strong software engineering principles to write maintainable, scalable code, primarily in Python (experience with Rust or C# is a plus). - Perform data processing and manipulation ...

As a versatile Python Developer at SoftProdigy, you will be responsible for designing, developing, and maintaining scalable backend applications and data pipelines. You will have the opportunity to work on various projects, including internal tools, data-driven solutions, and AI/ML integrations. Key Responsibilities: - Develop and maintain robust Python backend applications using frameworks like FastAPI, Flask, or Django. - Design and implement APIs, microservices, and serverless functions to integrate with external systems and data sources. - Build and optimize data pipelines and workflows using libraries such as Pandas, Polars, NumPy. - Configure and manage cloud infrastructure (AWS, GCP, ...

As a Quantitative Developer at Millennium in Bangalore within the Enterprise Risk Technology team, you will play a crucial role in leveraging innovations in technology and data science to solve complex problems for the business. Your responsibility will involve working closely with quants, risk managers, and other technologists globally to develop multi-asset analytics, stress testing, and VaR for the in-house risk platform. You will be developing micro-services using Python, analyzing data with Pandas/Polars, creating and managing cloud applications on AWS, and utilizing GIT and appropriate DBMS solutions. Key Responsibilities: - Work closely with quants, risk managers, and other technologi...

As a Balance Sheet Analytics Developer in the Treasury ALM team at Citi, your role involves designing and optimizing analytics tools for Citis NIR/NIM forecasting, balance sheet planning, and rate risk assessments. You will be responsible for developing and maintaining Python-based analytics libraries, optimizing data pipelines, collaborating with cross-functional teams, and supporting monthly reporting cycles. Your work will contribute to forecasting, scenario analysis, and results validation for NIR/NIM metrics. Key Responsibilities: - Develop and maintain Python-based analytics libraries for NIR/NIM modeling and IRRBB simulations - Optimize data pipelines using vectorized operations, memo...

Millennium's Global Risk Management Department is responsible for identifying, measuring, monitoring, managing, and reporting on the risks associated with Millennium portfolios. Our Risk Management organization is designed to accommodate the overall size, nature, and complexity of the firm's trading activities. We are looking to add an inquisitive minded Risk Modeler to join our team. You will have the opportunity to develop and maintain the quantitative frameworks used by our portfolio managers and senior management teams. You will be responsible for the framework which involves Cash Equities Factor modelling, Statistical Factor modeling, tail risk (e.g. VaR, Stress) modeling, performance a...

As an ETL Data Engineer, your role will involve re-engineering existing data pipelines to extract data from a new source (PostgreSQL / CURA system) instead of Microsoft SQL Server while maintaining data quality, system performance, and end-user experience during migration. Key Responsibilities: - Analyze current ETL pipelines and their dependencies on Microsoft SQL Server. - Design and implement modifications to redirect ETL extractions to PostgreSQL (CURA) while keeping current transformations and load logic for Elasticsearch and MongoDB. - Ensure end-to-end data integrity, quality, and freshness post source switch. - Write efficient SQL queries for data extraction from the new source. - Pe...

As an Applied AI ML Lead within the Digital Intelligence team at JPMorgan, you will collaborate with all lines of business and functions to deliver software solutions. You will experiment, develop, and productionize high-quality machine learning models, services, and platforms to make a significant impact on technology and business. You will design and implement highly scalable and reliable data processing pipelines. Additionally, you will perform analysis and insights to promote and optimize business results. You will contribute to a transformative journey and make a substantial impact on a wide range of customer products. - Research, develop, and implement machine learning algorithms to so...

Design,develop,andmaintainPython-based applications for handling large data sets and ensuring high performance. SKills :- Data Engineer Asynchronous Programming ETL Python Pandas Numphy Polars SQL NOSql Required Candidate profile WFO/Hybrid/WFH all options are available

Job Purpose We are seeking a highly skilled ETL Data Engineer to re-engineer our existing data pipelines to extract data from a new data source (PostgreSQL / CURA system) instead of the current Microsoft SQL Server (CRM persistence store), while preserving the existing load patterns to Elasticsearch and MongoDB. The engineer will ensure this migration has zero impact on data quality, system performance, or end-user experience. Key Responsibilities Analyze existing ETL pipelines and their dependencies on Microsoft SQL Server as source systems. Design and implement modifications to repoint ETL extractions from PostgreSQL (CURA) while preserving the current transformations and load logic into E...

Required Skills Experience 36 years of experience in backend development with Python. Strong hands-on experience with: FastAPI for building RESTful APIs. NumPy and Polars for numerical and tabular data processing. Solid understanding of Generative AI concepts and experience with: LangChain, LangGraph, and MCP Agents. Building and deploying agentic RAG systems. Experience with MongoDB or other vector databases for semantic search and retrieval. Familiarity with cloud platforms (Azure) and containerization (Docker/Kubernetes) is a plus. Please note - We are looking for immediate joiners (or max. NP 15-20 days). Qualifications Bachelor's/Master's degree in computer science, data science, mathem...

As a Data Architect with over 8 years of experience located in Balewadi, Pune, your technical skills and core competencies should include a strong understanding of Data Architecture and models. You should have expertise in leading data-driven projects and Data Modelling paradigms such as Kimball, Inmon, Data Marts, Data Vault, and Medallion. Additionally, you must have solid experience with Cloud Based data strategies and big data technologies, preferably with AWS. Your responsibilities will involve: - Participating in the design and development of features in the existing Data Warehouse - Providing leadership in establishing connections between Engineering, product, and analytics/data scien...

About the Role: 10 S&P Mobility The Team: At S&P Mobility, we're investing in technology to develop new products that help our customers drive their growth and transformation agenda. These include new data integration, advanced analytics, and modern applications that address new customer needs and are highly visible and strategic within the organization. Do you love building products on platforms at scale while leveraging cutting-edge technology Do you want to deliver innovative solutions to complex problems If so, be part of our mighty team of engineers and play a key role in driving our business strategies. The Impact: We stand at the crossroads of innovation through Data Products to bring...

Job Purpose : We are seeking a highly skilled ETL Data Engineer to re-engineer our existing data pipelines to extract data from a new data source (PostgreSQL / CURA system) instead of the current Microsoft SQL Server (CRM persistence store), while preserving the existing load patterns to Elasticsearch and MongoDB. The engineer will ensure this migration has zero impact on data quality, system performance, or end-user experience. Key Responsibilities : Analyze existing ETL pipelines and their dependencies on Microsoft SQL Server as source systems. Design and implement modifications to repoint ETL extractions from PostgreSQL (CURA) while preserving the current transformations and load logic in...

Job Description: - You'll be Responsible for: Design, develop and implement cutting-edge AI/ML solutions, including Large Language Models (LLMs) and Generative AI applications Lead projects end-to-end while mentoring team members in AI-ML, including traditional ML and emerging AI technologies Drive innovation in AI agent development and orchestration for automated decision-making systems Establish best practices for responsible AI development and deployment What you'd have: AI-ML Engineer or Data Scientist with 3 - 11 years of relevant experience Strong expertise in modern AI frameworks and tools: ML/DL frameworks (TensorFlow, PyTorch, Keras, Sklearn) LLM frameworks (LangChain, LlamaIndex, C...

In this role as a Balance Sheet Analytics Developer within the Treasury ALM team at Citi, you will play a crucial part in designing and optimizing analytics tools that drive the forecasting of NIR/NIM, balance sheet planning, and rate risk assessments. Your primary focus will be on hands-on coding to build scalable and high-performance libraries using Python (NumPy, Polars), Cython, and/or C++ for production use. Key Responsibilities: - Develop and maintain Python-based analytics libraries for NIR/NIM modeling and IRRBB simulations - Optimize data pipelines using vectorized operations, memory-efficient structures, and just-in-time compilation (e.g. Cython) - Collaborate with Treasury, Risk, ...

As a Senior Data Scientist at AuxoAI, you will play a crucial role in leading strategic initiatives by applying advanced algorithms and scientific rigor to solve high-impact business problems and guide AI-native product development. Your technical depth, curiosity, and discipline will be key as you mentor others and translate complexity into clarity. **Responsibilities:** - Lead the design and development of algorithms across ML, causal inference, and AI problem spaces - Conduct exploratory data analysis, feature engineering, and statistical modeling with an emphasis on interpretability and reproducibility - Benchmark and optimize models using advanced algorithms such as gradient boosting (X...

AuxoAI is seeking a Senior Data Scientist with deep expertise in advanced algorithms and scientific rigor to lead strategic initiatives. In this role, you'll apply machine learning, causal inference, Bayesian methods, and statistical modeling to solve high-impact business problems and guide AI-native product development. This position is ideal for someone who combines technical depth with curiosity and discipline, and enjoys mentoring others while translating complexity into clarity. Location: Mumbai/Bengaluru/Hyderabad/ Gurgaon (Hybrid) Responsibilities Lead the design and development of algorithms across ML, causal inference, and AI problem spaces Conduct exploratory data analysis, feature...

As a Balance Sheet Analytics Developer in the Treasury ALM team at Citi, you will play a crucial role in designing and optimizing analytics tools that drive NIR/NIM forecasting, balance sheet planning, and rate risk assessments. Your primary focus will be on developing and maintaining Python-based analytics libraries for modeling and simulations, optimizing data pipelines, and collaborating with various teams to integrate tools into business workflows. Additionally, you will contribute to forecasting and scenario analysis, work with data from different systems, and support reporting cycles and results validation. Key Responsibilities: - Develop and maintain Python-based analytics libraries f...

The Balance Sheet Analytics & Management (BSAM) team is looking for a technically skilled Python developer with a strong understanding of Treasury, IRRBB, and ALM concepts. In this role, you will be responsible for designing and optimizing analytics tools that support Citis NIR/NIM forecasting, balance sheet planning, and rate risk assessments. Your primary focus will be on hands-on coding to develop scalable, high-performance libraries using Python (NumPy, Polars), Cython, and/or C++ for production purposes. Your key responsibilities will include developing and maintaining Python-based analytics libraries for NIR/NIM modeling and IRRBB simulations, optimizing data pipelines through vectoriz...