16 Pyarrow Jobs

Job Title:Sr. Data Engineer Experience: 7+ Years Location: Remote Notice Period: Immediate Job Qualifications: 7+ years experience in building scalable enterprise data integration solutions; preferred on the Microsoft SQL Server and any MPP System (Teradata, Netezza etc.)Prefer Azure Data Warehouse/Database platforms. 1+ years of experience as a Python Developer. Good understanding of the Python software.development stacks, ecosystems, frameworks and tools such as Numpy, Pandas, Pyarrow. Experience in Azure functions, experience with vector db's, AI tools, Open AI, LLamaIndex, Lang chain Proficiency with data integration tools such as SSIS and Azure Data Factory (ADF), in-depth hands-on expe...

As a Data Engineer at this company, your role will involve architecting, building, and optimizing robust data pipelines and workflows. You will have end-to-end ownership of ETL pipelines and be required to have at least 3+ years of experience in Data Engineering. Key responsibilities include: - Proven hands-on experience with ETL pipelines - Deep experience with AWS resources such as EC2, Athena, Lambda, and Step Functions (non-negotiable) - Strong proficiency with MySQL (not negotiable) - Working with Docker for setup, deployment, and troubleshooting Additionally, it would be beneficial if you have experience with: - Airflow or any modern orchestration tool - PySpark, Python Ecosystem, SQL ...

Senior Data Scientist Experience Required: 6-8 years in data science or related field About the Role We are seeking an experienced Senior Data Scientist to join our team and help our clients drive data-driven decision making across our organization. In this role, you will leverage your deep expertise in statistical analysis, machine learning, and predictive modeling to solve complex business problems and deliver actionable insights using cutting-edge technologies. Key Responsibilities Lead end-to-end data science projects from problem definition through deployment and monitoring Conduct comprehensive exploratory data analysis (EDA) to uncover patterns, anomalies, and opportunities in complex...

In this role, you will leverage your deep expertise in statistical analysis, machine learning, and predictive modeling to solve complex business problems and deliver actionable insights using cutting-edge technologies. Provident fund

Responsibilities Building, Optimizing & supporting data pipelines utilizing SQL & Java Script in Snowflake Building & maintaining frameworks using stored procedures to simplify design patterns Working with DevOps team to standardize deploying python application Resolving overnight batch issues escalated by offshore team Perform Code review for other team members Has an eye for details, adhere to software development guidelines and adopt best practices Ability to work as a Individual contributor & collaborating with Global team Skills Required Good Communication, & problem-solving abilities Strong experience with Data Warehousing- OLTP, OLAP, Dimension, Facts, Data Modeling Strong experience ...

As a Senior MLOps Engineer, your role involves developing scalable and maintainable Python-based backend systems to support ML workflows. You will be responsible for building and optimizing APIs and services using frameworks like Flask and Django. Collaboration with cross-functional teams such as data science, DevOps, security, and QA is essential to ensure seamless integration of ML and LLM models into production. Additionally, you will design and maintain efficient database schemas, optimize query performance, and implement security measures to protect sensitive data. Your responsibilities also include debugging, testing, and enhancing existing systems for robustness and efficiency, suppor...

The opportunity As an AI/ML Engineer, you will be part of Operation Center, India (INOPC-PG), aiming to develop a global value chain, where key business activities, resources, and expertise are shared across geographic boundaries to optimize value for Hitachi Energy customers across markets. As part of Transformers BU, we provide high-quality engineering and Technology to Hitachi Energy world. This is an important step from Hitachi Energy's Global Footprint strategy. How You'll Make An Impact A technically skilled and multidisciplinary professional to support the development, deployment, and scaling of an end-to-end analytical solution for monitoring and optimizing the Vapor Phase Drying (VP...

The Red Hat Experience Engineering (XE) team is looking for a skilled and well-rounded Data Engineer with excellent programming skills and the ability to partner with internal stakeholders to join our team in Pune, India. This team manages data created by the XE organization making it available to internal users for planning, reporting, business intelligence, and AI initiatives. To be successful in this role, you should have an established set of foundational skills and the ability to learn new skills quickly as we modernize platforms and tooling. You must also be able to work with minimal supervision in a fast-paced and ambiguous environment. You will be accountable for translating and mani...

Experience : 1.00 + years Salary : INR 1800000-2200000 / year (based on experience) Expected Notice Period : 15 Days Shift : (GMT+05:30) Asia/Kolkata (IST) Opportunity Type : Remote Placement Type : Full Time Permanent position(Payroll and Compliance to be managed by: Zero to 1) (*Note: This is a requirement for one of Uplers client - Zero to 1) What do you need for this opportunity Must have skills required: graph features (PPR, Graph/GraphRAG: Neo4j, Jaccard) for constrained recommendations, Re-rankers: cross-encoders, reranking with transformers, Languages: Python 3.10+, Classical ML: scikit-learn, cross-val, Data: pandas, Delta Lake (S3), Feature Engineering, LightGBM/XGBoost, model sele...

Business Information: The Hitachi Energy Indian Operations Center (INOPC) is a competence center with around 3000 skilled engineers who focus on tendering, engineering, planning, procurement, functional system testing, installation supervision, and commissioning. Over the last decade, it has evolved to become the largest engineering hub. The India Operations Centre is a key aspect of the Power Grids business Power Up transformation program. The INOPC team in Chennai supports Hitachi Energy's units in over 40 countries, covering all four business units in the Power Grid sector. To date, the team has executed engineering and commissioning for projects in more than 80 countries. Mission Stateme...

Minimum Requirements: At least 3 years of professional experience in Data Engineering Demonstrated end-to-end ownership of ETL pipelines Deep, hands-on experience with AWS services: EC2, Athena, Lambda, and Step Functions (non-negotiable) Strong proficiency in MySQL (non-negotiable) Working knowledge of Docker: setup, deployment, and troubleshooting Highly Preferred Skills: Experience with orchestration tools such as Airflow or similar Hands-on with PySpark Familiarity with the Python data ecosystem: SQLAlchemy, DuckDB, PyArrow, Pandas, NumPy Exposure to DLT (Data Load Tool) Ideal Candidate Profile: The role demands a builder's mindset over a maintainer's. Independent contributors with clear...

Experience : 1.00 + years Salary : INR 1800000-2200000 / year (based on experience) Expected Notice Period : 15 Days Shift : (GMT+05:30) Asia/Kolkata (IST) Opportunity Type : Remote Placement Type : Full Time Permanent position(Payroll and Compliance to be managed by: Zero to 1) (*Note: This is a requirement for one of Uplers client - Zero to 1) What do you need for this opportunity Must have skills required: graph features (PPR, Graph/GraphRAG: Neo4j, Jaccard) for constrained recommendations, Re-rankers: cross-encoders, reranking with transformers, Languages: Python 3.10+, Classical ML: scikit-learn, cross-val, Data: pandas, Delta Lake (S3), Feature Engineering, LightGBM/XGBoost, model sele...

Experience : 1.00 + years Salary : INR 1800000-2200000 / year (based on experience) Expected Notice Period : 15 Days Shift : (GMT+05:30) Asia/Kolkata (IST) Opportunity Type : Remote Placement Type : Full Time Permanent position(Payroll and Compliance to be managed by: Zero to 1) (*Note: This is a requirement for one of Uplers client - Zero to 1) What do you need for this opportunity Must have skills required: graph features (PPR, Graph/GraphRAG: Neo4j, Jaccard) for constrained recommendations, Re-rankers: cross-encoders, reranking with transformers, Languages: Python 3.10+, Classical ML: scikit-learn, cross-val, Data: pandas, Delta Lake (S3), Feature Engineering, LightGBM/XGBoost, model sele...

Experience : 1.00 + years Salary : INR 1800000-2200000 / year (based on experience) Expected Notice Period : 15 Days Shift : (GMT+05:30) Asia/Kolkata (IST) Opportunity Type : Remote Placement Type : Full Time Permanent position(Payroll and Compliance to be managed by: Zero to 1) (*Note: This is a requirement for one of Uplers client - Zero to 1) What do you need for this opportunity Must have skills required: graph features (PPR, Graph/GraphRAG: Neo4j, Jaccard) for constrained recommendations, Re-rankers: cross-encoders, reranking with transformers, Languages: Python 3.10+, Classical ML: scikit-learn, cross-val, Data: pandas, Delta Lake (S3), Feature Engineering, LightGBM/XGBoost, model sele...

The ideal candidate should have a minimum of 3 years of experience in Data Engineering with proven hands-on experience in ETL pipelines, specifically possessing end-to-end ownership. It is essential for the candidate to exhibit deep expertise in AWS Resources such as EC2, Athena, Lambda, and Step Functions as this is critical to the role. Proficiency in MySQL is non-negotiable. Moreover, experience in Docker including setup, deployment, and troubleshooting is required. Experience with Airflow or any modern orchestration tool, PySpark, Python Ecosystem, SQL Alchemy, DuckDB, PyArrow, Pandas, Numpy, and DLT (Data Load Tool) would be considered advantageous. The successful candidate should be a ...

As a Senior AI Developer/ AI Architect in the AI team, you will have the opportunity to collaborate with and mentor a team of developers. Your primary focus will be on the Fusion AI Team and its AI engine AI Talos, where you will work with Large language models, simulations, and Agentic AI to deliver cutting-edge AI capabilities in the service management space. Your responsibilities will include developing intricate python-based AI code to ensure the successful delivery of advanced AI functionalities. Additionally, you will play a crucial role in team mentoring, guiding junior/mid-level developers in managing their workload efficiently and ensuring tasks are completed according to the produc...