10 Pyarrow Jobs

The opportunity As an AI/ML Engineer, you will be part of Operation Center, India (INOPC-PG), aiming to develop a global value chain, where key business activities, resources, and expertise are shared across geographic boundaries to optimize value for Hitachi Energy customers across markets. As part of Transformers BU, we provide high-quality engineering and Technology to Hitachi Energy world. This is an important step from Hitachi Energy's Global Footprint strategy. How You'll Make An Impact A technically skilled and multidisciplinary professional to support the development, deployment, and scaling of an end-to-end analytical solution for monitoring and optimizing the Vapor Phase Drying (VP...

The Red Hat Experience Engineering (XE) team is looking for a skilled and well-rounded Data Engineer with excellent programming skills and the ability to partner with internal stakeholders to join our team in Pune, India. This team manages data created by the XE organization making it available to internal users for planning, reporting, business intelligence, and AI initiatives. To be successful in this role, you should have an established set of foundational skills and the ability to learn new skills quickly as we modernize platforms and tooling. You must also be able to work with minimal supervision in a fast-paced and ambiguous environment. You will be accountable for translating and mani...

Experience : 1.00 + years Salary : INR 1800000-2200000 / year (based on experience) Expected Notice Period : 15 Days Shift : (GMT+05:30) Asia/Kolkata (IST) Opportunity Type : Remote Placement Type : Full Time Permanent position(Payroll and Compliance to be managed by: Zero to 1) (*Note: This is a requirement for one of Uplers client - Zero to 1) What do you need for this opportunity Must have skills required: graph features (PPR, Graph/GraphRAG: Neo4j, Jaccard) for constrained recommendations, Re-rankers: cross-encoders, reranking with transformers, Languages: Python 3.10+, Classical ML: scikit-learn, cross-val, Data: pandas, Delta Lake (S3), Feature Engineering, LightGBM/XGBoost, model sele...

Business Information: The Hitachi Energy Indian Operations Center (INOPC) is a competence center with around 3000 skilled engineers who focus on tendering, engineering, planning, procurement, functional system testing, installation supervision, and commissioning. Over the last decade, it has evolved to become the largest engineering hub. The India Operations Centre is a key aspect of the Power Grids business Power Up transformation program. The INOPC team in Chennai supports Hitachi Energy's units in over 40 countries, covering all four business units in the Power Grid sector. To date, the team has executed engineering and commissioning for projects in more than 80 countries. Mission Stateme...

Minimum Requirements: At least 3 years of professional experience in Data Engineering Demonstrated end-to-end ownership of ETL pipelines Deep, hands-on experience with AWS services: EC2, Athena, Lambda, and Step Functions (non-negotiable) Strong proficiency in MySQL (non-negotiable) Working knowledge of Docker: setup, deployment, and troubleshooting Highly Preferred Skills: Experience with orchestration tools such as Airflow or similar Hands-on with PySpark Familiarity with the Python data ecosystem: SQLAlchemy, DuckDB, PyArrow, Pandas, NumPy Exposure to DLT (Data Load Tool) Ideal Candidate Profile: The role demands a builder's mindset over a maintainer's. Independent contributors with clear...

Experience : 1.00 + years Salary : INR 1800000-2200000 / year (based on experience) Expected Notice Period : 15 Days Shift : (GMT+05:30) Asia/Kolkata (IST) Opportunity Type : Remote Placement Type : Full Time Permanent position(Payroll and Compliance to be managed by: Zero to 1) (*Note: This is a requirement for one of Uplers client - Zero to 1) What do you need for this opportunity Must have skills required: graph features (PPR, Graph/GraphRAG: Neo4j, Jaccard) for constrained recommendations, Re-rankers: cross-encoders, reranking with transformers, Languages: Python 3.10+, Classical ML: scikit-learn, cross-val, Data: pandas, Delta Lake (S3), Feature Engineering, LightGBM/XGBoost, model sele...

Experience : 1.00 + years Salary : INR 1800000-2200000 / year (based on experience) Expected Notice Period : 15 Days Shift : (GMT+05:30) Asia/Kolkata (IST) Opportunity Type : Remote Placement Type : Full Time Permanent position(Payroll and Compliance to be managed by: Zero to 1) (*Note: This is a requirement for one of Uplers client - Zero to 1) What do you need for this opportunity Must have skills required: graph features (PPR, Graph/GraphRAG: Neo4j, Jaccard) for constrained recommendations, Re-rankers: cross-encoders, reranking with transformers, Languages: Python 3.10+, Classical ML: scikit-learn, cross-val, Data: pandas, Delta Lake (S3), Feature Engineering, LightGBM/XGBoost, model sele...

Experience : 1.00 + years Salary : INR 1800000-2200000 / year (based on experience) Expected Notice Period : 15 Days Shift : (GMT+05:30) Asia/Kolkata (IST) Opportunity Type : Remote Placement Type : Full Time Permanent position(Payroll and Compliance to be managed by: Zero to 1) (*Note: This is a requirement for one of Uplers client - Zero to 1) What do you need for this opportunity Must have skills required: graph features (PPR, Graph/GraphRAG: Neo4j, Jaccard) for constrained recommendations, Re-rankers: cross-encoders, reranking with transformers, Languages: Python 3.10+, Classical ML: scikit-learn, cross-val, Data: pandas, Delta Lake (S3), Feature Engineering, LightGBM/XGBoost, model sele...

The ideal candidate should have a minimum of 3 years of experience in Data Engineering with proven hands-on experience in ETL pipelines, specifically possessing end-to-end ownership. It is essential for the candidate to exhibit deep expertise in AWS Resources such as EC2, Athena, Lambda, and Step Functions as this is critical to the role. Proficiency in MySQL is non-negotiable. Moreover, experience in Docker including setup, deployment, and troubleshooting is required. Experience with Airflow or any modern orchestration tool, PySpark, Python Ecosystem, SQL Alchemy, DuckDB, PyArrow, Pandas, Numpy, and DLT (Data Load Tool) would be considered advantageous. The successful candidate should be a ...

As a Senior AI Developer/ AI Architect in the AI team, you will have the opportunity to collaborate with and mentor a team of developers. Your primary focus will be on the Fusion AI Team and its AI engine AI Talos, where you will work with Large language models, simulations, and Agentic AI to deliver cutting-edge AI capabilities in the service management space. Your responsibilities will include developing intricate python-based AI code to ensure the successful delivery of advanced AI functionalities. Additionally, you will play a crucial role in team mentoring, guiding junior/mid-level developers in managing their workload efficiently and ensuring tasks are completed according to the produc...