5 Spark Pools Jobs

Setup a job Alert
JobPe aggregates results for easy application access, but you actually apply on the job portal directly.

5.0 - 8.0 years

0 Lacs

hyderabad, telangana, india

On-site

Founded in 2006, ProArch began as a tight-knit team of business-minded IT professionals passionate about delivering exceptional cloud-based technology solutions. Today, we've grown into a global force spread across US, UK and India into multidisciplinary experts spanning cloud, infrastructure, data analytics, cybersecurity, compliance, and software development. Organizations turn to ProArch for forward-thinking guidance, seamless implementation, and dependable ongoing support partnering with us to reach every milestone on the path to their vision. Our services consist of specific practice areas that are methodically designed to complement and enhance each other's effectiveness. This intercon...

Posted 18 hours ago

AI Match Score
Apply

5.0 - 7.0 years

3 - 4 Lacs

hyderabad, telangana, india

On-site

Design, develop, and optimize data pipelines using Azure Synapse Analytics, Spark Pools, and Azure Data Factory. Write efficient Python and SQL code with a focus on scalability, performance, and optimization. Manage Azure Data Lake for structured and unstructured data ingestion at scale (volume, variety, velocity). Implement CI/CD pipelines and follow Data Ops practices for automation and reliability. Optimize data partitioning, versioning, and storage/compute costs for large-scale workloads. Ensure high-quality solutions through unit testing frameworks and automated validation. Collaborate with business teams to support analytics, reporting, and data science initiatives. Mentor junior engin...

Posted 1 week ago

AI Match Score
Apply

3.0 - 5.0 years

1 - 4 Lacs

hyderabad, telangana, india

On-site

Pro Arch is seeking a Senior Data Engineer with 3-5 years of experience to join our Data & Analytics practice. In this role, you will design and deliver scalable data solutions, optimize performance, and enable advanced analytics across cloud platforms. You will work with large-scale datasets, modern cloud-native technologies, and collaborate with business stakeholders to build reliable and secure data ecosystems. This position also involves mentoring junior engineers and driving best practices in DataOps and performance optimization. Responsibilities: Design, develop, and optimize data pipelines using Azure Synapse Analytics, Spark Pools, and Azure Data Factory. Write efficient Python and S...

Posted 1 week ago

AI Match Score
Apply

5.0 - 9.0 years

11 - 12 Lacs

pune, bengaluru

Work from Office

Location: Bangalore/ Pune Experience: 5 to 9 Years NP: Immediate We are hiring a Senior Azure Data Engineer to build scalable data pipelines using Azure Databricks, PySpark, and Spark Pools. The role involves transforming raw data into insights, integrating cloud data platforms, and deploying machine learning models. Candidates should have 5+ years of data engineering experience and strong skills in Python, PySpark, Azure Data Lake, and Blob Storage. Experience with ML tools like MLlib or TensorFlow is preferred. The role demands strong problem-solving and communication skills, with added value for those familiar with CI/CD, Git, Docker, or Power BI.

Posted 3 weeks ago

AI Match Score
Apply

3.0 - 7.0 years

0 Lacs

karnataka

On-site

Role Overview: As a Senior Azure Data Engineer, you will utilize Azure technologies to facilitate data transformation, analytics, and machine learning. Your primary responsibility will involve designing scalable Databricks data pipelines using PySpark to convert raw data into actionable insights. Additionally, you will be tasked with constructing, deploying, and managing machine learning models using MLlib or TensorFlow, all while optimizing cloud data integration from various Azure sources such as Blob Storage, Data Lake, and SQL/NoSQL databases. Your role will also encompass executing large-scale data processing using Spark Pools and fine-tuning configurations for efficiency. Key Responsib...

Posted 1 month ago

AI Match Score
Apply
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

Featured Companies