7 Sparkscala Jobs

As a Data Engineer at our company, you will be responsible for the following tasks: - Build and maintain scalable data pipelines using Apache Spark (Scala) - Design and implement cloud-native solutions on Google Cloud Platform (GCP) - Develop backend components using .NET (C#) - Create reusable and efficient code using Python - Work with relational databases, especially PostgreSQL - Follow CI/CD best practices, write automated tests, and work with Git - Collaborate in Agile (Scrum/Kanban) teams The ideal candidate for this role should possess the following qualifications: - 5+ years of experience in Data Engineering - 3+ years with Spark-Scala - 5+ years in Python development - Strong experi...

As a Lead GCP Data Engineer at our company, you will be responsible for the following key responsibilities: - Lead the end-to-end design and implementation of data pipelines, ETL/ELT processes, and data lake/warehouse solutions on GCP. - Architect scalable data platforms leveraging BigQuery, Dataflow, Pub/Sub, Dataproc, Cloud Storage, Composer, and Cloud Functions. - Drive adoption of data engineering best practices including CI/CD, version control, testing, monitoring, and cost optimization. To qualify for this role, you should meet the following required qualifications: - Bachelors or Masters degree in Computer Science, Engineering, or related field. - 6+ years of experience in data engine...

As a Big Data Developer, you will be responsible for utilizing your strong experience with big data technologies such as Hadoop, Unix, HDFS, Hive, Impala, etc. You should be proficient in using Spark/Scala and have experience with data Import/Export using tools like Sqoop. Additionally, you will work with automation tools like Airflow, Jenkins, or similar ones. Your excellent knowledge of SQL Server and database structures will be crucial in writing and optimizing T-SQL queries and stored procedures. Your key responsibilities will include: - Demonstrating ability to write and optimize T-SQL queries and stored procedures - Working with Jira/Confluence/GitLab - Handling multiple activities wit...

As a Technical Support Engineer for Big Data applications and systems in a Hadoop ecosystem, your responsibilities will include: - Providing technical support and troubleshooting for Big Data applications and systems built on the Hadoop ecosystem. - Monitoring system performance, analyzing logs, and identifying potential issues before they impact services. - Collaborating with engineering teams to deploy and configure Hadoop clusters and related components. - Assisting in maintenance and upgrades of Hadoop environments to ensure optimum performance and security. - Developing and maintaining documentation for processes, procedures, and system configurations. - Implementing data backup and rec...

You are being considered for the positions available at CMS Computers Limited in Mumbai (Bhandup) on a Work From Office basis. Below are the job details: **Data Analytics / BI Position:** - **Experience Required:** 2-3 years - **Location:** Mumbai (Bhandup) WFO - **Note:** Immediate to 15 days notice period will be considered - Seeking candidates with 2-3 years of experience in Investment, real estate, taxation, finance, and accounts. **CA Requirement:** - **Experience Required:** 8+ years - **Location:** Mumbai (Bhandup) WFO - **Note:** Immediate to 15 days notice period will be considered - The role involves leading the data Analytics / BI domain and requires skills in: - Python experience...

As a Data Engineer with 6 to 10 years of experience, you will be responsible for working with GCP, Spark-Scala, Python, and .NET technologies. This hybrid role based in Gurugram offers the opportunity to contribute to large-scale data platforms and cloud-native solutions. Your key responsibilities will include building and maintaining scalable data pipelines using Apache Spark (Scala), designing and implementing cloud-native solutions on Google Cloud Platform (GCP), developing backend components using .NET (C#), creating reusable and efficient code using Python, working with relational databases like PostgreSQL, following CI/CD best practices, writing automated tests, and collaborating in Ag...

As a Technical Support Engineer specializing in Big Data applications and systems within the Hadoop ecosystem, you will play a crucial role in ensuring the smooth operation, performance, and security of our data infrastructure. Your responsibilities will include providing technical support and troubleshooting for Big Data applications, monitoring system performance, collaborating with engineering teams to deploy and configure Hadoop clusters, and assisting in maintenance and upgrades of Hadoop environments. You will also be responsible for developing and maintaining documentation, implementing data backup and recovery procedures, participating in on-call rotations, and staying up to date wit...