70 Scala Programming Jobs

Scala,functional programming paradigm,Play Framework,Akka,Lagom. RESTful APIs, Microservices Architecture,API integration,concurrency, asynchronous programming,SQL/NoSQL, PostgreSQL, MySQL, Cassandra,MongoDB,SBT or Maven,Git, Docker,CI/CD pipelines

( Apply only if you have Scala Programming Hands-on Experience & RESTful APIs ) Job Location : Chennai / Hyderabad / Bangalore / Pune Role & responsibilities Responsibilities: Design, develop, and maintain high-performance, scalable, and maintainable Scala applications. Develop and maintain RESTful APIs using Scala frameworks Work with relational databases (e.g., MySQL, PostgreSQL) using SQL. Participate in all phases of the software development lifecycle, including requirements gathering, design, development, testing, and deployment.1 Troubleshoot and debug complex issues in Scala applications. Collaborate effectively with other developers, testers, and product managers. Stay up-to-date with the latest advancements in Scala, functional programming, and related technologies. Contribute to the improvement of our development processes and tools. Preferred candidate profile Required Skills: Strong proficiency in Scala programming language, including functional programming concepts. Hands-on experience with developing and deploying Scala applications. Experience with RESTful API development and design principles. Proficiency in SQL and working with relational databases. Strong understanding of Object-Oriented Programming (OOP) concepts. Excellent problem-solving and debugging skills. Strong communication and collaboration skills. Desired Skills: Experience with Scala frameworks like Play, Akka, or Spark. Experience with cloud platforms (AWS, Azure, GCP). Experience with containerization technologies (Docker, Kubernetes). Experience with Agile development methodologies (Scrum, Kanban). Contributions to open-source projects. Perks and benefits

Expertise in Java/Python, Scala & SPARK Architecture Ability to Comprehend the Business requirement & translate to the Technical requirements Familiar with development of life cycle including CI/CD pipelines Familiarity working with agile methodology Required Candidate profile Experience with big-data technologies Spark/Databricks and Hadoop/ADLS is a must Experience in any one of the cloud platform Azure (Preferred), AWS or Google

About Position: We are looking for Spark/Scala developer with hands on experience on ETL, Azure Databricks. Role: Spark Scala Developer Location: All Persistent Locations Experience: 8+ Years Job Type: Full Time Employment What You'll Do: Design and Development: Design and develop scalable data processing applications using Apache Spark and Scala. Data Processing: Develop Spark jobs to process large datasets, including data ingestion, transformation, and aggregation. Data Pipeline Development: Build and maintain data pipelines using Spark, Scala, and other related technologies. Data Quality: Ensure data quality and integrity by implementing data validation, data cleansing, and data normalization techniques. Performance Optimization: Optimize Spark jobs for performance, scalability, and reliability. Troubleshooting: Troubleshoot and resolve technical issues related to Spark and Scala applications. Expertise You'll Bring: Minimum 8 years experience of Data Engineering Experience in ETL/Pipeline Development using tools such as Azure Databricks/Apache Spark and Azure DataFactory with development expertise on batch and real-time data integration Experience in programming using Scala or Python Experience in writing the Store Procedures Experience in data ingestion, preparation, integration and operationalization techniques in optimally addressing the data requirements Experience in Cloud data warehouse like Azure Synapse, Snowflake analytical warehouse Experience with Orchestration tools, Azure DevOps and GitHub Experience in building end to end architecture for Data Lakes, Data Warehouses and Data Marts Experience in relational data processing technology like MS SQL, Delta lake, Spark SQL Experience to own end-to-end development, including coding, testing, debugging and deployment Extensive knowledge of ETL and Data Warehousing concepts, strategies, methodologies. Ability to provide solutions that are forward-thinking in data and analytics Must be team oriented with strong collaboration, prioritization, and adaptability skills required Excellent written and verbal communication skills including presentation skills Familiarity with Azure services like Azure functions, Azure Data Lake Store, Azure Cosmos Familiarity with Healthcare business data models Benefits: Competitive salary and benefits package Culture focused on talent development with quarterly promotion cycles and company-sponsored higher education and certifications Opportunity to work with cutting-edge technologies Employee engagement initiatives such as project parties, flexible work hours, and Long Service awards Annual health check-ups Insurance coverage: group term life, personal accident, and Mediclaim hospitalization for self, spouse, two children, and parents Inclusive Environment: Persistent Ltd. is dedicated to fostering diversity and inclusion in the workplace. We invite applications from all qualified individuals, including those with disabilities, and regardless of gender or gender preference. We welcome diverse candidates from all backgrounds. We offer hybrid work options and flexible working hours to accommodate various needs and preferences. Our office is equipped with accessible facilities, including adjustable workstations, ergonomic chairs, and assistive technologies to support employees with physical disabilities. If you are a person with disabilities and have specific requirements, please inform us during the application process or at any time during your employment. We are committed to creating an inclusive environment where all employees can thrive. Our company fosters a values-driven and people-centric work environment that enables our employees to: Accelerate growth, both professionally and personally Impact the world in powerful, positive ways, using the latest technologies Enjoy collaborative innovation, with diversity and work-life wellbeing at the core Unlock global opportunities to work and learn with the industry's best Let's unleash your full potential at Persistent "Persistent is an Equal Opportunity Employer and prohibits discrimination and harassment of any kind."

Data Engineer Experience- 5 to 9 years Location: Pune Skillset is below: Candidates should have data engineering experience with Spark. Language can be anything between Scala/Python/Java. Only experienced spark developers can be trained on Scala.

Must-Have Skills: 5 to 8 years of backend development experience Strong proficiency in Core Java and Scala Hands-on experience with Spring Framework Cloud technologies and microservices architecture Multithreaded programming and concurrency Scripting (e.g., Shell , Perl ) and UNIX/Linux Working knowledge of relational databases (Sybase, DB2) Excellent communication and problem-solving skills Data Bricks primary Good to Have: Experience with Apache Spark , Hadoop , or other big data tools Familiarity with FIX Protocol , MQ , XML/DTD Exposure to CI/CD tools and Test-Driven Development Domain understanding of Equity or Fixed Income trade lifecycle Strong debugging and performance profiling capabilities

Role Purpose The purpose of this role is to design, test and maintain software programs for operating systems or applications which needs to be deployed at a client end and ensure its meet 100% quality assurance parameters Do 1. Instrumental in understanding the requirements and design of the product/ software Develop software solutions by studying information needs, studying systems flow, data usage and work processes Investigating problem areas followed by the software development life cycle Facilitate root cause analysis of the system issues and problem statement Identify ideas to improve system performance and impact availability Analyze client requirements and convert requirements to feasible design Collaborate with functional teams or systems analysts who carry out the detailed investigation into software requirements Conferring with project managers to obtain information on software capabilities 2. Perform coding and ensure optimal software/ module development Determine operational feasibility by evaluating analysis, problem definition, requirements, software development and proposed software Develop and automate processes for software validation by setting up and designing test cases/scenarios/usage cases, and executing these cases Modifying software to fix errors, adapt it to new hardware, improve its performance, or upgrade interfaces. Analyzing information to recommend and plan the installation of new systems or modifications of an existing system Ensuring that code is error free or has no bugs and test failure Preparing reports on programming project specifications, activities and status Ensure all the codes are raised as per the norm defined for project / program / account with clear description and replication patterns Compile timely, comprehensive and accurate documentation and reports as requested Coordinating with the team on daily project status and progress and documenting it Providing feedback on usability and serviceability, trace the result to quality risk and report it to concerned stakeholders 3. Status Reporting and Customer Focus on an ongoing basis with respect to project and its execution Capturing all the requirements and clarifications from the client for better quality work Taking feedback on the regular basis to ensure smooth and on time delivery Participating in continuing education and training to remain current on best practices, learn new programming languages, and better assist other team members. Consulting with engineering staff to evaluate software-hardware interfaces and develop specifications and performance requirements Document and demonstrate solutions by developing documentation, flowcharts, layouts, diagrams, charts, code comments and clear code Documenting very necessary details and reports in a formal way for proper understanding of software from client proposal to implementation Ensure good quality of interaction with customer w.r.t. e-mail content, fault report tracking, voice calls, business etiquette etc Timely Response to customer requests and no instances of complaints either internally or externally Mandatory Skills: Scala programming. Experience: 5-8 Years.

Long Description Experienceand Expertise inany of the followingLanguagesat least 1 of them : Java, Scala, Python Experienceand expertise in SPARKArchitecture Experience in the range of 6-10 yrs plus Good Problem SolvingandAnalytical Skills Ability to Comprehend the Business requirementand translate to the Technical requirements Good communicationand collaborative skills with fellow teamandacross Vendors Familiar with development of life cycle includingCI/CD pipelines. Proven experienceand interested in supportingexistingstrategicapplications Familiarity workingwithagile methodology Mandatory Skills: Scala programming.: Experience: 5-8 Years.

Responsibilities: * Design, develop, test & maintain Scala applications using Spark. * Collaborate with cross-functional teams on project delivery. * Optimize application performance through data analysis.

Responsibilities Data engineering lead role for D&Ai data modernization (MDIP) Ideally Candidate must be flexible to work an alternative schedule either on tradition work week from Monday to Friday; or Tuesday to Saturday or Sunday to Thursday depending upon coverage requirements of the job. The can didate can work with immediate supervisor to change the work schedule on rotational basis depending on the product and project requirements. Responsibilities Manage a team of data engineers and data analysts by delegating project responsibilities and managing their flow of work as well as empowering them to realize their full potential. Design, structure and store data into unified data models and link them together to make the data reusable for downstream products. Manage and scale data pipelines from internal and external data sources to support new product launches and drive data quality across data products. Create reusable accelerators and solutions to migrate data from legacy data warehouse platforms such as Teradata to Azure Databricks and Azure SQL. Enable and accelerate standards-based development prioritizing reuse of code, adopt test-driven development, unit testing and test automation with end-to-end observability of data Build and own the automation and monitoring frameworks that captures metrics and operational KPIs for data pipeline quality, performance and cost. Collaborate with internal clients (product teams, sector leads, data science teams) and external partners (SI partners/data providers) to drive solutioning and clarify solution requirements. Evolve the architectural capabilities and maturity of the data platform by engaging with enterprise architects to build and support the right domain architecture for each application following well-architected design standards. Define and manage SLAs for data products and processes running in production. Create documentation for learnings and knowledge transfer to internal associates. Qualifications 12+ years of engineering and data management experience Qualifications 12+ years of overall technology experience that includes at least 5+ years of hands-on software development, data engineering, and systems architecture. 8+ years of experience with Data Lakehouse, Data Warehousing, and Data Analytics tools. 6+ years of experience in SQL optimization and performance tuning on MS SQL Server, Azure SQL or any other popular RDBMS 6+ years of experience in Python/Pyspark/Scala programming on big data platforms like Databricks 4+ years in cloud data engineering experience in Azure or AWS. Fluent with Azure cloud services. Azure Data Engineering certification is a plus. Experience with integration of multi cloud services with on-premises technologies. Experience with data modelling, data warehousing, and building high-volume ETL/ELT pipelines. Experience with data profiling and data quality tools like Great Expectations. Experience building/operating highly available, distributed systems of data extraction, ingestion, and processing of large data sets. Experience with at least one business intelligence tool such as Power BI or Tableau Experience with running and scaling applications on the cloud infrastructure and containerized services like Kubernetes. Experience with version control systems like ADO, Github and CI/CD tools for DevOps automation and deployments. Experience with Azure Data Factory, Azure Databricks and Azure Machine learning tools. Experience with Statistical/ML techniques is a plus. Experience with building solutions in the retail or in the supply chain space is a plus. Understanding of metadata management, data lineage, and data glossaries is a plus. BA/BS in Computer Science, Math, Physics, or other technical fields. Candidate must be flexible to work an alternative work schedule either on tradition work week from Monday to Friday; or Tuesday to Saturday or Sunday to Thursday depending upon product and project coverage requirements of the job. Candidates are expected to be in the office at the assigned location at least 3 days a week and the days at work needs to be coordinated with immediate supervisor Skills, Abilities, Knowledge: Excellent communication skills, both verbal and written, along with the ability to influence and demonstrate confidence in communications with senior level management. Proven track record of leading, mentoring data teams. Strong change manager. Comfortable with change, especially that which arises through company growth. Ability to understand and translate business requirements into data and technical requirements. High degree of organization and ability to manage multiple, competing projects and priorities simultaneously. Positive and flexible attitude to enable adjusting to different needs in an ever-changing environment. Strong leadership, organizational and interpersonal skills; comfortable managing trade-offs. Foster a team culture of accountability, communication, and self-management. Proactively drives impact and engagement while bringing others along. Consistently attain/exceed individual and team goals. Ability to lead others without direct authority in a matrixed environment. Comfortable working in a hybrid environment with teams consisting of contractors as well as FTEs spread across multiple PepsiCo locations. Domain Knowledge in CPG industry with Supply chain/GTM background is preferred.

One of our prestigious client is looking for to hire candidates for the below position Position Type : Sr. Data Scientist Years of Experience: 5 - 7 Years Number of positions: 2 nos Salary / CTC : upto 38 LPA (based on your current salary and on the interview evaluation) Job Summary Responsibilities: Help design and build the next iteration of process automation in Core Map processes employing a highly scalable Big Data infrastructure and machine learning as applied to global-scale digital map-making. Build and test analytic and statistical models to improve a wide variety of both internal data-driven processes for map-making data decisions and system control needs. Act as an expert and evangelist in the areas of data mining, machine learning, statistics, and predictive analysis and modeling. Requirements: MS or PhD in a discipline such as Statistics, Applied Mathematics, Computer Science, or Econometrics with an emphasis or thesis work on one or more of the following: computational statistics/science/engineering, data mining, machine learning, and optimization. Minimum of 5 years related, professional experience. Knowledge of data mining and analytic methods such as regression, classifiers, clustering, association rules, decision trees, Bayesian network analysis, etc. We should have expert-level knowledge in one or more of these areas. Knowledge of Computer Vision, Deep Learning and Point Cloud Processing algorithms. Proficiency with a statistical analysis package and associated scripting language such as Python, R, Matlab, SAS, etc. Programming experience with SQL, shell script, Python, etc. Knowledge of and ideally some experience with MLOps will be preferred. Knowledge of and ideally some experience with tools such as Pig, Hive, etc., for working with big data in Hadoop and/or Spark for data extraction and data prep for analysis. Experience with and demonstrated capability to effectively interact with both internal and external customer executives, technical and non-technical to explain uses and value of predictive systems and techniques. Demonstrated proficiency with understanding, specifying and explaining predictive modeling solutions and organizing teams of other data scientists and engineers to execute projects delivering those solutions. Preferred Qualifications: Development experience with Java and Scala Development experience with Docker Development experience with GIS data Development experience with NoSQL (i.e. DynamoDB) Knowledge of GPU programming (CUDA or OpenCL) on GPU accelerator architecture ================================================================= Please provide us the following information. along with your updated resume: Your Total Experience: Your Relevant Development Experience in Java: Your Relevant Development Experience in Scala programming: Your Relevant Development Experience with Docker: Your Relevant Development Experience with GIS data: Your Relevant Development Experience with NoSQL (i.e. DynamoDB): Your Relevant Experience with GPU programming (CUDA or OpenCL) on GPU accelerator architecture: Your latest Education with year of passing/percentage: Your Certification (any): If yes, Provide the your code or share the Certication copy: Your Notice Period: Is Buyout option available (yes/no): if yes, Do mention the Buyout notice period amount: Your Current Location: Your Preferred Location: Work from Office / Hybrid: Your Current Salary : Your Expected Salary : Any active offer (yes/no) : If yes, do mention your current offered salary details / offered company name : Your Preferred Interview Date / Time:

One of our prestigious client is looking for to hire candidates for the below position Position Type: Senior Software Engineer Years of Experience : 5 to 7 years Number of positions : 2 nos Salary / CTC : upto 32.00 LPA (based on the current salary and on the interview evaluation) Notice Period : Immediate Job Summary Sr Software Engineer The Senior Software Engineer will be a major contributor on the team to deliver digital maps to major automakers. You will work on technology to collect and process road information from many sources, terabytes of data, including car sensors from millions of cars on the road. Our services convert this input into a digital map which is delivered back to the cars and used for navigation, driver assistance and even autonomous driving. Developers building new services will rapidly launch their differentiated prototypes leveraging templates that enforce security, availability, and efficiency best-practices with a minimal collection of service-specific libraries. Role Be responsible for providing design and development leadership in delivering new software products and tools from the ground up and extend and maintaining them in an innovative environment used for processing map data Implement tools to enhance both automated and semi-automated map data processing, involving backend/service-based software stacks, but also dashboard components for data tracking and analysis Own and drive technical leadership and in-depth solutions in an innovative and fast-paced environment Own one or more components of software architecture in immediate environment Apply and extended CI/CD tools and execute end-2-end ownership of your developed software stack, including DevOps and testing aspects Work closely with other full stack and frontend engineers on the team to de/-refine APIs and system integrations Work with other engineering teams and internal customers to identify new opportunities, address critical needs, and solve complex problems using your backend development expertise Become an expert at leveraging internal platform resources and APIs Drive initiatives that contribute in development of software that is efficient, re-usable and reliable (e.g. agile, coding, verification) Be part of an agile team, share knowledge, carry out code reviews Who are you? 5+ years of software development experience Excellent applied skills in Java and/or Scala programming, in combination with backend architecture, messaging technologies and related frameworks Cloud Experience (AWS/Azure/IBM/Oracle) Strong and applied experience in REST based web service technologies, JSON and XML, SOA and micro services architecture Strong and applied DBMS & SQL skills, with a strong preference on PostgreSQL / PostGIS Strong and applied AWS skills (EC2, S3, RDS,), as well as experience with virtualization tools like Docker Strong experience CI/CD tools, with a preference on Jenkins Good knowledge of using issue tracking tools (e.g., JIRA), code collaboration tools (e.g., Git/GitLab) and team collaboration tools (e.g., Confluence/Wiki). Good knowledge of Linux/Unix familiar with shell scripting Able to translate business and architectural features into quality, consistent software design Solid knowledge of programming practices, strive to write great code that is reusable, flexible, and reliable. Strong quality mindset is considered a must: unit testing, performance testing, writing testable code Self-motivated, well-organized, detail-oriented and a strong team player with an agile mindset What Youll Get: Challenging problems to solve Opportunities to learn cool new things Work that makes a difference in the world Freedom to decide how to perform your work Variety in the types of projects Feedback so you will know how well you are doing Collaborative, Supportive Colleagues ============================================================ Please provide us the following information. along with your updated resume: Your Total Experience: Your Relevant Experience in Java : Your Relevant Experience in Scala programming : Your Relevant Experience in Cloud (Azure): Your Relevant Experience in Cloud (AWS): Your Relevant Experience in Cloud (IBM): Your Relevant Experience in Cloud (Oracle): Your Relevant Experience in Cloud (GCP): Your latest Education with year of passing/percentage: Your Certification (any): If yes, Provide the your code or share the Certication copy: Your Notice Period: Is Buyout option available (yes/no): if yes, Do mention the Buyout notice period amount: Your Current Location: Your Preferred Location: Work from Office / Hybrid: Your Current Salary : Your Expected Salary : Any active offer (yes/no) : If yes, do mention your current offered salary details / offered company name : Your Preferred Interview Date / Time:

We're looking for talented software engineers with a passion for learning and a systems-oriented view of software engineering to join our team working full-time on the core of our proprietary database based on Apache Cassandra. In this position you will be working in an important role on a complex infrastructure project used by many major organizations across the world, and collaborating with fellow engineers to improve the project. If you want to work on the most interesting problems of your career with the most collaborative and skilled peers you've ever worked with, this might be the role for you! You'll take on a critical role on the core of our platform, working on enhancements and bug-fixes on our multi-model distributed database. Engineers on this team collaborate extensively with internal teams across to coordinate for releases, support existing customers through defect fixes and improvements, and review and advise on documentation for the project. We’re looking for engineers that have a knack for untangling complex knots in code-bases and concurrent systems, with expertise in a C-lineage language (Java, Scala, Kotlin, C#, C++, Rust, etc). A gut passion for quality, elegance, performance and simplicity in solutions and code is critical in this role.If you're comfortable in navigating multi-threaded, large distributed systems at scale this will be a great fit. What you will do: Author, debug, and improve code in the core of DataStax Enterprise Cassandra Actively and self-driven collaborate with other engineers, field team and support members Work on maintenance, bug fixes , new feature development and improvements to the platform Help prepare different teams for DSE releases (documentation, field, etc) Required education Bachelor's Degree Preferred education Master's Degree Required technical and professional expertise 4-6 years of relevant experience Expertise in at least one C-lineage language that supports OOP and FP (Java, Scala, Kotlin, C#, C++, Rust, etc) Ability to work autonomously, self-manage your time, and to an extent self-direct when given high level strategic priorities Ability to communicate clearly with peers and stakeholders verbally and via text (video calls, JIRA, Slack, email) Demonstrated ability to focus on analytical tasks such as finding issues in a huge, distributed system A desire to learn and grow daily, both technically and w/soft-skills interpersonally An open-minded and collaborative attitude Preferred technical and professional experience Expertise in Java and Scala programming on the JVM Experience with concurrency, memory management and I/O Experience with Linux or other Unix-like systems Experience with distributed databases, DataStax Enterprise or Apache Cassandra in particular Experience with distributed computing platforms, Apache Spark in particular

We're looking for talented software engineers with a passion for learning and a systems-oriented view of software engineering to join our team working full-time on the core of our proprietary database based on Apache Cassandra. In this position you will be working in an important role on a complex infrastructure project used by many major organizations across the world, and collaborating with fellow engineers to improve the project. If you want to work on the most interesting problems of your career with the most collaborative and skilled peers you've ever worked with, this might be the role for you! You'll take on a critical role on the core of our platform, working on enhancements and bug-fixes on our multi-model distributed database. Engineers on this team collaborate extensively with internal teams across to coordinate for releases, support existing customers through defect fixes and improvements, and review and advise on documentation for the project. We’re looking for engineers that have a knack for untangling complex knots in code-bases and concurrent systems, with expertise in a C-lineage language (Java, Scala, Kotlin, C#, C++, Rust, etc). A gut passion for quality, elegance, performance and simplicity in solutions and code is critical in this role.If you're comfortable in navigating multi-threaded, large distributed systems at scale this will be a great fit. What you will do: Author, debug, and improve code in the core of DataStax Enterprise Cassandra Actively and self-driven collaborate with other engineers, field team and support members Work on maintenance, bug fixes , new feature development and improvements to the platform Help prepare different teams for DSE releases (documentation, field, etc) Required education Bachelor's Degree Preferred education Master's Degree Required technical and professional expertise 7 – 9 + years of relevant work experience Expertise in at least one C-lineage language that supports OOP and FP (Java, Scala, Kotlin, C#, C++, Rust, etc) Ability to work autonomously, self-manage your time, and to an extent self-direct when given high level strategic priorities Ability to communicate clearly with peers and stakeholders verbally and via text (video calls, JIRA, Slack, email) Demonstrated ability to focus on analytical tasks such as finding issues in a huge, distributed system A desire to learn and grow daily, both technically and w/soft-skills interpersonally An open-minded and collaborative attitude Preferred technical and professional experience Expertise in Java and Scala programming on the JVM Experience with concurrency, memory management and I/O Experience with Linux or other Unix-like systems Experience with distributed databases, DataStax Enterprise or Apache Cassandra in particular Experience with distributed computing platforms, Apache Spark in particular

Roles and Responsibilities Design, develop, test, and deploy scalable big data solutions using Scala programming language. Collaborate with cross-functional teams to identify business requirements and design technical solutions. Implement data pipelines using Spark, Hive, Hadoop, Kafka for large-scale data processing. Troubleshoot complex issues related to big data processing and provide timely resolutions. Stay up-to-date with industry trends and best practices in big data technologies. Desired Candidate Profile 2-7 years of experience in developing big data applications using Scala programming language. Strong understanding of Spark, Hive, Hadoop, Kafka concepts and their applications in real-world scenarios. Bachelor's degree in Any Specialization (BCA or B.Sc). Proficiency in working on Windows OS environment.

About The Role This is an Internal document. Job TitleSenior Data Engineer About The Role As a Senior Data Engineer, you will play a key role in designing and implementing data solutions @Kotak811. You will be responsible for leading data engineering projects, mentoring junior team members, and collaborating with cross-functional teams to deliver high-quality and scalable data infrastructure. Your expertise in data architecture, performance optimization, and data integration will be instrumental in driving the success of our data initiatives. Responsibilities 1. Data Architecture and Designa. Design and develop scalable, high-performance data architecture and data models. b. Collaborate with data scientists, architects, and business stakeholders to understand data requirements and design optimal data solutions. c. Evaluate and select appropriate technologies, tools, and frameworks for data engineering projects. d. Define and enforce data engineering best practices, standards, and guidelines. 2. Data Pipeline Development & Maintenancea. Develop and maintain robust and scalable data pipelines for data ingestion, transformation, and loading for real-time and batch-use-cases b. Implement ETL processes to integrate data from various sources into data storage systems. c. Optimise data pipelines for performance, scalability, and reliability. i. Identify and resolve performance bottlenecks in data pipelines and analytical systems. ii. Monitor and analyse system performance metrics, identifying areas for improvement and implementing solutions. iii. Optimise database performance, including query tuning, indexing, and partitioning strategies. d. Implement real-time and batch data processing solutions. 3. Data Quality and Governancea. Implement data quality frameworks and processes to ensure high data integrity and consistency. b. Design and enforce data management policies and standards. c. Develop and maintain documentation, data dictionaries, and metadata repositories. d. Conduct data profiling and analysis to identify data quality issues and implement remediation strategies. 4. ML Models Deployment & Management (is a plus) This is an Internal document. a. Responsible for designing, developing, and maintaining the infrastructure and processes necessary for deploying and managing machine learning models in production environments b. Implement model deployment strategies, including containerization and orchestration using tools like Docker and Kubernetes. c. Optimise model performance and latency for real-time inference in consumer applications. d. Collaborate with DevOps teams to implement continuous integration and continuous deployment (CI/CD) processes for model deployment. e. Monitor and troubleshoot deployed models, proactively identifying and resolving performance or data-related issues. f. Implement monitoring and logging solutions to track model performance, data drift, and system health. 5. Team Leadership and Mentorshipa. Lead data engineering projects, providing technical guidance and expertise to team members. i. Conduct code reviews and ensure adherence to coding standards and best practices. b. Mentor and coach junior data engineers, fostering their professional growth and development. c. Collaborate with cross-functional teams, including data scientists, software engineers, and business analysts, to drive successful project outcomes. d. Stay abreast of emerging technologies, trends, and best practices in data engineering and share knowledge within the team. i. Participate in the evaluation and selection of data engineering tools and technologies. Qualifications1. 3-5 years" experience with Bachelor's Degree in Computer Science, Engineering, Technology or related field required 2. Good understanding of streaming technologies like Kafka, Spark Streaming. 3. Experience with Enterprise Business Intelligence Platform/Data platform sizing, tuning, optimization and system landscape integration in large-scale, enterprise deployments. 4. Proficiency in one of the programming language preferably Java, Scala or Python 5. Good knowledge of Agile, SDLC/CICD practices and tools 6. Must have proven experience with Hadoop, Mapreduce, Hive, Spark, Scala programming. Must have in-depth knowledge of performance tuning/optimizing data processing jobs, debugging time consuming jobs. 7. Proven experience in development of conceptual, logical, and physical data models for Hadoop, relational, EDW (enterprise data warehouse) and OLAP database solutions. 8. Good understanding of distributed systems 9. Experience working extensively in multi-petabyte DW environment 10. Experience in engineering large-scale systems in a product environment

Location- Coimbatore Exp- 5 + yrs Responsibilities: * Design, develop & maintain data pipelines using Scala & Python with Spark on Hadoop. * Collaborate with cross-functional teams to ensure data accuracy & timeliness.

You are a global information technology, consulting, and business process services company headquartered in India, offering a wide range of services such as IT consulting, application development, business process outsourcing, and digital solutions to clients across diverse industries in over 167 countries. Your focus is on providing technology-driven solutions to enhance efficiency and innovation, contributing significantly to the digital transformation of businesses worldwide. You are looking for a Software Engineer with 5-8 years of experience, who is proficient in Scala programming, and has hands-on experience working in a globally distributed team. It is essential for the candidate to have experience with big-data technologies like Spark/Databricks and Hadoop/ADLS. Additionally, experience in cloud platforms such as Azure (Preferred), AWS, or Google is required, along with expertise in building data lakes and data pipelines using Azure, Databricks, or similar tools. The ideal candidate should be familiar with the development life cycle, including CI/CD pipelines, and have experience in Business Intelligence project development, preferably with Microsoft SQL Server BI stack (SSAS/SSIS). Data warehousing knowledge, designing Star schema/Snowflaking, working in source-controlled environments like GitHub, Subversion, and agile methodology are also necessary skills. You should have a proven track record of producing secure and clean code, strong analytical and problem-solving skills, and the ability to work effectively within the complexity and boundaries of a leading global organization. Being a flexible and resilient team player with strong interpersonal skills, taking initiative to drive projects forward, is highly valued. While experience in financial services is a plus, it is not required. Fluency in English is a must for this role. Interested candidates can respond by submitting their updated resumes. For more job opportunities, please visit Jobs In India - VARITE. If you are not available or interested in this position, you are encouraged to refer potential candidates who might be a good fit. VARITE offers a Candidate Referral program where you can earn a one-time referral bonus based on the experience level of the referred candidate upon completion of a three-month assignment with VARITE. VARITE is a global staffing and IT consulting company that provides technical consulting and team augmentation services to Fortune 500 Companies in the USA, UK, Canada, and India. You are a primary and direct vendor to leading corporations in various verticals, including Networking, Cloud Infrastructure, Hardware and Software, Digital Marketing and Media Solutions, Clinical Diagnostics, Utilities, Gaming and Entertainment, and Financial Services. VARITE is an Equal Opportunity Employer committed to creating a diverse and inclusive workplace environment.,

Responsibilities: * Design, develop & maintain data pipelines using Scala/Python & Hadoop/Spark. * Ensure data quality through testing & monitoring. * Collaborate with cross-functional teams on big data initiatives.

The purpose of this role is to design, test and maintain software programs for operating systems or applications which needs to be deployed at a client end and ensure its meet 100% quality assurance parameters Do 1. Instrumental in understanding the requirements and design of the product/ software Develop software solutions by studying information needs, studying systems flow, data usage and work processes Investigating problem areas followed by the software development life cycle Facilitate root cause analysis of the system issues and problem statement Identify ideas to improve system performance and impact availability Analyze client requirements and convert requirements to feasible design Collaborate with functional teams or systems analysts who carry out the detailed investigation into software requirements Conferring with project managers to obtain information on software capabilities 2. Perform coding and ensure optimal software/ module development Determine operational feasibility by evaluating analysis, problem definition, requirements, software development and proposed software Develop and automate processes for software validation by setting up and designing test cases/scenarios/usage cases, and executing these cases Modifying software to fix errors, adapt it to new hardware, improve its performance, or upgrade interfaces. Analyzing information to recommend and plan the installation of new systems or modifications of an existing system Ensuring that code is error free or has no bugs and test failure Preparing reports on programming project specifications, activities and status Ensure all the codes are raised as per the norm defined for project / program / account with clear description and replication patterns Compile timely, comprehensive and accurate documentation and reports as requested Coordinating with the team on daily project status and progress and documenting it Providing feedback on usability and serviceability, trace the result to quality risk and report it to concerned stakeholders 3. Status Reporting and Customer Focus on an ongoing basis with respect to project and its execution Capturing all the requirements and clarifications from the client for better quality work Taking feedback on the regular basis to ensure smooth and on time delivery Participating in continuing education and training to remain current on best practices, learn new programming languages, and better assist other team members. Consulting with engineering staff to evaluate software-hardware interfaces and develop specifications and performance requirements Document and demonstrate solutions by developing documentation, flowcharts, layouts, diagrams, charts, code comments and clear code Documenting very necessary details and reports in a formal way for proper understanding of software from client proposal to implementation Ensure good quality of interaction with customer w.r.t. e-mail content, fault report tracking, voice calls, business etiquette etc Timely Response to customer requests and no instances of complaints either internally or externally Mandatory Skills: Scala programming. Experience: 5-8 Years.

About The Role Project Role : Software Development Engineer Project Role Description : Analyze, design, code and test multiple components of application code across one or more clients. Perform maintenance, enhancements and/or development work. Must have skills : Scala Good to have skills : NAMinimum 5 year(s) of experience is required Educational Qualification : 15 years of full time education Summary :As a Software Development Engineer, you will be responsible for analyzing, designing, coding, and testing multiple components of application code using Scala programming language. Your typical day will involve working on software development projects, collaborating with cross-functional teams, and ensuring the quality of the codebase. Roles & Responsibilities:- Design, develop, and maintain software applications using Scala programming language.- Collaborate with cross-functional teams to identify and prioritize software development projects.- Perform maintenance, enhancements, and/or development work on existing software applications.- Ensure the quality of the codebase by writing unit tests, performing code reviews, and adhering to coding standards. Professional & Technical Skills: - Proficiency in Scala programming language.- Experience with software development methodologies such as Agile or Scrum.- Strong understanding of object-oriented programming principles.- Experience with software development tools such as Git, JIRA, and Jenkins.- Experience with database technologies such as SQL and NoSQL.- Solid grasp of software testing methodologies, including unit testing and integration testing. Additional Information:- The candidate should have a minimum of 3 years of experience in Scala programming language.- The ideal candidate will possess a strong educational background in computer science or a related field, along with a proven track record of delivering high-quality software applications.- This position is based at our Pune office. Qualification 15 years of full time education

Role & responsibilities Tech Stack - Spark, Scala, EMR, Glue, Agile, SQL Required Skills As a Senior Spark Engineer (Scala), youll partner in a team of experienced software engineers, removing impediments and enabling the teams to deliver business value. Ensure team ownership of legacy systems with an emphasis on maintaining operational stability. Be a passionate leader committed to the development and mentorship of your teams. Partner with business and IT stakeholders to ensure alignment with key corporate priorities. Share ideas and work to bring people together to help solve sophisticated problems. Create a positive and collaborative environment by championing open communication and soliciting continuous feedback. Stay current with new technology trends. Additional Responsibilities Participates in the discussion and documentation of best practices and standards for application development Complies with all company policies and procedures Remains current in profession and industry trends Successfully completes regulatory and job training requirements Required Experience 5+ years of hands-on software engineering experience with any object-oriented language, Scala. 5+ years of experience using Spark, EMR, Glue or other serverless compute technology in the Cloud. 5+ years of experience architecting and enhancing data platforms and service-oriented architectures. Experience working within Agile/DevSecOps development environments. Excellent communication, collaboration, and mentoring skills. More recent experience in Cloud development preferred. Experience working with modern, web-based architectures, including REST APIs, Serverless, event-driven microservices. Bachelor’s degree or equivalent in Computer Science, Information Technology, or related discipline. Desired Experience Experience working with financial management stakeholders. Experience with Workday or other large ERP platforms desired. Life Insurance or financial services industry experience a plus.

Position Summary We are seeking a Senior Backend Engineer who takes full ownership of their work and brings a responsible, reliable, and proactive mindset. You should be a clear communicator, open to learning, and capable of independently driving features while applying best practices from prior experience. A leadership attitude and willingness to mentor others are highly valued. Experience Required: 3 to 6 Years Job Type: Permanent Responsibilities Lead the design, development, and deployment of robust backend services using Scala and modern frameworks. Develop and maintain event-driven, microservice-based distributed systems. Ensure systems are well-tested with strong unit and integration test coverage. Collaborate with cross-functional teams to deliver scalable, secure, and maintainable software. Implement and improve monitoring, alerting, and debugging workflows. Advocate for clean code, technical excellence, and engineering best practices. Take initiative in identifying and resolving performance bottlenecks and production issues. Required Skills & Qualifications Proven expertise in Scala (2.13+) , Play Framework , and Akka Actors . Experience designing RESTful APIs , working with GraphQL , and building event-driven microservices . Solid testing skills including unit testing , integration testing , and use of mocking frameworks . Hands-on experience with PostgreSQL and MySQL . Proficient with AWS services: S3 , RDS Aurora , Kinesis , Athena , CloudWatch . Strong focus on monitoring , debugging , and observability using tools like Datadog , Rollbar , and Sumo Logic . Familiarity with incident response processes and postmortem culture. Preferred Qualifications Experience leading projects or mentoring team members. Background in debugging complex, distributed systems in production. Enthusiastic about continuous learning and fostering a collaborative engineering culture.

Streaming data Technical skills requirements :- Experience- 5+ Years Solid hands-on and Solution Architecting experience in Big-Data Technologies (AWS preferred) - Hands on experience in: AWS Dynamo DB, EKS, Kafka, Kinesis, Glue, EMR - Hands-on experience of programming language like Scala with Spark. - Good command and working experience on Hadoop Map Reduce, HDFS, Hive, HBase, and/or No-SQL Databases - Hands on working experience on any of the data engineering analytics platform (Hortonworks Cloudera MapR AWS), AWS preferred - Hands-on experience on Data Ingestion Apache Nifi, Apache Airflow, Sqoop, and Oozie - Hands on working experience of data processing at scale with event driven systems, message queues (Kafka FlinkSpark Streaming) - Hands on working Experience with AWS Services like EMR, Kinesis, S3, CloudFormation, Glue, API Gateway, Lake Foundation - Hands on working Experience with AWS Athena - Experience building data pipelines for structured unstructured, real-time batch, events synchronous asynchronous using MQ, Kafka, Steam processing. Mandatory Skills- Spark, Scala, AWS, Hadoop

Responsibilities: * Design, develop, test & maintain Scala applications using Akka, Cats & Play Framework with SQL/NOSQL databases. * Collaborate with cross-functional teams on night shift for project delivery.