Big Data Developer

Company Description

Softility is a digital transformation technology services company specializing in innovative solutions across cloud adoption and modernization, data engineering and analytics, AI-driven operations, digital service management, and cybersecurity. Based in Herndon, Virginia, USA, with an Innovation & Development Center in Hyderabad, India, we serve numerous large organizations, including Fortune 500 telecom companies, SLED entities, healthcare institutions, major enterprises, and federal government agencies. Our dynamic team of highly skilled engineers, guided by a seasoned leadership with over two decades of experience, is dedicated to delivering cutting-edge solutions that enable our customers to #BeFutureReady.

Role Description

This is a full-time, on-site role for a Big Data Developer, located in Hyderabad. The Big Data Developer will be responsible for designing, developing, and optimizing big data solutions. Day-to-day tasks include working on data engineering projects, performing ETL processes, managing data warehousing, and developing software solutions. The role also involves collaboration with cross-functional teams to ensure the effective implementation of data-driven solutions.

Big Data Developer

● Participate in the design and implementation phases for data projects to help translate high level

business requirements into technical solutions

● Provide technically sound solutions for the ingestion, storage, transformation, and presentation of

enterprise data, including ETL design, data storage strategies, data access and security

● Driving the design of scalable solutions while considering recoverable and resiliency

requirements

● Participate in DevOps related activities, including involvement with continuous integration,

automated deployment, automated testing, and continuous monitoring to enhance performance

and product quality

● Provide timely support for troubleshooting and resolving production issues

Required Technical and Professional Expertise

● Experience with any of the following: Big Data technologies, Analytics, Hadoop ecosystems, Data

Lakes, or Data Migration

● Experience with cloud platforms such as AWS, Azure, or Google Cloud

● Experience with Java, Scala, Spark

● Strong database integration and management skills

● Strong ETL skills, including database performance tuning and optimization

● Familiar with Shell scripting skills and Unix/Linux knowledge

● Exceptional analytical and problem-solving skills

● Running diagnostic tests and performing debugging procedures

● Documenting application development processes, procedures, and standards

● Excellent leadership and interpersonal skills

● Strong communication and team working skills

● Able to analyze complex situations and derive workable actions

● Flexibility to adjust to multiple demands, shifting priorities, ambiguity and rapid change

Preferred Technical And Professional Expertise

● Knowledge of DevOps and related tooling such as Jenkins, Ansible etc.

● Experience with Big Data technologies such as Apache Hadoop, HBase, Hive, Spark, Flink or

Flume

● Strong coding skills in one of Python/Java/Scala

● Familiar with event management technologies such as Apache Kafka or Apache Airflow

● Familiar with container technologies such as Docker or Kubernetes

● Demonstrable experience coaching junior members of your teams