Primary Responsibilities: Basic, structured, standard approach to work Comply with the terms and conditions of the employment contract, company policies and procedures, and any and all directives (such as, but not limited to, transfer and/or re-assignment to different work locations, change in teams and/or work shifts, policies in regards to flexibility of work benefits and/or work environment, alternative work arrangements, and other decisions that may arise due to the changing business environment). The Company may adopt, vary or rescind these policies and directives in its absolute discretion and without any limitation (implied or otherwise) on its ability to do so Required Qualifications: Graduate degree or equivalent experience 4+ years of experience with Development role Hands-on experience in the following: data validation, writing unit test cases Hands-on project experience on Jupyter Notebook/ Zeppelin/ PyCharm etc. IDEs Experience in integrating PySpark with downstream and upstream applications through a batch/real-time interface Experience in QA / Testing concepts and processes Experience in cloud Azure experience is preferrable to handle infrastructure scalability Experience in server management (Kafka ,Kubernetes , Docker, tomcat etc) Experience in fine-tuning process and troubleshooting performance issues Good knowledge of Hadoop, Hive, and Cloudera/ Hortonworks Data Platform Knowledge on Big Data and ETL Knowledge of Linux Familiarity with CI/CD pipeline tools (Jenkins, Bamboo, Maven/Gradle, SonarQube, Git) for deployment process Solid SQL skills , JAVA, PYTHON, NOSQL Solid troubleshooting & debugging skills (security, monitoring, server load, networking) Understand and have operating experience with Agile delivery methodologies Proven ability to write automation scripting using bash, Python Proven ability to write synchronous and asynchronous APIs in JAVA Proven ability to build and run SQL queries to extract data and compare reports and compare data across multiple reports for consistency Proven ability in managing ServiceNow tickets assigned to the team Proven ability in maintaining and managing Linux servers, including OS and application patching and upgrades Proven analytical skills
