Pyspark Developer

Job Description

Job Description Position: Pyspark Developer Mandatory skills: - Databricks, Python, Pyspark Location: Pune ( Kharadi) Experience: 5 to 9yrs 5 + years of focused and in-depth experience in implementing complex business analytics applications using big data technologies. A problem-solvers, with good analytical skills and a can-do attitude. Experience of various programming technologies and has good development sense, modular coding experience. Participated in various Hackathons and provided optimal & impactful solution to a real-world problem. Start-up mindset, has worked in big data start-ups using Spark or comes with boutique or captive firms knows for building big data solutions using Spark Extensive experience as a Data engineer with experience in designing, developing, and managing complex data pipelines which collects, store, process, and analyses large volumes of data Develop optimized data pipelines and make sure they are executed with high performance Experience in Linux Bash, PowerShell, and Python scripting Perform research to handle any problems faced while meeting the business objectives. Believer of Clean Code follows importance of various clean code approaches Conducts through unit test of the code, discover issues, and fix them diligently Worked with version control tools such as Git and SVN. Extensively worked on Python Programming, Spark coding using scala or PySpark Knowledge of cloud technologies especially Azure, Databricks, and Devops (Git, development of CI/CD pipelines, containers) would be an added advantage Design functional and technical architectures A team player practices in Peer code reviews, Pair programming Great communication abilities, both technically and non-technically. Can work independently with little or no supervision. Essential Skills: Strong big data technologies and MPP design, development skills Strong coding skills in Python, PySpark Strong code standardization skills