Big Data Consultant

As a Senior Data Engineer with over 6 years of experience, you will be responsible for developing and enhancing data-processing, orchestration, monitoring, and more by utilizing popular open-source software, AWS, and GitLab automation. You will collaborate closely with product and technology teams to design and validate the capabilities of the data platform. Your role will involve identifying, designing, and implementing process improvements, such as automating manual processes, optimizing for usability, and re-designing for greater scalability. Additionally, you will provide technical support and usage guidance to the users of our platform services. Your key responsibilities will also include driving the creation and refinement of metrics, monitoring, and alerting mechanisms to provide the necessary visibility into our production services. To excel in this role, you should have experience in building and optimizing data pipelines in a distributed environment, as well as supporting and working with cross-functional teams. Proficiency in working in a Linux environment is essential, along with 4+ years of advanced working knowledge of SQL, Python, and PySpark. Knowledge of Palantir is preferred. Moreover, you should have experience using tools such as Git/Bitbucket, Jenkins/CodeBuild, and CodePipeline. Experience with platform monitoring and alert tools will be beneficial in fulfilling the requirements of this role. If you are ready to take on this challenging position and meet the qualifications mentioned above, please share your resume with Sunny Tiwari at stiwari@enexusglobal.com. We look forward to potentially having you as part of our team. Sunny Tiwari 510-925-0380,