Apps Dev Intmd Programmer Analyst

The Data Engineer role involves building Data Engineering Solutions using cutting-edge data techniques. You will collaborate with product owners, customers, and technologists to deliver data products/solutions in an agile environment. Responsibilities include designing and developing big data solutions, partnering with domain experts, product managers, analysts, and data scientists. You will work on PySpark and Python, build Client pipelines from various sources, ensure automation through CI/CD, define needs for data platform maintainability, testability, performance, security, quality, and usability. Additionally, you will drive implementation of consistent patterns, reusable components, and coding standards for data engineering processes. Converting Talend pipelines into PySpark and Python, tuning Big data applications for optimal performance, evaluating new IT developments, and recommending system enhancements are also part of the role. You should have 4-8 years of IT experience with at least 4 years in PySpark and Python. Experience in designing and developing Data Pipelines, Spark programming, machine learning libraries, containerization technologies, DevOps, and team management is required. Knowledge of Oracle performance tuning, SQL, Autosys, and Unix scripting is also beneficial. The ideal candidate holds a Bachelor's degree or equivalent experience. Please note that this job description provides a summary of the work performed, and additional job-related duties may be assigned as needed.,