Data Engineer (AWS Redshift, Kubernetes, Spark and Python)

Job Description

Job Summary As a Data Engineer at Synechron, you will play a pivotal role in harnessing data to drive business value. Your expertise will be essential in developing and maintaining data pipelines, ensuring data integrity, and facilitating analytics that inform strategic decisions. This role contributes significantly to our business objectives by optimizing data processing and enabling insightful reporting across the organization. Software Requirements Required: AWS Redshift (3+ years of experience) Spark (3+ years of experience) Python (3+ years of experience) Complex SQL (3+ years of experience) Shell scripting (2+ years of experience) Docker (2+ years of experience) Kubernetes (2+ years of experience) Bitbucket (2+ years of experience) Preferred: DBT Dataiku Kubernetes cluster management Overall Responsibilities Develop and optimize data pipelines using big data technologies, ensuring seamless data flow and accessibility. Collaborate with cross-functional teams to translate business requirements into technical solutions. Ensure high data quality and integrity in analytics and reporting processes. Implement data architecture and modeling best practices to support strategic objectives. Troubleshoot and resolve data-related issues, maintaining a service-first mentality to enhance customer satisfaction. Technical Skills (By Category) Programming Languages: EssentialPython, SQL PreferredShell scripting Databases/Data Management: EssentialAWS Redshift, Hive, Presto PreferredDBT Cloud Technologies: EssentialAWS PreferredKubernetes, Docker Frameworks and Libraries: EssentialSpark PreferredDataiku Development Tools and Methodologies: EssentialBitbucket, Airflow or Argo Workflows Experience Requirements 6-7 years of experience in data engineering or related roles. Strong understanding of data & analytics concepts, with proven experience in big data technologies. Experience in the financial services industry preferred but not required. Alternative pathwaysSignificant project experience in data architecture and analytics. Day-to-Day Activities Design and implement scalable data pipelines. Participate in regular team meetings to align on project goals and deliverables. Collaborate with stakeholders to refine data processes and analytics. Make informed decisions on data management strategies and technologies. Qualifications Bachelors degree in Computer Science, Data Engineering, or a related field (or equivalent experience). Certifications in AWS or relevant data engineering technologies preferred. Commitment to continuous professional development in data engineering and analytics. Professional Competencies Strong critical thinking and problem-solving capabilities, with a focus on innovation. Effective communication skills and stakeholder management. Ability to work collaboratively in a team-oriented environment. Adaptability and a willingness to learn new technologies and methodologies. Excellent time and priority management to meet deadlines and project goals.