Openings For Data Engineer Role

Job Description

Job Type - Third Party Payroll Payroll Company Name - Randstad Digital Position - Data Engineer Experience - 3+Years Location - Chennai only Notice Period - Immediate to 15days Interview Type - Virtual (Final Round Face2Face Interview) Work Mode - 5 days office Key Skills - AWS, SQL, ETL If you're interested, kindly share your updated resume and the following details to this below email ID or LinkedIn Email Id: gayathri.nambi@randstaddigital.com LinkedIn: https://www.linkedin.com/in/gayathri-alagia-nambi-0827921a5/ Full Name: Pan Number: Experience: Relevant Experience: Notice period: CTC: Expected CTC: Current company: Payroll Company: Location: Preferred location: Offer in hand : (Y/N) Reason for Job Change: Key Responsibilities Collaborate with Product teams ensuring that raw data is cleansed and transformed and useable by downstream consumers (ML Engineers, BI analytics) Expect level PL-SQL Assist and advise on the re-development and modernisation of end-to-end ETL pipelines and introduce new technologies where appropriate in a real-time streaming environment dealing with very large data volumes Working with AWS cloud infrastructure (specifically SQS, SNS, Redshift, OpenSearch, Athena, Kinesis, AWS code pipeline) to develop, innovate and maintain data flowing through various queues and data warehouses Working with a variety of data repository platforms (including SQL stores such as Oracle), as well as implementing data visualisation and network analysis (e.g GraphdB) Maintain and productionise machine learning and AI models Assist in the creation of next generation data ingestion platforms – sourcing data using Webscrapes, APIs, Email, and flat file (FTP) methods Understanding conflict resolution methods and assist subject matter experts in the debugging on data ingestion and managing overall feed uptimes across a large set of data collectors. Create and maintain detailed documentation and functional design specifications including data flows and data conversion Provide technical information to assist in the development of client facing product documentation Adhere to change management protocols and version control Present advanced technical designs with non-technical stakeholders What we are looking for: Essential Bachelor’s honours degree preferably in computer science, or engineering field, or demonstrable technical experience in a related engineering discipline At least 3 years of ETL experience using flat files to transposed Data Models Experience in troubleshooting and debugging SQL (Oracle & other SQL platforms), SNS, SQS, Kinesis and AWS Lambda Strong Data Mining and Analytical skills required to encode sophisticated business transformation logic in a pipeline and serve predictive models Familiarity with the design, development, and maintenance of best-in-class BI capabilities, including data warehouse data structures and data pipelines (Redshift, Athena etc) Familiarity with Agile development process Exceptional analytical thinking ability, ease with quantitative analysis, and excellent problem-solving skills Self–discipline and willingness to learn Ability to make connections with technical and non-technical stakeholders Excellent verbal and written communication skills Desirable Experience of streaming or ‘real-time’ processing at high data volumes Previous experience using JAVA and C# Familiarity of architectural design patterns for micro-services leveraging relational and big data technologies Demonstrable experience working with Big Data environments Experience of the SAS Analytics platform of particular interest