Software Engineer II

Overview:

• 3+ years of experience in Data and BI software development.
• In Depth Knowledge in Datawarehouse.
• Hands-on Knowledge and experience in most of the AWS Cloud migration services.
• Strong knowledge of SQL and databases architecture. Expertise in Amazon Redshift database is desired.
• Strong in Spark and python.
• Self-starter and a collaborator having the ability to independently acquire the knowledge required in succeeding the project.
• Growth mindset. A desire to learn from others and make yourself better every day.
• Proficiency in Design & Code Reviews.
• Experience with agile development methodologies.
• Proficient in ETL and data warehouse/lake house.
• Strong computational skills.
• Preferable to code fluently in Real Time Data Analytics in AWS platform.
  

Responsibilities:

• Basic experience working with Amazon EMR & Spark
• Prior experience in implementing large scale data lake preferably with amazon or google data processing technologies.
• Experience in ETL, data warehousing, data mining, and data modelling, reporting and analytical tools.
• Knowledge and experience in most of the following AWS services: EC2, Lambda, SQS, Kinesis, S3, CloudFormation, CLI, CloudWatch
• Experience working with column-based databases like Redshift.
• Experience in building real-time ETL processes.
• Have python and spark knowledge.
• DevOps experience: Linux, Jenkins, Docker, Kubernete
• Basic experience working with Amazon EMR & Spark
• Prior experience in implementing large scale data lake preferably with amazon or google data processing technologies.
• Experience in ETL, data warehousing, data mining, and data modelling, reporting and analytical tools.
• Knowledge and experience in most of the following AWS services: EC2, Lambda, SQS, Kinesis, S3, CloudFormation, CLI, CloudWatch
• Experience working with column-based databases like Redshift.
• Experience in building real-time ETL processes.
• Have python and spark knowledge.
• DevOps experience: Linux, Jenkins, Docker, Kubernetes
• 2 years of experience in Data and BI software development and working with Data processing.
• In Depth Knowledge in Datawarehouse.
• Hands-on Knowledge and experience in most of the AWS Cloud migration services.
• Strong knowledge of SQL and databases architecture. Expertise in Amazon Redshift database is desired.
• Should be an individual contributor as well as handling a team. Expertise in below mentioned domain.
• Strong fundamentals in Computer Science - programming, algorithms, data structures, sql querying
• Strong understanding of Data landscape (ETL, Data processing, Data Storage, Reporting)
• Excellent SQL/Data Analysis Skills
• 1-2 years’ experience with AWS cloud platforms and strong hands-on in Redshift.
• Creating Data Mapping documents between Source to target and also documenting business rules on transformations is mandatory
• Should have worked in traditional ETL tool and processes
• Should have experience in RDBMS and very strong in SQL.
• Should have basic experience in programming/scripting language (Python/JAVA/C++)
• Basics of Data Modelling and Data Architecture
• Triage Data Issues and do RCA
• Data Testing - Unit Testing, Functional Testing and end to end Data Validation
• Expertise in Performance Optimization
• Working experience in Cloud would be a plus
• Working knowledge of Snowflakes will have advantage.
• Reporting tool like Power BI/ Tableau understand is required.
• Experience in Kinesis & Lambda is advantageous.
  

Qualifications:

• B.E or B.Tech in Computer Science or Information Technology.