Job
Description
Positions Title : Data Engineer Experience Range : 4+ Years Location : Hyderabad and Gurgaon (Hybrid) Notice Period : Immediate to 15 days Primary Skills Required: Kafka, Spark, Python, SQL, Shell Scripting, Databricks, Snowlflake, AWS and Azure Cloud What you will do: 1. Provide Expertise and Guidance as a Senior Experienced Engineer in solution design and strategy for Data Lake and analytics-oriented Data Operations. 2. Design, develop, and implement end-to-end data solutions (storage, integration, processing, access) in hypervendor platforms like AWS and Azure. 3. Architect and implement Integration, ETL, and data movement solutions using SQL Server Integration Services (SSIS)/ C#, AWS Glue, MSK and/or Confluent, and other COTS technologies. 4. Prepare documentation and designs for data solutions and applications. 5. Design and implement distributed analytics platforms for analyst teams. 6. Design and implement streaming solutions using Snowflake, Kafka and Confluent. 7. Migrate data from traditional relational database systems (ex. SQL Server, Postgres) to AWS relational databases such as Amazon RDS, Aurora, Redshift, DynamoDB, Cloudera, Snowflake, Databricks, etc. Who you are: 1. Bachelor's degree in Computer Science, Software Engineering. 2. 4+ Years of experience in the Data domain as an Engineer and Architect. 3. Demonstrated sense of ownership and accountability in delivering high-quality data solutions independently or with minimal handholding. 4. Ability to thrive in a dynamic environment, adapting to evolving requirements and challenges. 5. A solid understanding of AWS and Azure storage solutions such as S3, EFS, and EBS. 6. A solid understanding of AWS and Azure compute solutions such as EC2. 7. Experience implementing solutions on AWS and Azure relational databases such as MSSQL, SSIS, Amazon Redshift, RDS, and Aurora. 8. Experience implementing solutions leveraging ElastiCache and DynamoDB. 9. Experience designing and implementing Enterprise Data Warehouse, Data Marts/Lakes. 10. Experience with Star or Snowflake Schema. 11. Experience with R or Python and other emerging technologies in D&A. 12. Understanding of Slowly Changing Dimensions and Data Vault Model. AWS and Azure Certifications are preferred Show more Show less
