Senior Software Analyst (Data Engineer)

Title: Senior Software Analyst (Data Engineer)

Purpose of the Job

We are seeking a highly skilled and experienced Data Engineer with expertise in Python, SQL and AWS. The ideal candidate will have over 3+ years of extensive experience in demonstrating expertise in data engineering methodologies, data pipelines, and AWS cloud-based data solutions. The successful candidate will play a crucial role in ensuring the timely delivery of high-quality data solutions within budget constraints.

• Data Pipeline Development:

  Design, develop, and deploy robust and scalable data pipelines using Python. Achieving the set SLOs for data processing.

• AWS Data Services

  : Utilize a deep understanding of AWS services (e.g., S3, Glue, Lambda, Athena, DMS, RDS, Bedrock) to design and manage cloud-based data platforms.

• Data Integration:

  Implement and optimize data integration processes from various sources into data lakes and data warehouses on AWS.

• Secure Data Implementation:

  Development and implementation of robust security within the data lifecycle on AWS. Good knowledge in data security practices, vulnerability management, and the ability to incorporate security measures into data pipelines.

• Problem Solving:

  Proactively identify data challenges and propose innovative solutions to address them. Troubleshoot complex data issues and provide resolutions to ensure project success in a timely manner.

• High productivity with data quality and security intact.
• Improved data accessibility and collaboration across the organization.
• Continuous improvement in data engineering processes and methodologies.
• Quality data deliverables and effective operational support in managing the data infrastructure in production environments on AWS.

• Having expertise in data engineering, data pipelines, and cloud-based data solutions on AWS.
• Proven programming ability in SQL, Python and database knowledge.
• Extensive experience in AWS data services such as S3, Athena, Glue, Lambda, DMS, RDS, Bedrock etc.
• Experience in data modeling and ETL processes.
• Strong expertise in data pipeline development and optimization on AWS.
• Working knowledge of data warehousing solutions on AWS.
• Working knowledge of Linux Ubuntu environment is a plus.
• Familiarity with data testing frameworks.
• Experience with data visualization and BI tools is a plus and will be considered an added advantage.
• Monitoring and achieving the set SLOs for the data teams.
• Should have experience working in an agile development model, delivering data solutions every sprint.
• Excellent written and verbal communication skills with an ability to collaborate with cross-functional teams.
• Understanding the data requirements, designing the data solutions, and delivering it with the help of various teams each sprint.
• High proficiency with data engineering practices, tools, and workflows.
• Continuously discover, evaluate, and implement new data technologies to maximize data processing efficiency.

Qualifications required:

B.E/B.Tech(CSE) / M.E/M.Tech(CSE) / MCA - Computer Science / Information Technology/Data Science.

Notice Period:

Work Location: