Data Engineer

Data EngineerWe are seeking a Data Engineer with a passion for building robust and scalable data pipelines. The ideal candidate should have strong experience in writing complex SQL queries, working with Python, and developing Extract, Transform, Load (ETL) processes within the Amazon Web Services (AWS) ecosystem. You should be a self-starter with excellent problem-solving skills and the ability to work independently.

• Develop and maintain the data architecture vision and strategy, ensuring alignment with business objectives and technology roadmaps.
• Develop, modify, and optimize complex SQL queries, stored procedures, and functions to support various applications.
• Plan, design and execute data integration solutions by establishing new or modified interfaces, data mappings, transformations, and data routing.
• Troubleshooting and debugging to optimize performance
• Exploring new technology solutions to enhance functionality continually
• Requirement and technical documentation
• Participating in code reviews

• Around 4 years of experience in a data engineering or similar role.
• Required Skills: Python, PySpark, SQL, AWS services relevant to ETL pipelines (e.g, Glue, Lambda, etc.,)
• A strong understanding of data modeling, data structures, databases, and ETL processes
• Proven experience with major relational databases such as PostgreSQL, MySQL, Microsoft SQL Server, or Oracle.
• Stakeholder management and communication skills, including prioritizing, problem solving and interpersonal relationship building
• Strong experience in SDLC delivery, including waterfall, hybrid and Agile methodologies. Experience delivering in an agile environment,
• Experience implementing and delivering data solutions and pipelines on the AWS Cloud Platform.
• An in-depth understanding of large-scale data sets, including both structured and unstructured data
• Knowledge and experience of delivering CI/CD and DevOps capabilities in a data environment is an added advantage
• Proficient understanding of build tools and code versioning tools, such as Git
• Knowledge of containerisation technologies like Docker and Kubernetes is a plus.

• Communicates effectively to influence agreement between partners and escalates items, as needed, to ensure execution activities remain on track.
• Ability to work collaboratively in a team-oriented environment.
• Have a strong passion for startups and the proactiveness to deliver
• You should be able to push your limits and go beyond your role to expand the product

Job Type: Full-time

Pay: ₹200,000.00 - ₹1,800,000.00 per year

Ability to commute/relocate:

• Bengaluru, Karnataka: Reliably commute or planning to relocate before starting work (Required)

Application Question(s):

• Whether having any experience in Python?
• Kindly mention your current ctc
• Kindly mention your expected ctc
• Kindly mention your notice period

Experience:

• SQL: 4 years (Required)

Work Location: In person