Senior Software Engineer

Job Title: Senior Data Engineer Pyper | AWS Lambda | AWS Glue | Snowflake

Experience Required:

Job Summary:

highly skilled and experienced Senior Data Engineer

remote position

Key Responsibilities:

• Design, build, and maintain robust and scalable

  ETL/ELT pipelines

  using

  AWS Glue

  and

  AWS Lambda

  .
• Integrate and manage

  Pyper-based solutions

  , ensuring secure and compliant data flow.
• Work with large datasets and implement complex data transformation logic within

  AWS and Snowflake

  environments.
• Optimize Snowflake queries, warehouse performance, and data architecture.
• Automate data ingestion, cleansing, transformation, and loading processes.
• Monitorand troubleshoot data pipeline failures and performance issues.
• Collaborate with cross-functional teams including data analysts, data scientists, and DevOps.
• Ensure adherence to data governance, quality, and security standards.
• Provide technical leadership and mentorship to junior data engineers as needed.

Required Skills & Qualifications:

• 5 to 9 years

  of overall experience in data engineering and cloud-based data solutions.
• Hands-on expertise in

  Pyspark

  platform and integrations.
• Strong experience with

  AWS Glue

  (Job creation, Crawlers, Catalog, PySpark/Scala scripts).
• Solid knowledge of

  AWS Lambda

  for serverless compute and data automation.
• Proven expertise in

  Snowflake

  (data modeling, performance tuning, secure data sharing, etc.).
• Proficient in

  SQL, Python

  , and working knowledge of

  PySpark

  or

  Scala

  .
• Experience with CI/CD practices for data pipelines (e.g., using Git, CodePipeline, or similar tools).
• Excellent problem-solving skills and the ability to work independently in a remote setup.

Good to Have:

• Exposure to AWS services such as S3, Athena, Redshift, CloudWatch, Step Functions.
• Familiarity with data security and compliance best practices (e.g., GDPR, HIPAA).
• Experience with Agile/Scrum methodologies.

Employment Type:

Full-time, Remote

Notice Period:

Immediate Joiners preferred