Python Developer

Innovate

Python Developer – Spark, AWS Lambda (4–7 Years Experience)

Python Developer - Spark, AWS Lambda

Python Developer

confidential requirement

Role Overview:

PySpark

Key Responsibilities:

• Develop and maintain scalable

  PySpark

  data processing pipelines.
• Design, build, and deploy

  AWS Lambda

  serverless applications.
• Work with

  AWS services

  such as API Gateway, S3, DynamoDB, CloudWatch, and IAM.
• Integrate Spark-based ETL jobs with AWS-based data systems.
• Optimize Spark jobs for performance and scalability.
• Write clean, reusable, and efficient Python code for data transformations and backend APIs.
• Collaborate with data engineers, architects, and DevOps teams to deliver end-to-end solutions.
• Participate in Agile ceremonies, code reviews, and technical design discussions.

Must-Have Skills:

• 4–7 years of professional experience in

  Python

  development.
• Strong experience in

  Apache Spark

  /

  PySpark

  for large-scale data processing.
• Hands-on experience in

  AWS Lambda

  application development.
• Knowledge of AWS services such as

  S3

  ,

  API Gateway

  ,

  CloudWatch

  ,

  DynamoDB

  , and

  IAM

  .
• Solid understanding of ETL concepts and data processing best practices.
• Proficiency with SQL and working with both relational and NoSQL databases.
• Familiarity with Git, CI/CD pipelines, and Agile development methodologies.

Good to Have:

• Experience with

  Databricks

  or

  AWS Glue

  .
• Knowledge of

  infrastructure as code

  tools like Terraform or AWS CloudFormation.
• Exposure to data lake/lakehouse architecture.
• AWS Certification (Developer Associate, Data Analytics, or Solutions Architect).
• Knowledge of containerization (Docker, Kubernetes).

Engagement Details:

• Location:

  PAN India

• Notice Period:

  Immediate joiners preferred / up to 30 days

• Compensation:

  Best in market based on experience