Sr. Data Engineer - AWS+Python+Pyspark

3 - 7 years

0 Lacs

Posted:3 days ago| Platform: Shine logo

Apply

Work Mode

On-site

Job Type

Full Time

Job Description

As an AWS Data Engineer at YASH Technologies, you will play a crucial role in designing, developing, testing, and supporting data pipelines and applications using various AWS services. Your primary skillsets should include AWS services such as Glue, Pyspark, SQL, Databricks, and Python. Additionally, proficiency in ETL tools, Github, and DevOps (CI/CD) will be valuable secondary skillsets. Key Responsibilities: - Design, develop, test, and support data pipelines and applications using AWS services like Glue, Pyspark, SQL, Databricks, and Python. - Utilize your expertise in data integration and pipeline development, with a focus on AWS Cloud technologies. - Work with a mix of Apache Spark, Glue, Kafka, Kinesis, and Lambda in S3 Redshift, RDS, MongoDB/DynamoDB ecosystems. - Use SQL in the development of data warehouse projects/applications, particularly in Oracle & SQL Server environments. - Demonstrate strong real-life experience in Python development, especially in PySpark within the AWS Cloud environment. - Work with SQL and NoSQL databases like MySQL, Postgres, DynamoDB, and Elasticsearch. - Implement workflow management tools like Airflow. - Engage with various AWS cloud services such as RDS, AWS Lambda, AWS Glue, AWS Athena, and EMR. Qualifications Required: - Bachelor's degree in computer science, engineering, or related fields. - 3+ years of experience in data integration and pipeline development. - Proficiency in Python, PySpark, SQL, and AWS. - Familiarity with AWS Cloud technologies and services. - Experience with Databricks and Redshift is a major plus. - Knowledge of Snowflake and Palantir Foundry is considered a good-to-have. At YASH Technologies, you will have the opportunity to shape your career in an inclusive team environment. Our Hyperlearning workplace is built on flexibility, trust, collaboration, and support, providing a stable employment with a great atmosphere and an ethical corporate culture. Join us in bringing real positive changes in the virtual world and driving business transformation through cutting-edge technologies. As an AWS Data Engineer at YASH Technologies, you will play a crucial role in designing, developing, testing, and supporting data pipelines and applications using various AWS services. Your primary skillsets should include AWS services such as Glue, Pyspark, SQL, Databricks, and Python. Additionally, proficiency in ETL tools, Github, and DevOps (CI/CD) will be valuable secondary skillsets. Key Responsibilities: - Design, develop, test, and support data pipelines and applications using AWS services like Glue, Pyspark, SQL, Databricks, and Python. - Utilize your expertise in data integration and pipeline development, with a focus on AWS Cloud technologies. - Work with a mix of Apache Spark, Glue, Kafka, Kinesis, and Lambda in S3 Redshift, RDS, MongoDB/DynamoDB ecosystems. - Use SQL in the development of data warehouse projects/applications, particularly in Oracle & SQL Server environments. - Demonstrate strong real-life experience in Python development, especially in PySpark within the AWS Cloud environment. - Work with SQL and NoSQL databases like MySQL, Postgres, DynamoDB, and Elasticsearch. - Implement workflow management tools like Airflow. - Engage with various AWS cloud services such as RDS, AWS Lambda, AWS Glue, AWS Athena, and EMR. Qualifications Required: - Bachelor's degree in computer science, engineering, or related fields. - 3+ years of experience in data integration and pipeline development. - Proficiency in Python, PySpark, SQL, and AWS. - Familiarity with AWS Cloud technologies and services. - Experience with Databricks and Redshift is a major plus. - Knowledge of Snowflake and Palantir Foundry is considered a good-to-have. At YASH Technologies, you will have the opportunity to shape your career in an inclusive team environment. Our Hyperlearning workplace is built on flexibility, trust, collaboration, and support, providing a stable employment with a great atmosphere and an ethical corporate culture. Join us in bringing real positive changes in the virtual world and driving business transformation through cutting-edge technologies.

Mock Interview

Practice Video Interview with JobPe AI

Start Python Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

coding practice

Enhance Your Python Skills

Practice Python coding challenges to boost your skills

Start Practicing Python Now

RecommendedJobs for You