Sr. Data Engineer

Role Overview: YASH Technologies is seeking AWS Professionals with expertise in AWS services such as Glue, Pyspark, SQL, Databricks, Python, and more. As an AWS Data Engineer, you will be responsible for designing, developing, testing, and supporting data pipelines and applications. This role requires a degree in computer science, engineering, or related fields along with strong experience in data integration and pipeline development. Key Responsibilities: - Design, develop, test, and support data pipelines and applications using AWS services like Glue, Pyspark, SQL, Databricks, Python, etc. - Work with a mix of Apache Spark, Glue, Kafka, Kinesis, and Lambda in S3 Redshift, RDS, MongoDB/DynamoDB ecosystems. - Utilize SQL in the development of data warehouse projects/applications (Oracle & SQL Server). - Develop in Python especially in PySpark in AWS Cloud environment. - Work with SQL and NoSQL databases like MySQL, Postgres, DynamoDB, Elasticsearch. - Manage workflow using tools like Airflow. - Utilize AWS cloud services such as RDS, AWS Lambda, AWS Glue, AWS Athena, EMR. - Familiarity with Snowflake and Palantir Foundry is a plus. Qualifications Required: - Bachelor's degree in computer science, engineering, or related fields. - 3+ years of experience in data integration and pipeline development. - Proficiency in Python, PySpark, SQL, and AWS. - Strong experience with data integration using AWS Cloud technologies. - Experience with Apache Spark, Glue, Kafka, Kinesis, Lambda, S3 Redshift, RDS, MongoDB/DynamoDB ecosystems. - Hands-on experience with SQL in data warehouse projects/applications. - Familiarity with SQL and NoSQL databases. - Knowledge of workflow management tools like Airflow. - Experience with AWS cloud services like RDS, AWS Lambda, AWS Glue, AWS Athena, EMR. Note: The JD also highlights YASH Technologies" empowering work environment that promotes career growth, continuous learning, and a positive, inclusive team culture grounded in flexibility, trust, transparency, and support for achieving business goals.,