Job
Description
About Us: Soulpage IT Solutions is an AI/ML technology company based in Hyderabad, specializing in cutting-edge solutions for data engineering, AI, and cloud-based analytics. We are looking for an experienced Data Engineer with expertise in Big Data technologies, Python, and PySpark to join our team. Key Responsibilities: Develop and optimize PySpark applications using Spark DataFrames in Python. Work on large-scale data processing, ensuring performance optimization for high-volume data pipelines . Implement best practices for version control using Git. Work with Amazon Analytics services such as Amazon EMR, Amazon Athena, and AWS Glue . Utilize Amazon Compute services including AWS Lambda, EC2 , and storage solutions like S3, SNS . Work with columnar storage formats like Parquet, Avro, ORC , and apply compression techniques ( Snappy, Gzip ). Good to have experience with data warehousing concepts (dimensions, facts, schemas - Star, Snowflake ). Good to have experience with AWS databases such as Aurora, RDS, Redshift, ElastiCache, or DynamoDB . Requirements: 4+ years of experience in IT, with strong hands-on expertise in Big Data technologies . Mandatory: Hands-on experience in Python and PySpark . Experience working on AWS ecosystem , including EMR, Athena, Glue, Lambda, EC2, S3, and SNS . Strong understanding of data modeling and warehousing concepts . Proficiency in working with structured and semi-structured data Ability to optimize Spark jobs for better performance and efficiency . Why Join Us? Work on cutting-edge AI & ML projects in a fast-growing technology company. Be part of an innovative and collaborative work environment. Career growth opportunities in Big Data, AI, and Cloud technologies . Competitive salary and benefits. Application Process: Interested candidates can send their resumes to [email protected] with the subject line: Application for AWS Data Engineer We look forward to welcoming passionate individuals to our team!
