Key Responsibilities Design, develop, and optimize large-scale data pipelines using PySpark and Apache Spark. Build scalable and robust ETL workflows leveraging AWS services such as EMR, S3, Lambda, and Glue. Collaborate with data scientists, analysts, and other engineers to gather requirements and deliver clean, well-structured data solutions. Integrate data from various sources, ensuring high data quality, consistency, and reliability. Manage and schedule workflows using Apache Airflow. Work on ML model deployment pipelines using tools like SageMaker and Anaconda. Write efficient and optimized SQL queries for data processing and validation. Develop and maintain technical documentation for data pipelines and architecture. Participate in Agile ceremonies, sprint planning, and code reviews. Troubleshoot and resolve issues in production environments with minimal supervision. Required Skills And Qualifications Bachelor's or Masters degree in Computer Science, Engineering, or a related field. 68 years of experience in data engineering with a strong focus on : Python PySpark SQL AWS (EMR, EC2, S3, Lambda, Glue) Experience in developing and orchestrating pipelines using Apache Airflow. Familiarity with SageMaker for ML deployment and Anaconda for environment management. Proficiency in working with large datasets and optimizing Spark jobs. Experience in building data lakes and data warehouses on AWS. Strong understanding of data governance, data quality, and data lineage. Excellent documentation and communication skills. Comfortable working in a fast-paced Agile environment. Experience with Kafka or other real-time streaming platforms. Familiarity with DevOps practices and tools (e.g., Terraform, CloudFormation). Exposure to NoSQL databases such as DynamoDB or MongoDB. Knowledge of data security and compliance standards (GDPR, HIPAA). Work with cutting-edge technologies in a collaborative and innovative environment. Opportunity to influence large-scale data infrastructure. Competitive salary, benefits, and professional development support. Be part of a growing team solving real-world data challenges. (ref:hirist.tech) Show more Show less

Company Description Oblige IT, a Microsoft Partner and Dynamics consultants and integrators, is headquartered in Manchester, United Kingdom. We specialize in complete implementation and support of Microsoft Dynamics 365, creating solutions to complex specifications to boost performance, growth, efficiency, and profitability. Our team comprises experts with international experience across various industries, which fosters creativity and a positive company culture. Role Description This is a full-time on-site role located in Bengaluru for a Technical Architect. The Technical Architect will be responsible for designing and implementing technical architectures, developing software solutions, designing solution architectures, integrating various systems, and overseeing enterprise architecture. The role requires working closely with cross-functional teams to ensure the successful delivery of projects. Qualifications Technical Architecture and Enterprise Architecture skills Software Development skills Solution Architecture skills Integration skills Strong analytical and problem-solving skills Excellent communication and collaboration skills Experience with Microsoft Dynamics 365 or similar platforms is a plus Bachelor's degree in Computer Science, Information Technology, or related field

We are seeking a Python Developer with AWS expertise having 5-7 years of experience to join our team at the earliest. If you have a strong passion for cloud technologies, API development, and backend systems, this opportunity is perfect for you! Your responsibilities will include developing Python applications, working with various AWS services like S3, Lambda, Glue, VPC, and EC2, deploying REST APIs, utilizing Docker for containerization, managing SQL Server databases, implementing authentication & authorization mechanisms, and potentially working with DynamoDB. Additional experience with Neoload, Dynatrace, CI/CD tools, OpenShift, SFTP API, file server management, and batch processing will be advantageous. Joining us means being part of a collaborative environment with ample growth prospects and the chance to work with cutting-edge technologies. Immediate joining opportunities are available within 15 days. If you meet the requirements and are excited about this role, send your resume to uzair.ahmed@obligeit.com. Apply now or refer someone who might be a suitable fit for this position!,

We are looking for a Python Developer (AWS) with a minimum of 4 years of experience to join our team located across Pan India. If you have a passion for cloud technologies, API development, and backend systems, this opportunity is ideal for you! As a Python + AWS Developer, you should possess the following key skills: - Strong proficiency in Python programming - Hands-on experience with various AWS services including S3, Lambda, Glue, VPC, and EC2 - Proficiency in REST API development and deployment - Knowledge of Docker and layers - Good understanding of SQL Server - Familiarity with authentication and authorization mechanisms - Experience with DynamoDB is a plus - Bonus points for experience with Neoload, Dynatrace, CI/CD tools, and OpenShift - Additional experience in SFTP API, file server management, and batch processing is beneficial Joining our team offers you: - A collaborative work environment with ample growth opportunities - Hands-on experience with cutting-edge technologies - Immediate joining opportunities within 15 days If you meet the requirements and are excited about this opportunity, please send your resume to uzair.ahmed@obligeit.com. Don't miss out on this chance or feel free to refer someone who might be interested! #Python #AWS #DevOps #Cloud #Hiring #Developers #ImmediateJoiner #AWSLambda #S3 #DynamoDB #APIDevelopment #Docker #CI/CD #SQLServer #TechJobs #JobOpening #OpenShift #BackendDeveloper #PythonDeveloper #CloudJobs,