Freelance AWS Data Engineer - EMR, PySpark, ML Models & Terraform Expert

Company Description

ThreatXIntel is a cybersecurity startup dedicated to protecting businesses and organizations from cyber threats. The company provides a wide range of services, including cloud security, web and mobile security testing, cloud security assessment, and DevSecOps, with a focus on tailored and cost-effective solutions for startups and small businesses. ThreatXIntel uses a proactive approach to monitor and test digital environments, identifying vulnerabilities before they are exploited to ensure the security of its clients. With a mission to provide peace of mind through high-quality cybersecurity solutions, ThreatXIntel empowers businesses to focus on their growth and success.

Role Description

Freelance AWS Data Engineer

Key Responsibilities

• Support and manage

  AWS data infrastructure

  (EMR, ECS, EAC) for ongoing operations, optimization, and troubleshooting post-migration.
• Work with

  Machine Learning models

  in

  card

  ,

  auto

  , and

  retail

  verticals, ensuring their seamless integration and optimization in AWS.
• Develop and manage

  Large Language Models (LLMs)

  and implement them for various business use cases.
• Optimize

  DynamoDB

  configurations for reliable and scalable data storage.
• Utilize

  Terraform

  to automate infrastructure provisioning and management on AWS.
• Develop and manage

  PySpark

  scripts for large-scale data processing tasks.
• Write

  Python scripts

  to automate cloud service management and enhance operational workflows.
• Collaborate with cross-functional teams to troubleshoot, optimize, and improve system performance.
• Maintain and document

  data flows

  , architecture designs, and best practices.

Required Skills & Qualifications

• 5+ years of experience

  as a

  Data Engineer

  , with a focus on

  AWS services

  (specifically

  EMR

  ,

  ECS

  , and

  EAC

  ).
• Strong experience working with

  Machine Learning models

  in

  card

  ,

  auto

  , and

  retail

  industries.
• Proven expertise in working with

  Large Language Models (LLMs)

  in AWS environments.
• Solid experience with

  DynamoDB

  , including setup, management, and optimization.

• Terraform

  expertise for infrastructure automation and management.

• PySpark

  experience for processing large datasets in the cloud.
• Strong proficiency in

  Python

  for automating processes and cloud resource management.
• Familiarity with

  AWS best practices

  for security, scalability, and cost management.
• Excellent

  communication

  and

  collaboration

  skills, especially in cross-functional team settings.