Freelance Senior AWS Data Engineer

Company Description

ThreatXIntel is a startup cyber security company that specializes in providing customized, affordable solutions to protect businesses and organizations from cyber threats. Our services include cloud security, web and mobile security testing, cloud security assessment, and DevSecOps. We take a proactive approach to security by continuously monitoring and testing clients' digital environments to identify vulnerabilities.

Role Description

This is a part-time remote role for a Freelance Senior AWS Data Engineer at ThreatXIntel. The Data Engineer will be responsible for tasks such as data engineering, data modeling, ETL processes, data warehousing, and data analytics.

Key Responsibilities

• Collaborate with BI Engineering, partner technical teams, and business stakeholders to understand requirements and translate them into data engineering solutions.
• Build and optimize

  ETL/ELT pipelines

  and workflows using AWS data services.
• Ensure

  data reliability and quality

  by identifying anomalies, performing root-cause analysis, and implementing fixes.
• Design and maintain

  data models, warehouses, and lakehouse solutions

  for analytical and operational workloads.
• Improve performance of

  SQL queries

  and optimize AWS data pipelines for scalability and cost efficiency.
• Work with

  large datasets

  across structured and unstructured data sources.
• Follow best practices in data engineering: validation, testing, version control, and documentation.

Required Expertise

• Bachelor’s degree in Computer Science, Data Engineering, or related field.

• 7+ years of data engineering experience

  with a focus on AWS cloud environments.

• Strong SQL development skills

  and experience in query optimization.
• Expertise in

  ETL/ELT pipeline development

  and data modeling.
• Hands-on programming experience in

  Python

  (Java, Scala, or Node.js also acceptable).
• Proven experience with AWS services:

  Redshift, S3, Glue, EMR, Lambda, Kinesis, Firehose, IAM

  .
• Experience with

  non-relational databases

  (document, key-value, graph, or object storage).
• Familiarity with

  DevOps practices

  – Git, CI/CD pipelines, automated testing.

Preferred Qualifications

• Experience in preparing data for

  visualization tools

  (Tableau, QuickSight, Power BI).
• Exposure to

  streaming data processing

  and real-time data pipelines.
• Knowledge of

  data governance, data lineage, and quality frameworks

  .
• Strong communication and documentation skills.