Freelance Job Opportunity – Data Engineer (Java, Pyspark, Azure) -Remote

Company Description

ThreatXIntel is a startup cyber security company dedicated to protecting businesses and organizations from cyber threats. Our experienced team offers a range of services, including cloud security, web and mobile security testing, and DevSecOps. We are committed to delivering customized, affordable solutions to meet the specific needs of our clients. At ThreatXIntel, we proactively monitor and test digital environments to identify vulnerabilities, ensuring our clients can focus on growing their business with peace of mind.

Freelance Data Engineer

remote-friendly freelance contract role

Key Responsibilities

• Develop, maintain, and optimize

  ETL/ELT pipelines

  using

  Java and Pyspark

  .
• Build and maintain

  data processing workflows

  on

  Databricks

  and

  Azure cloud

  platforms.
• Design and maintain

  SQL queries

  for data extraction, transformation, and analysis.
• Deploy and manage

  containerized workloads

  using

  Kubernetes

  .
• Collaborate with teams to integrate data pipelines with

  Power BI dashboards

  for reporting.
• Use

  Git

  for version control and CI/CD best practices in data engineering workflows.
• Monitor and troubleshoot production data pipelines for performance and reliability.
  

Required Skills & Qualifications

• Strong experience in

  Java

  and

  Pyspark

  for data processing.
• Hands-on expertise with

  SQL

  and relational databases.
• Experience with

  Databricks

  and

  Azure cloud services

  .
• Experience with

  ETL development

  and orchestration of data workflows.
• Familiarity with

  Kubernetes

  and containerized deployments.
• Proficiency with

  Power BI

  for data visualization.
• Experience using

  Git

  for version control and collaborative development.

Preferred Qualifications

• Experience with

  data lake architectures

  and cloud-based data warehouses.
• Familiarity with CI/CD pipelines and automated deployment for data workflows.
• Prior experience with

  big data platforms

  and distributed computing.
• Experience in cyber security is a plus.