Data Engineer

Precognitas Health Pvt. Ltd., a fully owned subsidiary of Foresight Health Solutions LLC, is seeking

data engineer

join us!

Required Skills & Experience

• 4+ years of experience in data engineering, data pipelines, and ETL/ELT workflows.
• Strong Python programming skills with expertise in Python Programming, NumPy, Pandas, and data manipulation techniques.
• Hands-on experience with orchestration tools like Prefect, Apache Airflow, or AWS Step Functions for managing complex workflows.
• Proficiency in AWS services, including AWS Glue, AWS Batch, S3, Lambda, RDS, Athena, and Redshift.
• Experience with Docker containerization and Kubernetes for scalable and efficient data processing.
• Strong understanding of data processing layers, batch and streaming data architectures, and analytics frameworks.
• Expertise in SQL and NoSQL databases, query optimization, and data modeling for structured and unstructured data.
• Familiarity with big data technologies like Apache Spark, Hadoop, or similar frameworks.
• Experience implementing data validation, quality checks, and observability for robust data pipelines.
• Strong knowledge of Infrastructure as Code (IaC) using Terraform or AWS CDK for managing cloud-based data infrastructure.
• Ability to work with distributed systems, event-driven architectures (Kafka, Kinesis), and scalable data storage solutions.
• Experience with CI/CD for data workflows, including version control (Git), automated testing, and deployment pipelines.
• Knowledge of data security, encryption, and access control best practices in cloud environments.
• Strong problem-solving skills and ability to collaborate with cross-functional teams, including data scientists and software engineers.

Compensation will be commensurate with experience. If you are interested, please send your application to jobs@precognitas.com.

For more information about our work, visit www.caliper.care