9 Astronomer Jobs

About The Job The Data & AI team is a highly focused effort to lead digital-first execution and transformation at Red Hat leveraging data & AI strategically for our customers, partners, and associates. What will you do Evolve existing source data pipelines to an ELT model of data ingestion Cleanly separate source-aligned data products from aggregate data products Richly decorate your data products with metadata to support knowledge transfer, adoption, and the application of Machine Learning Tag and classify your data assets to ensure they are used responsibly throughout the organization, applying masking or restricting access where appropriate Apply software engineering best practices to you...

Overview Proficient MLOps engineer capable of independently managing production model deployments, pipelines, and infrastructure operations. Responsibilities: Deploy and maintain ML models in production using technologies like AWS SageMaker, MLflow, or Kubeflow. Manage pipelines and CI/CD workflows using tools like ArgoCD, Terraform, or similar infrastructure-as-code platforms. Support data workflows and ETL orchestration through technologies like Astronomer or Airflow. Collaborate with data science teams to transition models into production environments. Perform root cause analysis and remediation for incidents. Qualifications: 24 years of experience in MLOps or DevOps. Proficiency with one...

Role Overview: Bridgenext is a global digital consultancy focused on helping clients innovate intentionally and achieve their digital goals by developing digital products, experiences, and solutions tailored to real people's needs. As an Engineer with hands-on Big Data experience at Bridgenext, you will have the opportunity to work on internal and customer-based projects, ensuring high-quality code and providing optimal solutions to meet clients" current and future needs. Key Responsibilities: - Possessing 3-4 years of overall experience - Demonstrating strong programming skills in Python/Java - Having 3+ years of experience with distributed systems and frameworks, especially Spark - Working...

Join our dynamic team as a software developer, where you will have the opportunity to solve complex problems and contribute to our innovative projects. Enhance your skills in Python, PySpark, and cloud architecture while working in an inclusive and respectful team environment. This role offers immense growth potential and a chance to work with cutting-edge technologies. As a Lead Software Engineer - Python / Spark Big Data at JPMorgan Chase within the Capital Reporting product, you will be executing software solutions, designing, developing, and troubleshooting technical issues. Value diversity, equity, inclusion, and respect in our team culture. This role provides an opportunity to contribu...

Immediate Joiners Only-0-15 days Only Considered 3+Years Mandatory Work Mode-Hybrid Work Loation: Hyderabad, Bengaluru,Chennai,Pune Mandatory Skills: Azure, ADF, Spark, Astronomer Data Engineering topics Kafka based ingestion API based ingestion Astronomer, Apache Airflow, dagster, etc. (orchestration tools) Familiarity with Apache Iceberg, Delta & Hudi table designs when to use, why to use & how to use Spark architecture Optimization techniques Performance issues and mitigation techniques Data Quality topics Data engineering without quality provides no value Great Expectations (https://docs.greatexpectations.io/docs/core/introduction/try_gx/) Pydeequ (https://pydeequ.readthedocs.io/en/lates...

3+ years experienced engineer who has worked on GCP environment and its relevant tools/services. (Big Query, Data Proc, Data flow, Cloud Storage, Terraform, Tekton , Cloudrun , Cloud scheduler, Astronomer/Airflow, Pub/sub, Kafka, Cloud Spanner streaming etc) 1 or 2 + years of strong experience in Python development (Object oriented/Functional Programming, Pandas, Pyspark etc) 1 or 2 + years of strong experience in SQL Language (CTEs, Window functions, Aggregate functions etc)

Key Responsibilities: Design and implement scalable and efficient full-stack solutions using Java and cloud technologies. Develop and maintain cloud-based solutions on Google Cloud Platform (GCP), utilizing services like BigQuery, Astronomer, Terraform, Airflow, and Dataflow. Architect and implement complex data engineering solutions using GCP services. Collaborate with cross-functional teams to develop, deploy, and optimize cloud-based applications. Utilize Python for data engineering and automation tasks within the cloud environment. Ensure alignment with GCP architecture best practices and contribute to the design of high-performance systems. Lead and mentor junior developers, fostering a...

Key Responsibilities: Design and implement scalable and efficient full-stack solutions using Java and cloud technologies. Develop and maintain cloud-based solutions on Google Cloud Platform (GCP), utilizing services like BigQuery, Astronomer, Terraform, Airflow, and Dataflow. Architect and implement complex data engineering solutions using GCP services. Collaborate with cross-functional teams to develop, deploy, and optimize cloud-based applications. Utilize Python for data engineering and automation tasks within the cloud environment. Ensure alignment with GCP architecture best practices and contribute to the design of high-performance systems. Lead and mentor junior developers, fostering a...

Senior Software Developer (Python) Experience: 5 - 7 Years Exp Salary : Upto USD 40,000 / year Preferred Notice Period : Within 60 Days Shift : 11:00AM to 8:00PM IST Opportunity Type: Hybrid (Bengaluru) Placement Type: Permanent (*Note: This is a requirement for one of Uplers' Clients) Must have skills required : Apache Airflow, Astronomer, Pandas/Pyspark/Dask, RESTful API, Snowflake, Docker, Python, SQL Good to have skills : CI/CD, Data Vizualization, Matplotlib, Prometheus, AWS, Kubernetes A Single Platform for Loans/Securities & Finance (One of Uplers' Clients) is Looking for: Senior Software Developer (Python) who is passionate about their work, eager to learn and grow, and who is commit...