54 Dagster Jobs - Page 2

Weave is looking for engineers hungry for fun challenges who can join our self-empowered teams and contribute in both technical and non-technical ways. You will be joining a team of talented developers that share a common interest in distributed backend systems, data, scalability, and continued development. You will get a chance to apply these, and other skills, to new and ongoing projects to make machine learning more approachable, data more available, and easier to discover and use by helping design how teams build out AI powered features at Weave. Our teams are cross-functional agile teams composed of a product owner, backend and frontend devs and devops. Teams are highly autonomous with ...

Sonatype is the software supply chain security company. We provide the world's best end-to-end software supply chain security solution, combining the only proactive protection against malicious open source, the only enterprise grade SBOM management and the leading open source dependency management platform. This empowers enterprises to create and maintain secure, quality, and innovative software at scale. As founders of Nexus Repository and stewards of Maven Central, the world's largest repository of Java open-source software, we are software pioneers and our open source expertise is unmatched. We empower innovation with an unparalleled commitment to build faster, safer software and harness ...

Job Description: Data Engineer As a Data Engineer, you will own the end-to-end lifecycle of our data infrastructure. You will design and implement robust, scalable data pipelines and architect modern data solutions using a best-in-class technology stack. Your work will transform raw, messy data into clean, reliable, and actionable data products that power decision-making across the business. You'll collaborate cross-functionally with product managers, data analysts, data scientists, and software engineers to understand data needs and deliver high-performance data solutions. Your impact will be measured by how effectively data is delivered, modeled, and leveraged to drive business outcomes. K...

Job Title: Senior Data Engineer Employment Type: Full-Time Location: Ahmedabad, Onsite Experience Required: 5+ Years About Techiebutler Techiebutler is looking for an experienced Data Engineer to develop and maintain scalable, secure data solutions. You will collaborate closely with data science, business analytics, and product development teams, deploying cutting-edge technologies and leveraging best-in-class third-party tools. You will also ensure compliance with security, privacy, and regulatory standards while aligning data solutions with industry best practices. Tech Stack Languages: SQL, Python Pipeline Orchestration: Dagster (Legacy: Airflow) Data Stores: Snowflake, Clickhouse Platfor...

Job Summary We are looking for a skilled Data Modeler / Architect with 58 years of experience in designing, implementing, and optimizing robust data architectures in the financial payments industry. The ideal candidate will have deep expertise in SQL, data modeling, ETL/ELT pipeline development, and cloud-based data platforms such as Databricks or Snowflake. You will play a key role in designing scalable data models, orchestrating reliable data workflows, and ensuring the integrity and performance of mission-critical financial datasets. This is a highly collaborative role interfacing with engineering, analytics, product, and compliance teams. Key Responsibilities Design, implement, and maint...

Sanas is revolutionizing the way we communicate with the world's first real-time algorithm, designed to modulate accents, eliminate background noises, and magnify speech clarity. Pioneered by seasoned startup founders with a proven track record of creating and steering multiple unicorn companies, our groundbreaking GDP-shifting technology sets a gold standard. Sanas is a 200-strong team, established in 2020. In this short span, we've successfully secured over $100 million in funding. Our innovation have been supported by the industry's leading investors, including Insight Partners, Google Ventures, Quadrille Capital, General Catalyst, Quiet Capital, and other influential investors. Our reput...

Design, build, and maintain scalable batch and streaming pipelines using Google Cloud Dataflow, Google Cloud Datastream, Airbyte, and orchestration tools (Airflow/Prefect/Dagster). Develop and optimize ETL/ELT processes across AWS Postgres, Google FHIR Store, and Google BigQuery. Build and maintain unified data models that integrate multiple healthcare data sources (EHR/FHIR, claims/X12, ADT/HL7, CRM, transactional Postgres, Tuva, and third-party APIs). Implement dbt/OBT transformations to create curated semantic layers for AI/LLM, BI, and predictive analytics. Ensure data quality, lineage, validation, and governance while maintaining HIPAA compliance and PHI/PII security. Collaborate with A...

Job Requisition ID # 25WD91419 Position Overview We are seeking a highly experienced Principal Engineer to lead the design, development, and evolution of our Batch Processing platform , which powers Autodesk's Analytics Data Platform (ADP). This role requires deep technical expertise in distributed data systems, large-scale pipeline orchestration, and hands-on leadership in shaping next-generation data platform capabilities. You will partner closely with Engineering Managers, Architects, Product teams, and Partner Engineering to modernize our data lakehouse architecture, deliver highly reliable data pipelines, and establish technical excellence across ingestion, processing, and governance. R...

About the Role: Join us in building the future of data-driven gender equality We&aposre assembling a world-class team to create a groundbreaking AI platform that will transform how organizations understand and serve half the world&aposs population. Think Harvey AI, but for one of the most important and overlooked domains in business intelligence. The Mission You&aposll be instrumental in building infrastructure that turns fragmented public data into actionable gender intelligence, helping Fortune 500 companies, governments, and NGOs make better decisions that impact billions of women worldwide. What You&aposll Do: Design and implement scalable data pipelines ingesting from 100+ global source...

How is this team contributing to vision of Providence Ensure a continual and seamless service for customers regardless of which services they access. What will you be responsible for End-to-end development and quality of solutions and services in conversational & Agentic AI capability Understanding and Implementing advanced techniques in Agentic AI & Conversational AI Frameworks. Introduce best practices in AI Frameworks. What would your day look like Lead the design and development of Agentic AI Frameworks, models and systems, ensuring high performance and scalability. Good in Python, RestAPI and data structure skills Fine-tune and optimize pre-trained large language models (LLMs) such as G...

As an experienced Software Engineer specialized in Internal Tooling and Support, you will be responsible for strengthening the ingestion infrastructure and internal operations tooling at the intersection of Engineering and Operations. Your role will involve ensuring smooth data ingestion, reliable scraping infrastructure, and efficient tooling for Ops teams. Additionally, you will act as the first layer of triage between Ops and Engineering Oncall, driving faster resolutions and building long-term automation to reduce operational overhead. - **Maintain and optimize the ingestion and scraping infrastructure, ensuring high reliability and performance. - **Design, build, and improve internal to...

As an Infoscion, your primary role would be to lead the engagement effort of providing high quality and value-adding consulting solutions to customers at different stages from problem definition to diagnosis to solution design development and deployment. You will review the proposals prepared by consultants, provide guidance, and analyze the solutions defined for the client's business problems to identify any potential risks and issues. Additionally, you will identify change management requirements and propose a structured approach to the client for managing the change using multiple communication mechanisms. Your responsibilities also include coaching, creating a vision for the team, provid...

About Chargebee: Chargebee is a subscription billing and revenue management platform powering some of the fastest-growing brands around the world today, including Calendly, Hopin, Pret-a-Manger, Freshworks, Okta, Study.com and others. Thousands of SaaS and subscription-first businesses process over billions of dollars in revenue every year through the Chargebee platform. Headquartered in San Francisco, USA, our 500+ team members work remotely throughout the world, including India, the Netherlands, Paris, Spain, Australia, and the USA. Chargebee has raised over $480 million in capital and is funded by Accel, Tiger Global, Insight Partners, Steadview Capital, and Sapphire Ventures. And were on...

This is your chance to contribute to building the foundational backend systems for "Citi Assist", a Generative AI assistant that aims to reach every Citi employee globally. As a core builder on this high-visibility platform, you will play a key role in setting the standard for how a global bank adopts this technology safely and at scale. In this hands-on role, your primary responsibility will be to build, code, and deliver within our Python backend. Your focus will be on creating high-quality, tested code and efficiently moving features from concept to production. Taking ownership of the features you develop is essential. This involves not only writing the code but also determining the best ...

You will be responsible for managing and optimizing PLM and MES systems to enhance manufacturing processes. This includes handling large volumes of structured and unstructured data, identifying and overcoming technical difficulties and integration issues in previous projects, and implementing robust data security measures to protect sensitive information. Your role will also involve designing and maintaining data warehouse architecture and optimizing Power BI performance, focusing on storage mode and response time. In addition, you will need to have a good understanding of manufacturing workflows, production planning, and quality control. You will be expected to generate comprehensive report...

Line of Service Advisory Industry/Sector Not Applicable Specialism Data, Analytics & AI Management Level Senior Associate Job Description & Summary At PwC, our people in data and analytics focus on leveraging data to drive insights and make informed business decisions. They utilise advanced analytics techniques to help clients optimise their operations and achieve their strategic goals. In business intelligence at PwC, you will focus on leveraging data and analytics to provide strategic insights and drive informed decision-making for clients. You will develop and implement innovative solutions to optimise business performance and enhance competitive advantage. *Why PWC At PwC, you will be pa...

Key Responsibilities : Plan, and execute the end-to-end migration of large-scale datasets and data pipelines from PostgreSQL to Snowflake, ensuring minimal downtime and data integrity. – Design, build, and optimize robust, scalable, and automated ETL/ELT data pipelines using Python and modern data engineering technologies. – Guide and mentor other data engineers, fostering a culture of technical excellence, collaboration, and knowledge sharing. Provide code reviews and architectural oversight. – Take full ownership of data engineering projects from conception through to deployment and ongoing maintenance. Be accountable for the quality, reliability, and timeliness of deliverables. – Work clo...

As a member of the Infosys consulting team, your primary responsibility will be to lead engagement efforts in delivering high-quality consulting solutions to customers. Your role will involve guiding the team through problem definition, diagnosis, solution design, development, and deployment stages. You will review proposals, provide guidance, analyze solutions, and identify potential risks and issues for client business problems. Additionally, you will suggest change management strategies and communication mechanisms to facilitate smooth transitions. Your duties will include coaching team members, providing subject matter training, and fostering a vision for the team. Motivating and inspiri...

As the Lead Python Software Engineer at Citi, you will have the exciting opportunity to build the foundational backend systems for "Citi Assist", a Generative AI assistant that is set to reach every Citi employee globally. Joining at the ground floor, you will play a pivotal role in developing a high-visibility platform that establishes the standard for the safe and scalable adoption of this technology by a global bank. In this hands-on role, your primary responsibility will be to build, code, and deliver high-quality, tested Python backend features efficiently. Taking ownership of the features you develop, you will drive them from conception to completion, ensuring security and compliance a...

You have over 8 years of experience and are located in Balewadi, Pune. You possess a strong understanding of Data Architecture and have led data-driven projects. Your expertise includes knowledge of Data Modelling paradigms like Kimball, Inmon, Data Marts, Data Vault, Medallion, etc. Experience with Cloud Based data strategies, particularly AWS, is preferred. Designing data pipelines for ETL with expert knowledge on ingestion, transformation, and data quality is a must, along with hands-on experience in SQL. In-depth understanding of PostGreSQL development, query optimization, and designing indexes is a key requirement. Proficiency in Postgres PL/SQL for complex warehouse workflows is necess...

The ideal candidate should possess extensive expertise in SQL, data modeling, ETL/ELT pipeline development, and cloud-based data platforms like Databricks or Snowflake. You will be responsible for designing scalable data models, managing reliable data workflows, and ensuring the integrity and performance of critical financial datasets. Collaboration with engineering, analytics, product, and compliance teams is a key aspect of this role. Responsibilities: - Design, implement, and maintain logical and physical data models for transactional, analytical, and reporting systems. - Develop and oversee scalable ETL/ELT pipelines to process large volumes of financial transaction data. - Optimize SQL ...

Job Role: We are seeking a highly skilled and experienced Data Architect with expertise in designing and building data platforms in cloud environments. The ideal candidate will have a strong background in either AWS Data Engineering or Azure Data Engineering, along with proficiency in distributed data processing systems like Spark. Additionally, proficiency in SQL, data modeling, building data warehouses, and knowledge of ingestion tools and data governance are essential for this role. TheData Architect will also need experience with orchestration tools such as Airflow or Dagster and proficiency in Python, with knowledge of Pandas being beneficial. ? Why Choose Ideas2IT Ideas2IT has all the ...

As a Senior Python Engineer at our company, you will leverage your deep expertise in data engineering and API development to drive technical excellence and autonomy. Your primary responsibility will be leading the development of scalable backend systems and data infrastructure that power AI-driven applications across our platform. You will design, develop, and maintain high-performance APIs and microservices using Python frameworks such as FastAPI and Flask. Additionally, you will build and optimize scalable data pipelines, ETL/ELT processes, and orchestration frameworks, ensuring the utilization of AI development tools like GitHub Copilot, Cursor, or CodeWhisperer to enhance engineering vel...

You should have a Bachelor's degree in Computer Science, Information Technology, or a related field. A strong understanding of operating systems, networking basics, and Linux command-line usage is essential. Proficiency in at least one scripting language such as Python or Bash is required. Basic knowledge of cloud computing concepts, with a preference for AWS, is expected. Familiarity with DevOps principles like CI/CD, automation, and cloud infrastructure management is a plus. Awareness of version control systems like Git is necessary. It would be beneficial to have exposure to cloud platforms, preferably AWS, and infrastructure services such as EC2, S3, RDS, and Kubernetes. Understanding of...

Position Overview We are seeking a skilled Data Engineer with 2-4 years of experience to design, build, and maintain scalable data pipelines and infrastructure. You will work with modern data technologies to enable data-driven decision making across the organisation. Key Responsibilities Design and implement ETL/ELT pipelines using Apache Spark and orchestration tools (Airflow/Dagster). Build and optimize data models on Snowflake and cloud platforms. Collaborate with analytics teams to deliver reliable data for reporting and ML initiatives. Monitor pipeline performance, troubleshoot data quality issues, and implement testing frameworks. Contribute to data architecture decisions and work with...