1849 Data Engineer Jobs - Page 9

Data Engineer with below skills and experience 8 Years of experience in any 2 of the below skills AWS DevOps CICD Jenkins GitHub Show a good understanding of cloud infrastructure best practices Experience range 5 to 7 years Mandatory skills- AWS DevOps,Terraforms,CICD,Jenkins,GitHub

* Provide expertise in analysis, requirements gathering, design, coordination, customization, testing and support of reports, in client’s environment * Develop and maintain a strong working relationship with business and technical members of the team * Relentless focus on quality and continuous improvement * Perform root cause analysis of reports issues * Development / evolutionary maintenance of the environment, performance, capability and availability. * Assisting in defining technical requirements and developing solutions * Effective content and source-code management, troubleshooting and debugging. Required education Bachelor's Degree Preferred education Master's Degree Required technica...

As Data Engineer, you will develop, maintain, evaluate and test big data solutions. You will be involved in the development of data solutions using Spark Framework with Python or Scala on Hadoop and AWS Cloud Data Platform * Responsibilities: * Experienced in building data pipelines to Ingest, process, and transform data from files, streams and databases. Process the data with Spark, Python, PySpark, Scala, and Hive, Hbase or other NoSQL databases on Cloud Data Platforms (AWS) or HDFS * Experienced in develop efficient software code for multiple use cases leveraging Spark Framework / using Python or Scala and Big Data technologies for various use cases built on the platform * Experience in d...

Role Description As a Senior Cloud Data Platform (Azure) Engineer at Incedo, you will be responsible for managing and optimizing the Microsoft Azure environment, ensuring its performance, scalability, and security. You will work closely with data analysts and data scientists to develop data pipelines and run data science experiments. You will be skilled in cloud computing platforms such as AWS or GCP and have experience with data warehousing technologies such as Azure Synapse Analytics. You will be responsible for configuring and optimizing the Azure environment, ensuring that data pipelines are efficient and accurate, and troubleshooting any issues that arise. You will also work with the se...

Role Description As a Technical Lead - Cloud Data Platform (Azure) at Incedo, you will be responsible for managing and optimizing the Microsoft Azure environment, ensuring its performance, scalability, and security. You will work closely with data analysts and data scientists to develop data pipelines and run data science experiments. You will be skilled in cloud computing platforms such as AWS or GCP and have experience with data warehousing technologies such as Azure Synapse Analytics. You will be responsible for configuring and optimizing the Azure environment, ensuring that data pipelines are efficient and accurate, and troubleshooting any issues that arise. You will also work with the s...

Role & responsibilities Experience :- 6 + Experience At least 5 years of experience in AWS based projects. Technical skills Proficiency in Python and PySpark for data engineering tasks. Big Data Strong knowledge of Big Data technologies and data warehousing concepts. AWS services Experience with AWS Data Engineering stack, including S3, RDS, Athena, Glue, Lambda, and Step Functions. SQL Strong SQL skills for data manipulation and querying. CI CD Experience with CI CD tools like Terraform and Git Actions. Soft skills Good communication skills and ability to work in a multicultural team.

Roles and Responsibilities : Design, develop, test, deploy and maintain large-scale data pipelines using Python and SQL. Collaborate with cross-functional teams to gather requirements and deliver high-quality data solutions. Ensure scalability, reliability, and performance of the data infrastructure on AWS cloud platform. Troubleshoot complex issues related to data processing, storage, and retrieval. Job Requirements : 5-8 years of experience in Data Engineering with expertise in Python programming language. Strong understanding of SQL database management systems (e.g., MySQL) for querying large datasets. Proficiency in developing ETL processes using Python libraries like Pandas, NumPy, etc.

About The Role Project Role : Custom Software Engineer Project Role Description : Develop custom software solutions to design, code, and enhance components across systems or applications. Use modern frameworks and agile practices to deliver scalable, high-performing solutions tailored to specific business needs. Must have skills : Python (Programming Language) Good to have skills : Dataiku Data Science Studio (DSS), Google Cloud Platform Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Custom Software Engineer, you will develop custom software solutions that involve designing, coding, and enhancing components across various sy...

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Cloud Data Migration, Google BigQuery, Data Building Tool Good to have skills : NA Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data ...

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Microsoft Azure DevOps Good to have skills : NA Minimum 7.5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data pipelines, ensuring data quality,...

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : PySpark Good to have skills : NA Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data pipelines, ensuring data quality, and implementing...

About The Role Project Role : Custom Software Engineer Project Role Description : Develop custom software solutions to design, code, and enhance components across systems or applications. Use modern frameworks and agile practices to deliver scalable, high-performing solutions tailored to specific business needs. Must have skills : Python (Programming Language) Good to have skills : Google Cloud Platform Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Custom Software Engineer, you will engage in the development of custom software solutions that involve designing, coding, and enhancing various components across systems or appli...

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : PySpark Good to have skills : NA Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data pipelines, ensuring data quality, and implementing...

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Cognite Data Fusion Good to have skills : Cucumber Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Roles & Responsibilities: As an application data engineer, you will provide functional and/or technical expertise to plan, analyze, define, and support the delivery of future functional and technical capabilities for an ...

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Cognite Data Fusion Good to have skills : Stakeholder Management Minimum 7.5 year(s) of experience is required Educational Qualification : 15 years full time education Roles & Responsibilities: As an application data engineer, you will provide functional and/or technical expertise to plan, analyze, define, and support the delivery of future functional and technical capa...

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Databricks Unified Data Analytics Platform, Microsoft SQL Server, AWS Redshift Good to have skills : NA Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will i...

About The Role Project Role : Custom Software Engineer Project Role Description : Develop custom software solutions to design, code, and enhance components across systems or applications. Use modern frameworks and agile practices to deliver scalable, high-performing solutions tailored to specific business needs. Must have skills : Python (Programming Language) Good to have skills : Dataiku Data Science Studio (DSS), Google Cloud Platform Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Custom Software Engineer, you will engage in the development of custom software solutions that involve designing, coding, and enhancing various...

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : PySpark Good to have skills : NA Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data pipelines, ensuring data quality, and implementing...

Senior AWS Big Data Engineer/Lead Job Description Senior AWS Big Data Engineer/Lead required at PAN India locations. Experience Range: 9 to 15 Years Key Technical Skills Relevant experience of 9-15 years in this role. Deep expertise in building data pipelines on AWS Cloud. Hands-on implementation knowledge to develop, build, and deploy data pipelines on AWS. Proficient in PySpark (Python + Spark) and code development. Working knowledge of AWS services such as EMR, Lambda, S3, etc. Knowledge of AWS data services including Data Lake, Glue, Athena. Knowledge of CI/CD and Airflow is an advantage. Location Mumbai Job Function Consultancy Role Engineer Desired Skills AWS | Python | Integration Qua...

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : PySpark Good to have skills : Microsoft SQL Server, Python (Programming Language), AWS Redshift Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve c...

About The Role Project Role : Custom Software Engineer Project Role Description : Develop custom software solutions to design, code, and enhance components across systems or applications. Use modern frameworks and agile practices to deliver scalable, high-performing solutions tailored to specific business needs. Must have skills : Python (Programming Language) Good to have skills : Google Cloud Platform Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Custom Software Engineer, you will engage in the development of custom software solutions that involve designing, coding, and enhancing various components across systems or appli...

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Microsoft SQL Server, AWS S3 (Simple Storage Service) Good to have skills : NA Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data pipe...

About The Role Project Role : Custom Software Engineer Project Role Description : Develop custom software solutions to design, code, and enhance components across systems or applications. Use modern frameworks and agile practices to deliver scalable, high-performing solutions tailored to specific business needs. Must have skills : Python (Programming Language) Good to have skills : Dataiku Data Science Studio (DSS), Google Cloud Platform Minimum 7.5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Custom Software Engineer, you will develop custom software solutions to design, code, and enhance components across systems or applications. ...

About The Role Project Role : Custom Software Engineer Project Role Description : Develop custom software solutions to design, code, and enhance components across systems or applications. Use modern frameworks and agile practices to deliver scalable, high-performing solutions tailored to specific business needs. Must have skills : Python (Programming Language) Good to have skills : Google Cloud Platform Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Custom Software Engineer, you will develop custom software solutions that involve designing, coding, and enhancing components across various systems or applications. Your typical...

Join us as a Data Engineer Were looking for someone to build effortless, digital first customer experiences to help simplify our organisation and keep our data safe and secure Day-to-day, youll develop innovative, data-driven solutions through data pipelines, modelling and ETL design while inspiring to be commercially successful through insights If youre ready for a new challenge, and want to bring a competitive edge to your career profile by delivering streaming data ingestions, this could be the role for you We're offering this role at associate vice president level What youll do Your daily responsibilities will include you developing a comprehensive knowledge of our data structures and me...