6 Dataframes Jobs

Requirements: Develop,maintain, andoptimizescalable data processing applications using Python andPySpark. Design and implement data solutions that meet performance and reliability requirements. Collaborate with data engineers, data scientists, and other stakeholders to gather requirements and deliver high-quality solutions. Write clean, efficient, and maintainable code following best practices and coding standards. Perform data analysis and ensure data quality and integrity. Monitorand troubleshoot performance issues in the data processing pipelines. Implement andmaintainCI/CD pipelines for automated testing and deployment. Stayup-to-datewith the latest industry trends and technologies in Python andPySpark Required Skills and Qualifications: BachelororMasterdegree in Computer Science, Engineering, or a related field. Proven experience as a Python Developer withexpertiseinPySpark. Strong knowledge of Python and its libraries (e.g., Pandas, NumPy). Experience with Apache Spark, including Spark SQL,DataFrames, and Spark Streaming. Proficiencyin SQL and experience with relational databases. Familiarity with big data tools and frameworks. Experience with version control systems such as Git. Strong problem-solving skills and attention to detail. Excellent communication and teamwork skills.

The FDR/CVR Data Analyst will play a critical role in ensuring the safety and efficiency of aircraft operations by performing in-depth analysis of flight data. You will work with large datasets from flight recorders to monitor aircraft health and support return-to-service processes. Collaborating with various teams, you will interpret data, develop reports, and ensure compliance with industry standards. Additionally, you will contribute to the development of new data analysis methodologies and tools, provide technical expertise, and maintain thorough documentation. Your key responsibilities will include performing detailed readouts and analysis of FDR and CVR data to support aircraft health monitoring and return-to-service processes. You will construct and manage dataframes for organizing and analyzing large datasets from flight recorders. Collaborating with cross-functional teams, including engineers and data scientists, you will interpret and present findings. Developing and maintaining documentation and reports related to FDR/CVR readouts and data analysis will also be part of your role. Ensuring compliance with industry standards and regulatory requirements in all data handling and analysis processes will be essential. Additionally, you will provide technical expertise and support in the development of new methodologies and tools for data analysis. To qualify for this position, you should have a Bachelor's degree in Aerospace Engineering, Data Science, or a related field. An advanced degree is preferred. Proven experience in FDR and CVR readouts and analysis is required. Proficiency in dataframe construction and data analysis is essential. Strong analytical and problem-solving skills with attention to detail are necessary. Excellent communication skills, both written and verbal, with the ability to present complex data in a clear and concise manner are important. Knowledge of aviation safety regulations and standards is a plus. You should be able to work independently and as part of a team in a fast-paced environment. AMETEK, Inc. is a leading global provider of industrial technology solutions serving a diverse set of attractive niche markets with annual sales over $7.0 billion. AMETEK is committed to making a safer, sustainable, and more productive world a reality. Differentiated technology solutions are used to solve customers" most complex challenges. With 21,000 colleagues in 35 countries, AMETEK is grounded by core values: Ethics and Integrity, Respect for the Individual, Inclusion, Teamwork, and Social Responsibility. AMETEK (NYSE: AME) is a component of the S&P 500. Visit www.ametek.com for more information.,

Join us as a Data Engineer at Barclays, where you will spearhead the evolution of our infrastructure and deployment pipelines, driving innovation and operational excellence. You will harness cutting-edge technology to build and manage robust, scalable and secure infrastructure, ensuring seamless delivery of our digital solutions. To be successful as a Data Engineer, you should have experience with hands-on experience in Pyspark and a strong knowledge of Dataframes, RDD, and SparkSQL. You should also have hands-on experience in developing, testing, and maintaining applications on AWS Cloud. A strong hold on AWS Data Analytics Technology Stack (Glue, S3, Lambda, Lake formation, Athena) is essential. Additionally, you should be able to design and implement scalable and efficient data transformation/storage solutions using Snowflake. Experience in data ingestion to Snowflake for different storage formats such as Parquet, Iceberg, JSON, CSV, etc., is required. Familiarity with using DBT (Data Build Tool) with Snowflake for ELT pipeline development is necessary. Advanced SQL and PL SQL programming skills are a must. Experience in building reusable components using Snowflake and AWS Tools/Technology is highly valued. Exposure to data governance or lineage tools such as Immuta and Alation is an added advantage. Knowledge of Orchestration tools such as Apache Airflow or Snowflake Tasks is beneficial, and familiarity with Abinitio ETL tool is a plus. Some other highly valued skills may include the ability to engage with stakeholders, elicit requirements/user stories, and translate requirements into ETL components. A good understanding of infrastructure setup and the ability to provide solutions either individually or working with teams is essential. Knowledge of Data Marts and Data Warehousing concepts, along with good analytical and interpersonal skills, is required. Implementing Cloud-based Enterprise data warehouse with multiple data platforms along with Snowflake and NoSQL environment to build data movement strategy is also important. You may be assessed on key critical skills relevant for success in the role, such as risk and controls, change and transformation, business acumen, strategic thinking, digital and technology, as well as job-specific technical skills. The role is based out of Chennai. Purpose of the role: To build and maintain the systems that collect, store, process, and analyze data, such as data pipelines, data warehouses, and data lakes to ensure that all data is accurate, accessible, and secure. Accountabilities: - Build and maintenance of data architectures pipelines that enable the transfer and processing of durable, complete, and consistent data. - Design and implementation of data warehouses and data lakes that manage the appropriate data volumes and velocity and adhere to the required security measures. - Development of processing and analysis algorithms fit for the intended data complexity and volumes. - Collaboration with data scientists to build and deploy machine learning models. Analyst Expectations: - Meet the needs of stakeholders/customers through specialist advice and support. - Perform prescribed activities in a timely manner and to a high standard which will impact both the role itself and surrounding roles. - Likely to have responsibility for specific processes within a team. - Lead and supervise a team, guiding and supporting professional development, allocating work requirements, and coordinating team resources. - Demonstrate a clear set of leadership behaviours to create an environment for colleagues to thrive and deliver to a consistently excellent standard. - Manage own workload, take responsibility for the implementation of systems and processes within own work area and participate in projects broader than the direct team. - Execute work requirements as identified in processes and procedures, collaborating with and impacting on the work of closely related teams. - Provide specialist advice and support pertaining to own work area. - Take ownership for managing risk and strengthening controls in relation to the work you own or contribute to. - Deliver work and areas of responsibility in line with relevant rules, regulations, and codes of conduct. - Maintain and continually build an understanding of how all teams in the area contribute to the objectives of the broader sub-function, delivering impact on the work of collaborating teams. - Continually develop awareness of the underlying principles and concepts on which the work within the area of responsibility is based, building upon administrative/operational expertise. - Make judgements based on practice and previous experience. - Assess the validity and applicability of previous or similar experiences and evaluate options under circumstances that are not covered by procedures. - Communicate sensitive or difficult information to customers in areas related specifically to customer advice or day-to-day administrative requirements. - Build relationships with stakeholders/customers to identify and address their needs. All colleagues will be expected to demonstrate the Barclays Values of Respect, Integrity, Service, Excellence, and Stewardship our moral compass, helping us do what we believe is right. They will also be expected to demonstrate the Barclays Mindset to Empower, Challenge, and Drive the operating manual for how we behave.,

The FDR/CVR Data Analyst will play a critical role in ensuring the safety and efficiency of aircraft operations by performing in-depth analysis of flight data. You will work with large datasets from flight recorders to monitor aircraft health and support return-to-service processes. Collaboration with various teams to interpret data, develop reports, and ensure compliance with industry standards is an essential part of your responsibilities. In addition, you will contribute to the development of new data analysis methodologies and tools, provide technical expertise, and maintain thorough documentation. Your key responsibilities will include performing detailed readouts and analysis of FDR and CVR data, constructing and managing dataframes for organizing and analyzing large datasets, collaborating with cross-functional teams to interpret and present findings, developing and maintaining documentation and reports related to FDR/CVR readouts and data analysis, ensuring compliance with industry standards and regulatory requirements, and providing technical expertise and support in the development of new methodologies and tools for data analysis. To qualify for this role, you should have a Bachelor's degree in Aerospace Engineering, Data Science, or a related field (Advanced degree preferred), proven experience in FDR and CVR readouts and analysis, proficiency in dataframe construction and data analysis, strong analytical and problem-solving skills with attention to detail, excellent communication skills (both written and verbal) with the ability to present complex data clearly and concisely, knowledge of aviation safety regulations and standards is a plus, and the ability to work independently and as part of a team in a fast-paced environment. AMETEK, Inc. is a leading global provider of industrial technology solutions serving a diverse set of attractive niche markets with annual sales over $7.0 billion. AMETEK is committed to making a safer, sustainable, and more productive world a reality by using differentiated technology solutions to solve customers" most complex challenges. With 21,000 colleagues in 35 countries, the core values of AMETEK include Ethics and Integrity, Respect for the Individual, Inclusion, Teamwork, and Social Responsibility. AMETEK (NYSE:AME) is a component of the S&P 500. Visit www.ametek.com for more information.,

Ready to build the future with AI At Genpact, we don&rsquot just keep up with technology&mdashwe set the pace. AI and digital innovation are redefining industries, and we&rsquore leading the charge. Genpact&rsquos AI Gigafactory, our industry-first accelerator, is an example of how we&rsquore scaling advanced technology solutions to help global enterprises work smarter, grow faster, and transform at scale. From large-scale models to agentic AI, our breakthrough solutions tackle companies most complex challenges. If you thrive in a fast-moving, innovation-driven environment, love building and deploying cutting-edge AI solutions, and want to push the boundaries of what&rsquos possible, this is your moment. Genpact (NYSE: G) is an advanced technology services and solutions company that delivers lasting value for leading enterprises globally. Through our deep business knowledge, operational excellence, and cutting-edge solutions - we help companies across industries get ahead and stay ahead. Powered by curiosity, courage, and innovation, our teams implement data, technology, and AI to create tomorrow, today. Get to know us at genpact.com and on LinkedIn, X, YouTube, and Facebook. Inviting applications for the role of Lead consultant - SQL/SSIS/SSRS! Responsibilities . Designing and implementing robust applications. . Good knowledge in implementing SCD1,2 and 3 on SSIS . Good to have knowledge on SSRS . Debugging applications to ensure low-latency and high-availability. . Writing optimized custom SQL queries . Integrate user-facing elements into applications . Test and debug programs for SSIS and SQL developer related . Improve functionality of existing systems . Implement security and data protection solutions . Must be capable of writing SQL queries for validating dashboard outputs . Must be able to translate visual requirements into detailed technical specifications . Good understanding and exposure on any Git, Bamboo, Confluence and Jira. . Good in Dataframes and SQL ANSI using pandas. . Team player, collaborative approach and excellent communication skills . Good to have knowledge on AWS cloud and Snowflake. . Qualifications we seek in you! Minimum qualifications . BE/B Tech/ MCA . Excellent written and verbal communication skills . Candidate should have experience . Understand user requirements and specifications for SSIS packages, SSRS reports and SQL Server Agent jobs to develop new and modify existing packages/reports/jobs . Should have in-depth knowledge on SSIS including data pull from multiple sources & databases, SFTP, SCD, & package optimization . Should to read and write complex queries, ability to create database objects (tables, views, stored procedures, user-defined functions) . Should have experience in creating matrix & tabular reports using SSRS including reports having multiple tabs. Should have understanding of creating Connecting Strings, DataSources, DataSets . Basics of Designing databases, create, and implement database systems based on the end user%27s requirements. . Good understanding and exposure on any Git, Bamboo, Confluence and Jira. . Good in Dataframes and SQL ANSI using pandas. . Team player, collaborative approach and excellent communication skills . Good to have knowledge on AWS cloud and Snowflake. Preferred qualifications . Creative ways of solving problems efficiently and logically . Good understanding of datawarehouse concepts. . Good to have knowledge on Python - pandas . Good to have knowledge on Snowflake DWH, BI Tools (Visualization). . Knowledge on Database performance tunning. . Learning attitude & Flexible with project and timings . Good communication and presentation skills Why join Genpact . Lead AI-first transformation - Build and scale AI solutions that redefine industries . Make an impact - Drive change for global enterprises and solve business challenges that matter . Accelerate your career&mdashGain hands-on experience, world-class training, mentorship, and AI certifications to advance your skills . Grow with the best - Learn from top engineers, data scientists, and AI experts in a dynamic, fast-moving workplace . Committed to ethical AI - Work in an environment where governance, transparency, and security are at the core of everything we build . Thrive in a values-driven culture - Our courage, curiosity, and incisiveness - built on a foundation of integrity and inclusion - allow your ideas to fuel progress Come join the 140,000+ coders, tech shapers, and growth makers at Genpact and take your career in the only direction that matters: Up. Let&rsquos build tomorrow together. Genpact is an Equal Opportunity Employer and considers applicants for all positions without regard to race, color, religion or belief, sex, age, national origin, citizenship status, marital status, military/veteran status, genetic information, sexual orientation, gender identity, physical or mental disability or any other characteristic protected by applicable laws. Genpact is committed to creating a dynamic work environment that values respect and integrity, customer focus, and innovation. Furthermore, please do note that Genpact does not charge fees to process job applications and applicants are not required to pay to participate in our hiring process in any other way. Examples of such scams include purchasing a %27starter kit,%27 paying to apply, or purchasing equipment or training.

Educational Requirements MCA,MSc,Bachelor of Engineering,BBA,BCom,BSc Service Line Data & Analytics Unit Responsibilities Spark Expertise Expert proficiency in Spark Ability to design and implement efficient data processing workflows Experience with Spark SQL and DataFrames Good exposure to Big Data architectures and good understanding of Big Data eco system Experience with some framework building experience on Hadoop Good with DB knowledge with SQL tuning experience. Good to have experience with Python, APIs and exposure to Kafka. Additional Responsibilities: Ability to work with clients to identify business challenges and contribute to client deliverables by refining, analyzing, and structuring relevant data Awareness of latest technologies and trends Logical thinking and problem solving skills along with an ability to collaborate Ability to assess the current processes, identify improvement areas and suggest the technology solutions One or two industry domain knowledge Technical and Professional Requirements: Primary skills:Technology->Big Data - Data Processing->Spark Preferred Skills: Technology->Big Data - Data Processing->Spark