pyspark developer

Strong experience in PySpark. Good programming knowledge of Python. Hands-on experience with SQL. Understanding of ETL/ELT concepts and data warehousing. Experience working with large datasets and distributed processing. Knowledge of Spark SQL, DataFrames, and Spark transformations. Familiarity with Linux/Unix environment. Design, develop, and maintain data...

## Job highlights - 2-8 years experience with strong PySpark, Python, SQL, and Big Data skills - Design and maintain scalable PySpark data processing applications and ETL pipelines; optimize Spark jobs; collaborate with stakeholders; ensure data quality and governance **Position: PySpark Developer** **Experience: 2-8 Years** **Location: Pan India** ...

## Job highlights - Experience with PySpark and Spark, degree in MCA, MSc, MTech, B.Tech, BCA, or BSc - Support consulting team in problem definition, solution design, deployment, build POCs, and configure solution requirements **Job description** Hiring for PySpark ,Spark **Responsibilities** A day in the life of an Infoscion As part of the...

Job Description Required Qualifications • Bachelor's degree in Computer Science, Information Systems, Engineering, or related field. • 5+ years of IT experience with5+ years in Data Engineering and Big Data development. • Strong hands-on experience with PySpark and Spark-based data processing. • Experience developing data pipelines on Cloudera Data...

**Position:** **Pyspark Developer** **Experience:** **2 to 5 years** **Location:** **Pan India Opening** **Employment Type:** **Full-Time** **Roles & Responsibilities** - Design and develop scalable data processing applications using PySpark and Spark. - Build and maintain ETL/ELT pipelines for large-scale datasets. - Process structured and...

- Primary skills: Pyspark , Spark , Hadoop , SQL - At least 6+ years of experience in designing and developing large scale, distributed data processing pipelines using PySpark, Hadoop and related technologies. - Having expertise in Pyspark, Spark Core, Spark SQL, Batch processing and Spark Streaming - Experience with Hadoop, HDFS, Hive and other BigData...

" AIA - Chennai" Weekend Drive Drive Date: 14th November 2026 Skill: Azure Databricks, Pyspark Experience: 6 - 9 Years Mode of Interview: Face to Face Interview Location: Chennai Job Summary This hybrid Data Engineer role focuses on designing and optimizing Databricks SQL and PySpark solutions for complex payer and Medicare Medicaid claims processing....

Wipro Limited (NYSE: WIT, BSE: 507685, NSE: WIPRO) is a leading technology services and consulting company focused on building innovative solutions that address clients’ most complex digital transformation needs. Leveraging our holistic portfolio of capabilities in consulting, design, engineering, and operations, we help clients realize their...

Industry/SectorNot ApplicableSpecialismAnalyticsManagement LevelManagerJob Description & SummaryThe OpportunityJoin our Acceleration Center India and help shape the future of business for our diverse client portfolio across geographies and jurisdictions. You’ll work at the heart of global teams across Advisory, Assurance, Tax and Business...

Description: Job Description: 5+ years of Data Engineering experience.• 3+ years of Denodo development experience.• Strong knowledge of:o Virtual Data Modelso Data Integrationo SQLo Data Warehousingo Dimensional Modeling• Experience with:o AWS Lambdao ETL/ELT developmento APIs and Web Serviceso Data Product development• Experience implementing:o...

Project Description: • Surveillance Enhancement Program (SEP) is a multi-year program (MYP) to build and enhance the surveillance platform to detect potential instances of market misconduct, market manipulation and market abuse. The Bank met its commitment to FCA (Financial Conduct Authority, FCA) to meet Market Abuse Regulation ("MAR") requirements for...

Responsibilities Specialist Software Engineer – Data Engineer (Databricks-pySpark) Responsibilities • Understand business and technical requirements and translate them into scalable, maintainable data engineering solutions. • Own the design and development of robust, high‑performance data pipelines using Databricks(pySpark). • Build and optimize...

DescriptionAgile Dev Team Members have collective responsibility for the design, development, testing and/or deployment of system functionality. Provides guidance, mentorship and training to a direct reporting staff of Agile Dev team members. Agile Dev Team Member IV with primarily a development discipline provides technical feasibility using a range of...

**Project Description:** - Surveillance Enhancement Program (SEP) is a multi-year program (MYP) to build and enhance the surveillance platform to detect potential instances of market misconduct, market manipulation and market abuse. The Bank met its commitment to FCA (Financial Conduct Authority, FCA) to meet Market Abuse Regulation ("MAR") requirements for...

The Applications Development Technology Lead Analyst is a senior level position responsible for establishing and implementing new or revised application systems and programs in coordination with the Technology team. The overall objective of this role is to lead applications systems analysis and programming activities. Responsibilities: • Partner with...

About Persistent We are an AI-led, platform-driven Digital Engineering and Enterprise Modernization partner, combining deep technical expertise and industry experience to help our clients anticipate what?s next. Our offerings and proven solutions create a unique competitive advantage for our clients by giving them the power to see beyond and rise above. We...

Job Description: Python Developer with Hadoop Background Chicago, IL,  Denver, CO,  Jacksonville, FL,  Charlotte, NC (Onsite interview from these locations only) W2 Candidates – visa open 5 Days Onsite   Python + Sql + Hive + Pyspark + Hadoop (Exposure) – rest all Development and coding experience. No Data Engineer profiles   JD: Key Skills &...

## Job highlights - 6 to 8 years experience with expertise in PySpark, Azure Databricks, and Azure Data Factory - Design, develop, and maintain scalable data pipelines and ETL/ELT workflows using Azure data services; optimize Spark jobs and ensure data quality **Job Description:** **Position: PySpark ,** **Databricks Engineer** **Experience:** **6 to 8...

7-9 years of overall IT experience. Strong hands-on expertise in Databricks and PySpark. Proficiency in Python programming and SQL. Experience building enterprise-scale data pipelines and data lake solutions. Strong understanding of distributed computing concepts and Spark architecture. Experience in performance tuning and optimization. Excellent stakeholder...

12-16 years of IT experience with strong Data Engineering expertise. Hands-on experience in Azure Databricks and PySpark development. Strong knowledge of Azure Data Factory (ADF). Expertise in SQL and Data Warehousing concepts. Experience with Azure Data Lake Storage (ADLS Gen2). Strong understanding of Spark architecture and performance tuning. Experience...