Pyspark Developer

4 weeks ago


Bengaluru, India Manvision Technologies Full time
SN

Required Information

Details

1

Role

PySpark Developer

2

Required Technical Skill Set

PySpark, Python, HDFS, Hadoop, SQL

3

No of Requirements

02

4

Desired Experience Range

5+ years

Location of Requirement

India

Desired Competencies (Technical/Behavioral Competency)

Must-Have

Sound programming knowledge on PySpark & SQL in terms of processing large amount of semi structured & unstructured dataAbility to design data pipelines in end to end mannerKnowledge on Avro, Parquet formatKnowledge on working on Hadoop Big Data platformStrong debugging and troubleshooting capabilitiesGood knowledge with Python languageGood-to-Have

Knowledge on Jira, Agile, Sonar, Teamcity & CICDAny exposure / experience for an international Banking client / multi-vendor / multi geography teamsSN

Responsibility of / Expectations from the Role

1

Development in a programming language on Hadoop components

2

Testing & Validation

3

Debugging & troubleshooting

  • Bengaluru, India LTIMindtree Full time

    Job Description: Primary Skill Set: Lead PySpark Developer Seconday Skill Set: SAS tools Lead a team of data engineers in the design and implementation of big data solutions using PySpark. Collaborate with cross-functional teams to understand business needs and develop data-driven solutions. Design and implement scalable and robust data pipelines using...


  • Bengaluru, India LTIMindtree Full time

    Job Description: Primary Skill Set: Lead PySpark Developer Seconday Skill Set: SAS tools Lead a team of data engineers in the design and implementation of big data solutions using PySpark. Collaborate with cross-functional teams to understand business needs and develop data-driven solutions. Design and implement scalable and robust data pipelines using...

  • Pyspark

    2 months ago


    Bengaluru, India Riverforest Connections Full time

    Position Purpose - For the projects which are implemented on Data SSC platform, we need senior developer for python - pyspark development to migrate project from spark/scala to python-pyspark._ **Responsibilities** **Direct Responsibilities** Design high quality deliverables adhering to business requirement with defined standards and design principles,...

  • Pyspark Developer

    2 months ago


    Bengaluru, India Corporate Resources Full time

    Job DescriptionDesigning and developing big data applications using the PySpark framework to meet the needs of the businessWriting and optimizing Spark SQL statements to extract and manipulate large datasetsDeveloping and deploying Spark algorithms to perform data processing and analytics tasks, such as machine learning and graph processingDebugging and...

  • AM-Pyspark Developer

    4 weeks ago


    Bengaluru, India Genpact Full time

    With a startup spirit and 115,000+ curious and courageous minds, we have the expertise to go deep with the world’s biggest brands—and we have fun doing it. We dream in digital, dare in reality, and reinvent the ways companies work to make an impact far bigger than just our bottom line. We’re harnessing the power of technology and humanity to create...

  • AM-Pyspark Developer

    2 weeks ago


    Bengaluru, India Genpact Full time

    With a startup spirit and 115,000+ curious and courageous minds, we have the expertise to go deep with the world’s biggest brands—and we have fun doing it. We dream in digital, dare in reality, and reinvent the ways companies work to make an impact far bigger than just our bottom line. We’re harnessing the power of technology and humanity to create...

  • AM-Pyspark Developer

    4 weeks ago


    Bengaluru, India Genpact Full time

    With a startup spirit and 115,000+ curious and courageous minds, we have the expertise to go deep with the world’s biggest brands—and we have fun doing it. We dream in digital, dare in reality, and reinvent the ways companies work to make an impact far bigger than just our bottom line. We’re harnessing the power of technology and humanity to create...

  • AM-Pyspark Developer

    2 weeks ago


    Bengaluru, India Genpact Full time

    With a startup spirit and 115,000+ curious and courageous minds, we have the expertise to go deep with the world’s biggest brands—and we have fun doing it. We dream in digital, dare in reality, and reinvent the ways companies work to make an impact far bigger than just our bottom line. We’re harnessing the power of technology and humanity to create...

  • Big Data

    2 months ago


    Bengaluru, India AR TECHNOLOGY Full time

    **Pyspark Developer** Exp : 6-9 yrs Location - Bangalore /Chennai **Job Description**: **Key Responsibilities**: MongoDB - Build Machine Learning models - Deployment on Cloud platforms **Must have**: - Total IT / development experience of minimum 4+ years of Big Data. - Deep knowledge of Pyspark and libraries to develop and debug complex data...


  • Bengaluru, India Natobotics Technologies Private Limited Full time

    **INFOSYS IS HIRING PYTHON,PYSPARK WITH AWS FOR BANGALORE & MUMBAI** Exp : 5+ Yrs Role : Python,Pyspark With AWS Location : Bangalore & Mumbai Payroll : Natobotics Client : Infosys Below is JD. Skill Set (any 1 as primary pls mention) 1. Python 2. PySpark 3. AWS 4. SQL 5. Snowflake, 6. DevOps JD details 1. Design and develop data integration...

  • Python, Pyspark

    2 months ago


    Bengaluru, India Ziniosedge Full time

    Python, Pyspark 5 Technology Lead (Data Engineer) BE - 8+ years of industry experience as Lead Developer - Experience in implementing ETL and ELT data pipelines with PySpark - Spark Structured API, SPARK SQL & Spark Performance tuning are highly preferred. - Experience in building data pipelines on data lake or Lakehouse(AWS Databricks) & handling...

  • Python+Pyspark

    2 weeks ago


    Bengaluru, India Wissen Full time

    Wissen Technology is now hiringPython+PysparkWe are seeking a skilled Python Developer with a strong background in PySpark to develop and optimize data processing applications. The ideal candidate will be responsible for building robust and scalable data processing solutions using Python and...

  • Adb + Pyspark + SQL

    2 months ago


    Bengaluru, India RARR Technologies Full time

    **Job Details - ADB + Pyspark + SQL**: **Job ID**: - RARR Job 3323**Job Title**: - ADB + Pyspark + SQL**Job Type**: - Permanent**Job Location**: - Bangalore**Total Experience**: - 5 - 8 Years**Skills**: - Adb, Sql, Pyspark, Azure Databricks, Synapse Analytics**Posted - **23/05/2023 **Job Description**: **Responsibilities**: - Design, develop, and...


  • Bengaluru, India 12542 Citicorp Services India Private Limited Full time

    Data Engineer:The Data Engineer is responsible for building Data Engineering Solutions using next generation data techniques. The individual will be working with tech leads, product owners, customers and technologists to deliver data products/solutions in a collaborative and agile environment.Responsibilities:Responsible for design and development of big...

  • Python+Pyspark

    2 weeks ago


    Bengaluru, India Wissen Full time

    Wissen Technology is now hiringPython+Pyspark We are seeking a skilled Python Developer with a strong background in PySpark to develop and optimize data processing applications. The ideal candidate will be responsible for building robust and scalable data processing solutions using Python and PySpark. Experience–4-8years Location:Bangalore ...


  • Bengaluru, India Spruce IT Pvt. Ltd. Full time

    Job Role: Sr Python Developer. Skills: PySpark / Flink / Apache Spark / Scala. Experience: 6+ years. Location: Pan India. JD: - Sr Python Developer.- Must have Hands on experience- in python.- Develop pipeline objects using PySpark / Flink / Apache Spark / Scala. - Candidates preferred who have experience in building real-time data streams using Flink and...

  • Aws Pyspark

    2 weeks ago


    Bengaluru, India Cognizant Full time

    Mandatory skills AWS, Python and PySpark, Spark SQL, NoSQL Data Bricks Experience on AWS and its web service offering S3, Redshift, EC2, EMR, Lambda, CloudWatch, RDS, Step functions, Spark streaming etc. Good knowledge of Configuring and working on Multi node clusters and distributed data processing framework Spark. Hands on experience with EMR Apache Spark...


  • Bengaluru, India EMPASYS INFO SOLUTIONS PVT LTD Full time

    Job Role: SoftwareDeveloper (Python Pyspark AWSDevops)Experience: 5 YearsMandatory Skills: Python Pyspark AWSDevopsLocation: Pune Work mode: HybridBudget: 16 LPA Education:GraduateTechnologySkills: Strongknowledge of Python/Pyspark and Bash scriptingExperience working with Data frames PandasScipy Numpy libraries is a plus Strong handsonworking knowledge in...

  • Pyspark QA

    7 days ago


    Bengaluru, India Virtusa Full time

    **Skill: Pyspark QA** **Role / Tier: T2/Senior Consultant*** **Required Skills**: Experience with BIG Data technology mentioned below Hadoop Big Data HDFS,PYTHON,SPARK SQL MapReduce with PYSpark. Hands on experience in build CI CD pipelines is required Outstanding coding, debugging and analytical skills,Core problem solving skills and data migration from...


  • Bengaluru, India Horigine Consulting Pvt. Ltd Full time

    DescriptionWe are seeking a highly skilled and experienced Azure Databricks Developer with expertise in PySpark and SparkSQL. As an Azure Databricks Developer, you will be responsible for designing, developing, and implementing data processing solutions using PySpark and SparkSQL. You will work closely with our team to understand business requirements and...