Pyspark Developer

4 weeks ago


bangalore, India Manvision Technologies Full time

SN

Required Information

Details

1

Role

PySpark Developer

2

Required Technical Skill Set

PySpark, Python, HDFS, Hadoop, SQL

3

No of Requirements

02

4

Desired Experience Range

5+ years

Location of Requirement

India

Desired Competencies (Technical/Behavioral Competency)

Must-Have

  • Sound programming knowledge on PySpark & SQL in terms of processing large amount of semi structured & unstructured data
  • Ability to design data pipelines in end to end manner
  • Knowledge on Avro, Parquet format
  • Knowledge on working on Hadoop Big Data platform
  • Strong debugging and troubleshooting capabilities
  • Good knowledge with Python language

Good-to-Have

  1. Knowledge on Jira, Agile, Sonar, Teamcity & CICD
  2. Any exposure / experience for an international Banking client / multi-vendor / multi geography teams

SN

Responsibility of / Expectations from the Role

1

Development in a programming language on Hadoop components

2

Testing & Validation

3

Debugging & troubleshooting


  • Pyspark Developer

    2 months ago


    bangalore, India Corporate Resources Full time

    Job Description Designing and developing big data applications using the PySpark framework to meet the needs of the business Writing and optimizing Spark SQL statements to extract and manipulate large datasets Developing and deploying Spark algorithms to perform data processing and analytics tasks,...

  • AM-Pyspark Developer

    4 weeks ago


    bangalore, India Genpact Full time

    With a startup spirit and 115,000+ curious and courageous minds, we have the expertise to go deep with the world’s biggest brands—and we have fun doing it. We dream in digital, dare in reality, and reinvent the ways companies work to make an impact far bigger than just our bottom line. We’re harnessing the power of technology and humanity to create...

  • AM-Pyspark Developer

    2 weeks ago


    bangalore, India Genpact Full time

    With a startup spirit and 115,000+ curious and courageous minds, we have the expertise to go deep with the world’s biggest brands—and we have fun doing it. We dream in digital, dare in reality, and reinvent the ways companies work to make an impact far bigger than just our bottom line. We’re harnessing the power of technology and humanity to create...

  • Python Pyspark Lead

    1 month ago


    bangalore, India Virtusa Full time

    Python Pyspark Lead - CREQ187226 Description Design and develop on Hadoop applications,Hands on in developing Jobs in pySpark with Python/ SCALA (Preferred) or Java/ SCALAExperience on Core Java, Experience on Map Reduce programs, Hive programming, Hive queries performance conceptsExperience on source code management with Git repositoriesSecondary...

  • Python Pyspark Lead

    2 weeks ago


    bangalore, India Virtusa Full time

    Python Pyspark Lead - CREQ187226 Description Design and develop on Hadoop applications,Hands on in developing Jobs in pySpark with Python/ SCALA (Preferred) or Java/ SCALAExperience on Core Java, Experience on Map Reduce programs, Hive programming, Hive queries performance conceptsExperience on source code management with Git repositoriesSecondary...

  • Tableau Developer

    2 months ago


    Bangalore,Chennai, India Sam manpower services & Career LLP Full time

    Tableau Developer - Develop Tableau dashboards and reports to visualize business metrics, KPIs, and trends, based on stakeholder requirements.- Collaborate with data engineers to access and prepare data from various sources, ensuring data quality and integrity for Tableau visualizations.- Optimize Tableau dashboards for performance and usability,...

  • Python+Pyspark

    2 weeks ago


    bangalore, India Wissen Full time

    Wissen Technology is now hiringPython+Pyspark We are seeking a skilled Python Developer with a strong background in PySpark to develop and optimize data processing applications. The ideal candidate will be responsible for building robust and scalable data processing solutions using Python and PySpark. Experience–4-8years Location:Bangalore ...

  • ETL Developer

    2 months ago


    bangalore, India IT Full time

    We are seeking a skilled ETL Developer with a total of 5 years of experience, including a minimum of 2 to 3 years of hands-on experience with Data Bricks. Proficiency in Python and PySpark is essential for this - Develop, implement, and maintain ETL processes for data integration, transformation, and loading.- Collaborate with stakeholders to understand...

  • ETL Developer

    2 months ago


    Bangalore, India IT Full time

    We are seeking a skilled ETL Developer with a total of 5 years of experience, including a minimum of 2 to 3 years of hands-on experience with Data Bricks. Proficiency in Python and PySpark is essential for this - Develop, implement, and maintain ETL processes for data integration, transformation, and loading.- Collaborate with stakeholders to understand...

  • ETL Developer

    2 weeks ago


    Bangalore, India IT Full time

    We are seeking a skilled ETL Developer with a total of 5 years of experience, including a minimum of 2 to 3 years of hands-on experience with Data Bricks. Proficiency in Python and PySpark is essential for this - Develop, implement, and maintain ETL processes for data integration, transformation, and loading.- Collaborate with stakeholders to understand...


  • bangalore, India Anicalls (Pty) Ltd Full time

    • PySpark Developer / PySpark Data Engineer• Should have at least three years of strong experience in PySpark• Strong SQL Expertise• Strong communication and client-facing skills


  • Bangalore, India Spruce IT Pvt. Ltd. Full time

    Job Role: Sr Python Developer. Skills: PySpark / Flink / Apache Spark / Scala. Experience: 6+ years. Location: Pan India. JD: - Sr Python Developer.- Must have Hands on experience- in python.- Develop pipeline objects using PySpark / Flink / Apache Spark / Scala. - Candidates preferred who have experience in building real-time data streams using Flink and...


  • Bangalore, India Spruce IT Pvt. Ltd. Full time

    Job Role: Sr Python Developer. Skills: PySpark / Flink / Apache Spark / Scala. Experience: 6+ years. Location: Pan India. JD: - Sr Python Developer.- Must have Hands on experience- in python.- Develop pipeline objects using PySpark / Flink / Apache Spark / Scala. - Candidates preferred who have experience in building real-time data streams using Flink and...


  • bangalore, India 12542 Citicorp Services India Private Limited Full time

    Data Engineer: The Data Engineer is responsible for building Data Engineering Solutions using next generation data techniques. The individual will be working with tech leads, product owners, customers and technologists to deliver data products/solutions in a collaborative and agile environment. Responsibilities: Responsible for design and...

  • Data Analyst

    2 months ago


    Bangalore, India Varite India Full time

    About the job :Company Name : VARITE India Private LimitedAbout The Client : - A global information technology, consulting, and business process services company, headquartered in India, provides a broad spectrum of services, including IT consulting, application development, business process outsourcing, and digital solutions.- Serving clients across diverse...


  • bangalore, India EMPASYS INFO SOLUTIONS PVT LTD Full time

    Job Role: SoftwareDeveloper (Python Pyspark AWS Devops ) Experience: 5 YearsMandatory Skills: Python Pyspark AWSDevops Location: Pune Work mode: Hybrid Budget: 16 LPA Education:Graduate TechnologySkills: Strongknowledge of Python/Pyspark and Bash scripting Experience working with Data frames PandasScipy Numpy libraries is a plus Strong handsonworking...

  • Pyspark

    4 weeks ago


    bangalore district, India Alp Consulting Limited Full time

    Job description Title-Hadoop Developer Must Skill-Hadoop + Pyspark Years of Exp-4-6 Years Location: Whitefield, Bangalore-560066 Shift Time- General Shift (9 am- 6 pm) Job Title: Hi Applicants!!! Hiring for a Job in a Reputed Organization(Product and Service based company) . Here is a Gateway to it, through ALP Consulting. Recruiting...


  • Anywhere in India,Multiple Locations,Bangalore,Hyderabad,Pune,Chennai CA-One India Full time

    Job descriptionJob Opportunity: Pyspark DeveloperExperience: 6+ YearsLocation: Bangalore, Hyderabad, Pune, ChennaiJob description : Good hands-on experience in Pyspark, preferably more than 5 years Should have good knowledge of Python and spark concepts Develop and maintain data pipelines and ETL processes using Python and Pyspark. Design, implement, and...


  • bangalore, India Horigine Consulting Pvt. Ltd Full time

    Description We are seeking a highly skilled and experienced Azure Databricks Developer with expertise in PySpark and SparkSQL. As an Azure Databricks Developer, you will be responsible for designing, developing, and implementing data processing solutions using PySpark and SparkSQL. You will work closely with our team to understand business requirements and...

  • Data Engineer

    4 weeks ago


    bangalore, India WIZSTAFFING PRIVATE LIMITED Full time

    Job Description : We at Captain Fresh, are building smart supply chain to deliver the highest quality seafood and meat for the Indian consumer. Our innovations in process management and workforce orchestration along with strong industry credentials are enabling us to deliver the fastest harvest-to-fork in the industry. Our endeavor is to leverage...