Pyspark

1 week ago


Bengaluru, Karnataka, India Riverforest Connections Full time
Position Purpose

  • For the projects which are implemented on Data SSC platform, we need senior developer for python
- pyspark development to migrate project from spark/scala to python-pyspark._

Responsibilities

Direct Responsibilities
Design high quality deliverables adhering to business requirement with defined standards and design principles, patterns

Develop and maintain highly scalable, high performance code

Develop/Integrate the code adhering to CI/CD

Provide solutions relevant to existing technology architecture.

Manage & Support the storage platform for the project

Create tests and ensure code coverage is met as per the agreed standards

Contributing Responsibilities
To work with members of DataSSC in establishing the best practises related to python-pyspark development

Technical & Behavioral Competencies

  • Deep experience in developing data processing task using pyspark such as reading data from external sources, merge data, perform data enrichment and load into target destinations
  • Experience to Big Data ecosystem components (Hive, ZooKeeper, Oozie, HDFS etc.)
  • Produce unit tests and document for pyspark transformations and helper methods
  • Preferred to have ETL background
  • Good knowledge in Unix Shell scripting
  • CI/CD with knowledge of Git Hub and Jenkins
  • Ability to learn new concepts, technologies and tools quickly
  • Solid understanding of Agile Sprint methodologies
  • Ability to communicate effectively in both a technical and non-technical manner

Skills Required:

pyspark

Location
Mumbai / Chennai / Bangalore/Bengaluru

Years Of Experience
4 to 9 Years
  • Bigdata + Pyspark

    1 week ago


    Bengaluru, Karnataka, India Impetus Technologies Full time

    BIgdata + Pyspark :Big Data; Hadoop / HDFS,Pyspark,PythonExperience with design and coding across one or more platforms and languages (e.g. , Python/Pyspark/SQL) as appropriateHands-on expertise with application design, software developmentProficient in Big Data technologies Designs, codes, tests, corrects and documents large and/or complex programs and...

  • Bigdata + Pyspark

    1 week ago


    Bengaluru, Karnataka, India Impetus Technologies Full time

    BIgdata + Pyspark : Big Data; Hadoop / HDFS,Pyspark,Python Experience with design and coding across one or more platforms and languages (e.g. , Python/Pyspark/SQL) as appropriateHands-on expertise with application design, software development Proficient in Big Data technologies Designs, codes, tests, corrects and documents large and/or complex programs and...


  • Bengaluru, Karnataka, India LTIMindtree Full time

    Job Description: Primary Skill Set: Lead PySpark Developer Seconday Skill Set: SAS tools Lead a team of data engineers in the design and implementation of big data solutions using PySpark. Collaborate with cross-functional teams to understand business needs and develop data-driven solutions. Design and implement scalable and robust data pipelines using...

  • Pyspark Developer

    1 week ago


    Bengaluru, Karnataka, India Manvision Technologies Full time

    SNRequired InformationDetails1RolePySpark Developer2Required Technical Skill SetPySpark, Python, HDFS, Hadoop, SQL3No of Requirements024Desired Experience Range5+ yearsLocation of RequirementIndiaDesired Competencies (Technical/Behavioral Competency)Must-HaveSound programming knowledge on PySpark & SQL in terms of processing large amount of semi structured &...

  • Python+Pyspark

    1 week ago


    Bengaluru, Karnataka, India Wissen Full time

    Wissen Technology is now hiringPython+Pyspark We are seeking a skilled Python Developer with a strong background in PySpark to develop and optimize data processing applications. The ideal candidate will be responsible for building robust and scalable data processing solutions using Python and PySpark. Experience–4-8years Location:Bangalore ...

  • Pyspark

    1 week ago


    Bengaluru, Karnataka, India Black & White Business Solutions Full time

    Job Information:IndustryIT Services***ProvinceKarnataka***CityBangalore North***Postal Code560001***CountryIndiaJob title:Pyspark DeveloperYears ofEXP:6+yearsLocation:Bangalore/Hyderabad/ChennaiNP:Immediate

  • Pyspark Developer

    1 week ago


    Bengaluru, Karnataka, India Corporate Resources Full time

    Job DescriptionDesigning and developing big data applications using the PySpark framework to meet the needs of the businessWriting and optimizing Spark SQL statements to extract and manipulate large datasetsDeveloping and deploying Spark algorithms to perform data processing and analytics tasks, such as machine learning and graph processingDebugging and...

  • Python Pyspark Lead

    1 week ago


    Bengaluru, Karnataka, India Virtusa Full time

    Python Pyspark Lead - CREQ187226 Description Design and develop on Hadoop applications,Hands on in developing Jobs in pySpark with Python/ SCALA (Preferred) or Java/ SCALAExperience on Core Java, Experience on Map Reduce programs, Hive programming, Hive queries performance conceptsExperience on source code management with Git repositoriesSecondary...

  • Pyspark Developer

    1 week ago


    Bengaluru, Karnataka, India Manvision Technologies Full time

    SN Required Information Details 1 Role PySpark Developer 2 Required Technical Skill Set PySpark, Python, HDFS, Hadoop, SQL 3 No of Requirements 02 4 Desired Experience Range 5+ years Location of Requirement India Desired Competencies (Technical/Behavioral Competency) Must-Have Sound...

  • Aws Pyspark

    1 week ago


    Bengaluru, Karnataka, India Cognizant Full time

    Mandatory skills AWS, Python and PySpark, Spark SQL, NoSQL Data BricksExperience on AWS and its web service offering S3, Redshift, EC2, EMR, Lambda, CloudWatch, RDS, Step functions, Spark streaming etc.Good knowledge of Configuring and working on Multi node clusters and distributed data processing framework Spark.Hands on experience with EMR Apache Spark...

  • Pyspark Developer

    1 week ago


    Bengaluru, Karnataka, India Corporate Resources Full time

    Job Description Designing and developing big data applications using the PySpark framework to meet the needs of the business Writing and optimizing Spark SQL statements to extract and manipulate large datasets Developing and deploying Spark algorithms to perform data processing and analytics tasks, such as machine learning and graph processing ...


  • Bengaluru, Karnataka, India Genpact Full time

    With a startup spirit and 115,000+ curious and courageous minds, we have the expertise to go deep with the world's biggest brands—and we have fun doing it. We dream in digital, dare in reality, and reinvent the ways companies work to make an impact far bigger than just our bottom line. We're harnessing the power of technology and humanity to create...


  • Bengaluru, Karnataka, India Genpact Full time

    With a startup spirit and 115,000+ curious and courageous minds, we have the expertise to go deep with the world's biggest brands—and we have fun doing it. We dream in digital, dare in reality, and reinvent the ways companies work to make an impact far bigger than just our bottom line. We're harnessing the power of technology and humanity to create...

  • Pyspark Lead

    1 week ago


    Bengaluru, Karnataka, India CIEL HR Services Full time

    We are hiring for our client-An International IT service providerRole- Pyspark LeadMandatory skill set- Python+Spark+Scala(experience in all 3 skill sets should be strong & mandatory) ,Data Engineering+ AWSExp. Level- 5-12 yrsLocation- Bangalore & HyderabadNotice Period-Immediate to 15daysJob DescriptionDesign and implement scalable and robust ELT processes...


  • Bengaluru, Karnataka, India Edstem Technologies Full time

    We are seeking a talented and experienced PySpark Data Engineer to join our dynamic team. The ideal candidate will have a strong background in data engineering, a passion for big data technologies, and the ability to work in a fast-paced, collaborative environment.Willing to work inLocation: Trivandrum, Bengaluru, ChennaiKey Responsibilities:Data Pipeline...


  • Bengaluru, Karnataka, India NAM Info Inc Full time

    AWS Data Engineer with PySpark Domain: Clinical / pharma/ healthcare Location: Bangalore or Chennai / Kolkata / Hyderabad Preferred Skills: AWS and Python and or PySpark AWS Redshift, Aurora, AWS Glue , AWS Lambda, etc. Extensive experience with Data gathering and ingestion (from multiple sources), and manipulation, orchestration and optimization on...


  • Bengaluru, Karnataka, India NAM Info Inc Full time

    AWS Data Engineer with PySparkDomain: Clinical / pharma/ healthcareLocation: Bangalore or Chennai / Kolkata / Hyderabad Preferred Skills:AWS and Python and or PySparkAWS Redshift, Aurora, AWS Glue, AWS Lambda, etc.Extensive experience with Data gathering and ingestion (from multiple sources), and manipulation, orchestration and optimization on AWS CloudSpark...


  • Bengaluru, Karnataka, India krazy mantra hr solutions Full time

    Apply for Hiring For Data Bricks With Python/Pyspark, Career Progress Consultants in Bengaluru/ Bangalore for Year of Experience on


  • Bengaluru, Karnataka, India LTIMindtree Full time

    Job Description:Primary Skill Set:Lead Py Spark Developer Seconday Skill Set: SAS tools Lead a team of data engineers in the design and implementation of big data solutions using Py Spark.Collaborate with cross-functional teams to understand business needs and develop data-driven solutions.Design and implement scalable and robust data pipelines using Py...


  • Bengaluru, Karnataka, India Smart Consulting - Creating Future Leaders Full time

    Big 4 MNC Hiring for "Azure Databricks+Pyspark+Kubernetes" Location - Bangalore CTC - Upto 24 LPA Experience - 5+ Yrs Mandatory Skill - Azure, Databricks, Pyspark Good to Have - Kubernetes