Pyspark Developer

1 day ago

Bengaluru Chennai Pune, India VHR Solutions Full time ₹ 9,00,000 - ₹ 12,00,000 per year

Job Description:

We are looking for a skilled PySpark Developer to join our data engineering team. The ideal candidate will have strong experience in building scalable data pipelines using Apache Spark (PySpark), integrating with big data platforms, and working with large datasets in distributed environments. You will work closely with data engineers, analysts, and business stakeholders to build and optimize data solutions.

Roles and Responsibilities:

  • Design, develop, and maintain efficient and scalable data pipelines using PySpark.
  • Work with big data technologies like Hadoop, Hive, and Spark to process and transform large datasets.
  • Optimize performance of data processing tasks and troubleshoot issues in distributed systems.
  • Develop and deploy data workflows using orchestration tools like Apache Airflow or Oozie.
  • Collaborate with data architects and analysts to understand data requirements and deliver high-quality data solutions.
  • Write complex SQL queries and interact with SQL and NoSQL databases.
  • Ensure data quality, integrity, and compliance with data governance policies.

  • Pyspark Developer

    1 day ago

    Bengaluru, Chennai, Pune, India Tekskills Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    JOB SUMMARY:Experience 6+years (relevant minimum 5+ years)Detailed job description - Skill Set:Candidate should have good hands on experience in Pyspark preferrable more than 7 years.Should have very good understanding of Agile development methodologies and excellent team handling experience.Mandatory Skills - Pyspark, Python, Agile

  • Pyspark Developer

    1 day ago

    Bengaluru, Chennai, Pune, India Quess Corp Limited Full time US$ 1,04,000 - US$ 1,30,878 per year

    ROLE SUMMARYWe are seeking a highly skilled PySpark Developer with hands-on experience in Databricks IT Systems Development unit in an offshore capacity. This role focuses on designing, building, and optimizing large-scale data pipelines and processing solutions on the Databricks Unified Analytics Platform. The ideal candidate will have expertise in big data...

  • PySpark Developer

    4 days ago

    Bengaluru / Bangalore, Chennai, Pune, India beBeeData Full time US$ 1,04,000 - US$ 1,30,878

    Job SummaryWe are seeking a highly skilled PySpark expert with hands-on experience in Databricks to join our data engineering team. This role focuses on designing, building, and optimizing large-scale data pipelines and processing solutions on the Databricks Unified Analytics Platform.Key Responsibilities:Develop and manage data pipelines using PySpark on...

  • Pyspark Developer

    1 day ago

    Pune, Maharashtra, India Tech Mahindra Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Pyspark DeveloperRequirements:Mandatory: Primary skill: Pyspark, Data Engineering, Azure Data BricksGood Experience of Hadoop, Hive, and Cloudera/ Azure/GCP 3+ years of experience in the design and implementation of Big Data systems using PySpark, database migration, transformation and integration solutions for any Data warehousing project.Must have...

  • Pyspark developer

    5 days ago

    Bengaluru, Chennai, Pune, India MFX Infotech Private Limited Full time

    Job DescriptionROLE SUMMARYWe are seeking a highly skilledPySpark Developerwith hands-on experience inDatabricksto join Sompo's IT Systems Development unit in an offshore capacity. This role focuses on designing, building, and optimizing large-scale data pipelines and processing solutions on theDatabricks Unified Analytics Platform. The ideal candidate will...

  • PySpark Developers

    1 day ago

    Chennai, Tamil Nadu, India LTIMindtree Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Skill : PySpark DeveloperJob Locations : Chennai, PuneNotice Period : AnyExperience : 3-8 years Job Description :PySpark DeveloperMandatory Skills : (Apache Spark, Big Data Hadoop Ecosystem, SparkSQL, Python)A good professional experience in Bigdata PySpark HIVE Hadoop PLSQLGood knowledge of AWS and SnowflakeGood understanding of CICD and system design...

  • PySpark Developer

    7 days ago

    Hyderabad, Bengaluru, Chennai, India Coders Brain Technology Private Limited Full time

    Job DescriptionROLE RESPONSIBILITIESData Engineering and Processing:Develop and manage data pipelines using PySpark on Databricks.Implement ETL/ELT processes to process structured and unstructured data at scale.Optimize data pipelines for performance, scalability, and cost-efficiency in Databricks.Databricks Platform Expertise:Experience in Perform Design,...

  • Pyspark Developer

    1 day ago

    Bengaluru, Karnataka, India Sigma Allied Services Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Position - Pyspark DeveloperLocation - BangaloreExperience - 6 to 9 yrsRequired Skills -Project Role Description : Lead the effort to design, build and configure applications, acting as the primary point of contact.Must have skills : PySparkMinimum 5 year(s) of experience is requiredEducational Qualification : 15 years full time educationSummary:As an...

  • Pyspark Developer

    1 day ago

    Bengaluru, Karnataka, India Unified Excellence Full time US$ 90,000 - US$ 1,20,000 per year

    Responsibilities:* Collaborate with cross-functional teams on project delivery.* Ensure code quality through testing and documentation.* Design, develop, and maintain PySpark applications using Python and Spark.

  • Python pyspark Developer

    1 day ago

    Bengaluru, Pune, India Infosys Full time US$ 90,000 - US$ 1,20,000 per year

    Job descriptionHiring for Python Pyspark developer with experience range 3 to 8 yearsMandatory Skills: Python, Pyspark and sparkEducation: BE/B.Tech/MCA/M.Tech/MSc./MSResponsibilities A day in the life of an Infoscion As part of the Infosys consulting team, your primary role would be to actively aid the consulting team in different phases of the project...