Pyspark Developer

2 weeks ago


Hyderabad Chennai Pune, India Innova solutinos Full time

Job Description

- Develop and optimize scalable data pipelines using Databricks and Apache Spark.
- Design and implement solutions for data integration, data processing, and data storage on Databricks.
- Collaborate with data scientists and analysts to build end-to-end analytics solutions.
- Build and maintain automated workflows, ensuring reliability and efficiency.
- Design and manage ETL processes in Databricks.
- Write optimized Spark SQL and PySpark code for data transformations.
- Work with large datasets and ensure performance, scalability, and reliability of data pipelines.
- Monitor and troubleshoot existing data pipelines and workflows.
- Integrate Databricks with other tools and systems like AWS, Azure, or Google Cloud.

Role:Data Engineer

Industry Type:IT Services & Consulting

Department:Engineering - Software & QA

Employment Type:Full Time, Permanent

Role Category:Software Development

Education

UG:Any Graduate


  • PySpark Developer

    6 days ago


    Hyderabad, India Anicalls (Pty) Ltd Full time

    • PySpark Developer / PySpark Data Engineer • Should have at least three years of strong experience in PySpark • Strong SQL Expertise • Strong communication and client-facing skills

  • Pyspark Developer

    1 week ago


    Pune, Maharashtra, India Tech Mahindra Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Pyspark DeveloperRequirements:Mandatory: Primary skill: Pyspark, Data Engineering, Azure Data BricksGood Experience of Hadoop, Hive, and Cloudera/ Azure/GCP 3+ years of experience in the design and implementation of Big Data systems using PySpark, database migration, transformation and integration solutions for any Data warehousing project.Must have...

  • Pyspark Developer

    1 week ago


    Bengaluru, Chennai, Pune, India VHR Solutions Full time ₹ 5,00,000 - ₹ 12,00,000 per year

    Job Description:We are looking for a skilled PySpark Developer to join our data engineering team. The ideal candidate will have strong experience in building scalable data pipelines using Apache Spark (PySpark), integrating with big data platforms, and working with large datasets in distributed environments. You will work closely with data engineers,...

  • Pyspark Developer

    1 week ago


    Bengaluru, Chennai, Pune, India Tekskills Full time ₹ 12,50,000 - ₹ 25,00,000 per year

    JOB SUMMARY:Experience 6+years (relevant minimum 5+ years)Detailed job description - Skill Set:Candidate should have good hands on experience in Pyspark preferrable more than 7 years.Should have very good understanding of Agile development methodologies and excellent team handling experience.Mandatory Skills - Pyspark, Python, Agile

  • PySpark Developer

    3 weeks ago


    Hyderabad, Bengaluru, Chennai, India Coders Brain Technology Private Limited Full time

    Job Description ROLE RESPONSIBILITIES Data Engineering and Processing: Develop and manage data pipelines using PySpark on Databricks. Implement ETL/ELT processes to process structured and unstructured data at scale. Optimize data pipelines for performance, scalability, and cost-efficiency in Databricks. Databricks Platform Expertise: Experience in...

  • Pyspark Developer

    3 weeks ago


    Chennai, Tamil Nadu, India MP DOMINIC AND CO Full time

    Job Summary - Design develop and implement scalable data pipelines and streaming use cases using PySpark and Spark on a distributed computing platform - Possess strong programming skills in Spark streaming - Have familiarity with cloud platforms like GCP - Gain experience in big data technologies such as Hadoop Hive and HDFS - Perform ETL operations...

  • Pyspark Developer

    1 week ago


    Bengaluru, Chennai, Pune, India Quess Corp Limited Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    ROLE SUMMARYWe are seeking a highly skilled PySpark Developer with hands-on experience in Databricks IT Systems Development unit in an offshore capacity. This role focuses on designing, building, and optimizing large-scale data pipelines and processing solutions on the Databricks Unified Analytics Platform. The ideal candidate will have expertise in big data...

  • Pyspark Developer

    3 weeks ago


    Hyderabad, India KloudPortal Technology Solutions PVT. LTD Full time

    Job Description Job SummaryWe are hiring a Senior PySpark Developer with 4-7 years of experience in building and optimising data pipelines using PySpark on Databricks, within AWS cloud environments. This role involves modernising legacy systems, integrating with Kafka, and collaborating across cross-functional teams. Key Responsibilities Develop and optimise...

  • PySpark Developer

    3 weeks ago


    Hyderabad, India Algoleap Technologies Full time

    SUMMARY Job Summary We are looking for a Senior PySpark Developer with 3 to 6 years of experience in building and optimizing data pipelines using PySpark on Databricks, within AWS cloud environments. This role focuses on the modernization of legacy domains, involving integration with systems like Kafka and collaboration across cross-functional teams. Key...

  • PySpark Developer

    2 weeks ago


    Hyderabad, Telangana, India algoleap Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Job SummaryWe are looking for a Senior PySpark Developer with 3 to 6 years of experience in building and optimizing data pipelines using PySpark on Databricks, within AWS cloud environments. This role focuses on the modernization of legacy domains, involving integration with systems like Kafka and collaboration across cross-functional teams.Key...