Pyspark Developer

4 days ago


Bengaluru, Karnataka, India Synechron Technologies Pvt. Ltd. Full time ₹ 9,00,000 - ₹ 12,00,000 per year

Day-to-Day Activities:Design, develop, and maintain ETL pipelines using PySpark on CDP.Implement and manage data ingestion processes from various sources. Process, cleanse, and transform large datasets using PySpark. Conduct performance tuning and optimization of ETL processes.

Implement data quality checks and validation routines. Automate data workflows using orchestration tools. Monitor pipeline performance and troubleshoot issues.

Collaborate with team members to understand data requirements. Maintain documentation of data engineering processes and configurations. Data Pipeline Development: Design, develop, and maintain highly scalable and optimized ETL pipelines using PySpark on the Cloudera Data Platform, ensuring data integrity and accuracy.

Data Ingestion: Implement and manage data ingestion processes from a variety of sources (e.g., relational databases, APIs, file systems) to the data lake or data warehouse on CDP.


  • Pyspark Developer

    1 week ago


    Bengaluru, Karnataka, India Sigma Allied Services Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Position - Pyspark DeveloperLocation - BangaloreExperience - 6 to 9 yrsRequired Skills -Project Role Description : Lead the effort to design, build and configure applications, acting as the primary point of contact.Must have skills : PySparkMinimum 5 year(s) of experience is requiredEducational Qualification : 15 years full time educationSummary:As an...

  • Pyspark Developer

    1 week ago


    Bengaluru, Karnataka, India Unified Excellence Full time US$ 90,000 - US$ 1,20,000 per year

    Responsibilities:* Collaborate with cross-functional teams on project delivery.* Ensure code quality through testing and documentation.* Design, develop, and maintain PySpark applications using Python and Spark.

  • Pyspark Developer

    1 week ago


    Bengaluru, Karnataka, India Nuvento Systems Full time ₹ 6,00,000 - ₹ 12,00,000 per year

    We are looking for immediate joiner | Work from HomeKey skills:Pyspark, Apache Spark, AWS, Databricks, Scala, Java

  • Pyspark Developer

    1 week ago


    Bengaluru, Karnataka, India EduRun Group Full time US$ 90,000 - US$ 1,20,000 per year

    5+ years of hands-on experience in developing and optimizing large-scale data pipelines using PySpark.Strong expertise in ETL workflows, data cleansing, and transformations to enable analytics and machine learning use cases.Proficient in big data technologies such as Hadoop, Hive, HDFS, and Spark SQL .Ability to collaborate with cross-functional teams to...

  • Pyspark Developer

    1 week ago


    Bengaluru, Karnataka, India Naukri E Hire Campaign Full time US$ 90,000 - US$ 1,20,000 per year

    Company Name: NatWest GroupExperience: 7-11 YearsLocation: Bangalore (Hybrid Model)Interview Mode: VirtualInterview date: 23rd August (Saturday)Interview Rounds: 2 RoundsNotice Period: AnyJob description:Experience in PySpark AWS, and SQLStrong experience in Airflow, CI/CD, and DevOpsExperience of DevOps and Agile methodology and associated toolsets...

  • Pyspark

    7 days ago


    Bengaluru, Karnataka, India Virtusa Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    highly skilled Data Engineer with 6+ years of experience in the IT industry, specializing in Data Engineering and Data Migration. The ideal candidate will have strong expertise in Oracle to PostgreSQL migration and be well-versed in AWS DMS (Database Migration Service). The role requires proficiency in Python and PySpark to work on various data migration...


  • Bengaluru, Karnataka, India Contactx Resource Management Pvt. Ltd. Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    Senior Big Data Engineer / PySpark Developer with deep expertise in distributed computing, PySpark, and Spark performance tuning for both batch and streaming data processing.Hands-on experience with Hive, open table formats such as Iceberg, and workflow orchestration tools like Airflow or Oozie.Strong coding skills adhering to OOP principles, design...


  • Bengaluru, Karnataka, India Innova ESI Full time ₹ 15,000 - ₹ 28,00,000 per year

    Snowflake+Pyspark developer ||4 Years||Pan IndiaUnderstanding of data modeling concepts, data warehousing tools and databases • Experience in Snowflake, SQL, Cloud (AWS) , Unix Technologies experience • Must have hands on experience on SQL , Snowflake • Experience in AWS S3 and other common aws services. • Should have experience working with multiple...


  • Bengaluru, Karnataka, India Valuelabs Full time US$ 90,000 - US$ 1,20,000 per year

    Job Title- PySpark Data EngineerWe're growing our Data Engineering team at ValueLabs and looking for a talented individual to build scalable data pipelines on Cloudera Data PlatformExperience- 5years to 9years.Pyspark Job Description:Data Pipeline Development: Design, develop, and maintain highly scalable and optimized ETL pipelines using PySpark on the...


  • Bengaluru, Karnataka, India Phygital Insights Full time

    Job Description- The developer must have sound knowledge in Apache Spark and Python programming.- Deep experience in developing data processing tasks using pySpark such as reading data from external sources, merge data, perform data enrichment and load in to target data destinations.- Experience in deployment and operationalizing the code is added advantage...