Big Data/Pyspark Developer

2 weeks ago

Bengaluru, Karnataka, India Contactx Resource Management Pvt. Ltd. Full time ₹ 1,04,000 - ₹ 1,30,878 per year
  • Senior Big Data Engineer / PySpark Developer with deep expertise in distributed computing, PySpark, and Spark performance tuning for both batch and streaming data processing.
  • Hands-on experience with Hive, open table formats such as Iceberg, and workflow orchestration tools like Airflow or Oozie.
  • Strong coding skills adhering to OOP principles, design patterns, and unit testing, along with proficiency in Git/GitHub, are essential.
  • Experience in designing scalable, reusable, and high-performance solutions, preparing High-Level and Low-Level Designs (HLD/LLD), and working closely with stakeholders to convert requirements into actionable user stories.
  • Experience in CI/CD automation, security scanning, and problem-solving to optimize system performance and scalability is highly desirable.

  • Big Data Developer

    2 weeks ago

    Bengaluru, Karnataka, India Tata Consultancy Services Full time

    Position - Big Data DeveloperExperience: 4 to 10 YearsNotice Period- 0-60 DaysLocation-BengaluruRequired Skill Set_ Hadoop, PySpark, Spark SQL, HIVEJob Description- Hands-on experience of PySpark, Spark, Hive, Hadoop Big Data Eco System Tools.- Strong SQL experience.- Should be able to develop, tweak queries and work on performance enhancement.- Solid...

  • Big Data Developer

    2 weeks ago

    Bengaluru, Karnataka, India Tata Consultancy Services Full time

    Position - Big Data DeveloperExperience: 4 to 10 YearsNotice Period- 0-60 DaysLocation-BengaluruRequired Skill Set_ Hadoop, PySpark, Spark SQL, HIVEJob DescriptionHands-on experience of PySpark, Spark, Hive, Hadoop Big Data Eco System Tools.Strong SQL experience.Should be able to develop, tweak queries and work on performance enhancement.Solid understanding...

  • Big Data Developer

    1 week ago

    Bengaluru, Karnataka, India Tata Consultancy Services Full time

    Position - Big Data Developer Experience: 4 to 10 Years Notice Period- 0-60 Days Location-Bengaluru Required Skill Set_ Hadoop, PySpark, Spark SQL, HIVE Job Description Hands-on experience of PySpark, Spark, Hive, Hadoop Big Data Eco System Tools. Strong SQL experience. Should be able to develop, tweak queries and work on performance enhancement....

  • Big Data Specialist

    1 week ago

    Bengaluru, Karnataka, India beBeePySpark Full time ₹ 1,04,000 - ₹ 1,30,878

    We are currently seeking a skilled professional to fill the role of PySpark Data Engineer.Job DescriptionThe successful candidate will be responsible for designing, implementing and maintaining PySpark-based applications to handle complex data processing tasks. This includes ensuring data quality, integrating with diverse data sources, and developing robust...

  • Pyspark Developer

    2 weeks ago

    Bengaluru, Karnataka, India EduRun Group Full time US$ 90,000 - US$ 1,20,000 per year

    5+ years of hands-on experience in developing and optimizing large-scale data pipelines using PySpark.Strong expertise in ETL workflows, data cleansing, and transformations to enable analytics and machine learning use cases.Proficient in big data technologies such as Hadoop, Hive, HDFS, and Spark SQL .Ability to collaborate with cross-functional teams to...

  • Advanced Big Data Solutions Developer

    2 weeks ago

    Bengaluru, Karnataka, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Big Data Solutions Architect We are seeking a highly skilled and experienced professional to develop and optimize big data solutions using PySpark, Spark SQL, Hadoop, and Hive. The ideal candidate will have strong SQL skills and hands-on experience with data warehousing and data lakes.Main Responsibilities:Design and implement scalable big data...

  • Pyspark Developer

    2 weeks ago

    Bengaluru, Karnataka, India Sigma Allied Services Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Position - Pyspark DeveloperLocation - BangaloreExperience - 6 to 9 yrsRequired Skills -Project Role Description : Lead the effort to design, build and configure applications, acting as the primary point of contact.Must have skills : PySparkMinimum 5 year(s) of experience is requiredEducational Qualification : 15 years full time educationSummary:As an...

  • Data Engineer- PySpark

    2 weeks ago

    Bengaluru, Karnataka, India Valuelabs Full time US$ 90,000 - US$ 1,20,000 per year

    Job Title- PySpark Data EngineerWe're growing our Data Engineering team at ValueLabs and looking for a talented individual to build scalable data pipelines on Cloudera Data PlatformExperience- 5years to 9years.Pyspark Job Description:Data Pipeline Development: Design, develop, and maintain highly scalable and optimized ETL pipelines using PySpark on the...

  • Big Data Developer

    3 weeks ago

    Bengaluru, Karnataka, India Coders Brain Full time

    Job DescriptionRoles and Responsibilities:- 5+ years of experience working with cloud or on-prem Big Data/MPP analytics platform (i.e. AWS Glue/EMR, Google BigQuery, Azure Data Warehouse, Databricks, Snowflake, Hortonworks/Cloudera Clusters)- 3+ years of exp in writing Advanced SQLs- Pyspark is mandatory.- 3+ years of exp with building dimensional data...

  • Big Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Tata Consultancy Services Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Greetings from TCS TCS is hiring for Big Data (PySpark & Scala)Location: - Pune/Mumbai/Chennai/BangaloreDesired Experience Range: 4 - 6 YearsMust-HavePySpark HiveGood-to-Have Spark HBase DQ tool Agile Scrum experience Exposure in data ingestion from disparate sources onto Big Data platformThanksAnshika