Big Data Engineer

1 day ago


Bengaluru Karnataka India, Karnataka Tata Consultancy Services Full time

Job Title :- Data Engineer - Pyspark

Experience: 5 to 8 Years

Location: Pune/Hyderabad


Job Description


Required Skills:

5+ years of experience in Big data and pyspark

Must-Have

Good work experience on Big Data Platforms like Hadoop, Spark, Scala, Hive, Impala, SQL

Good-to-Have

Good Spark, Pyspark,Big Data experience

Spark UI/Optimization/debugging techniques

Good python scripting skills

Intermediate SQL exposure – Subquery, Joins, CTE’s

Database technologies

AWS EMR, S3, IAM, Lambda, SNS, SQS


Good work experience on Big Data Platforms like Hadoop, Spark, Scala, Hive, Impala, SQL

Experience working on Data Engineering projects

Good Understanding of SQL

Good understanding of Unix and HDFS commands

Communication

Experience working on Data Analytics and Pyspark



Thanks & Regards ,


Manasi Prava Natha



  • Bengaluru, Karnataka, India, Karnataka Talentmatics Full time

    We are seeking an experienced GCP Big Data Engineer with 8–10 years of expertise in designing, developing, and optimizing large-scale data processing solutions. The ideal candidate will bring strong leadership capabilities, technical depth, and a proven track record of delivering end-to-end big data solutions in cloud environments.Key...

  • Big Data Engineer

    2 days ago


    Bengaluru, Karnataka, India Etaclam Techno Services Full time ₹ 12,00,000 - ₹ 14,40,000 per year

    Job Title: Big Data EngineerLocation: BengaluruExperience Required: 5 to 8 yearsJob Description:We are looking for a skilled Big Data Engineer with strong hands-on experience in PySpark and SQL. This is a hybrid role, requiring the candidate to work both remotely and from the office as needed. The ideal candidate should be comfortable working on large-scale...

  • Big Data Engineer

    6 days ago


    Bengaluru, Karnataka, India Deqode Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    Profile: Big Data Engineer (System Design)Experience:5+ yearsLocation:BangaloreWork Mode:HybridAbout The RoleWe're looking for an experiencedBig Data Engineerwith system design expertise to architect and build scalable data pipelines and optimize big data solutions.Key ResponsibilitiesDesign, develop, and maintain data pipelines and ETL processes using...


  • Bengaluru, Karnataka, India, Karnataka ITC Infotech Full time

    SRE & Devops (Big Data)Location : BangaloreMode: HybridRequired Skills:● Demonstrated ability in designing, building, refactoring and releasing software written in Java, Python.● Strong experience with Big Data technologies including Hadoop, Spark, Flink, Hive, HDFS.● Ability to handle data integration, bug fi xing, performance optimization, and...


  • Bengaluru, Karnataka, India, Karnataka Acme Services Full time

    Job Title: GCP Big Data EngineerExperience: 5–9 YearsCompensation: ₹21–25 LPALocation: PAN IndiaWork Mode: Work From OfficeJob Description: We are looking for an experienced GCP Big Data Engineer to design, develop, and maintain scalable data pipelines and analytics solutions on Google Cloud Platform.Key Responsibilities:Build and optimize data...

  • Big Data Engineer

    1 week ago


    Bengaluru, Karnataka, India Suzva Software Technologies Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Hiring: Big Data Engineer (PySpark)Client: [Details will be shared upon shortlisting]Location: Bangalore (Onsite)Experience: 6-8 years (Relevant)Joining: Immediate to 15 days Key Skills: Strong hands-on experience in PySpark Expertise in Big Data technologies Solid understanding of SQL, Data Pipelines, and ETLInterested candidates can share their resume...

  • Big Data Engineer

    1 week ago


    Bengaluru, Karnataka, India Innova ESI Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Role: Big Data EngineerExperience: 7+ YearsLocation: BangaloreNotice: Immediate Joiners OnlyJob Description:Azure Databricks, Azure Data Factory, Azure Function apps, Apache Spark, Scala, Java, Apache Kafka, event stream and Big DataOptional Skills: Airflow, PythonRoles & ResponsibilitiesOverall, 12 years of experience in IT industry, including 5 years in...


  • Bengaluru, Karnataka, India Peoplelogic Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Role: Big Data Engineers/Senior Engineers About the Role:We are seeking highly skilled Big Data Engineers/Senior Engineers with a strong background inbuilding and supporting big data solutions. The ideal candidate will have expertise in big datatechnologies, data pipeline development, and performance optimization within a collaborativeand agile...


  • Bengaluru, Karnataka, India Innova ESI Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Role: Big Data Engineer – AzureExperience: 10+ YearsLocation: BangaloreImmediate Joiners OnlyBig Data :Mandatory Skills:Azure Databricks, Azure Data Factory, Azure Function apps, Apache Spark, Scala, Java, Apache Kafka, event stream and Big DataOptional Skills: Airflow, PythonRoles & ResponsibilitiesOverall, experience in IT industry, including 5 years in...


  • Bengaluru, Karnataka, India CODERS BRAIN TECHNOLOGY PRIVATE LIMITED Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    About the Role : We are looking for an experienced AWS Big Data Lead Engineer to design, build, and manage scalable data solutions on AWS. The ideal candidate will have extensive hands-on experience in Big Data technologies, cloud-native architecture, and leadership to guide engineering teams in delivering enterprise-grade data pipelines and analytics...