Big Data Engineer(Iceberg)

3 days ago


Bengaluru, Karnataka, India Brillio Full time ₹ 20,00,000 - ₹ 25,00,000 per year

Looking for - Hive, SQL, Python, Spark, Hadoop and kafka with Iceberg experience

  • Bachelor's or Master's degree in Computer Science, Information Systems, or a related field.
  • Design, develop, and maintain data pipelines and ETL processes using Python, Hive, Spark, and other relevant technologies.
  • Good Hands on Exp with java
  • Minimum of 6+ years of experience as a Data Engineer, with proven expertise in Python, Hive, and Spark.
  • Advance SQL experience and working experience with Big data Hadoop .
  • Strong understanding of data engineering concepts, including data modelling, data integration, and data warehousing.
  • Hands-on experience with tools such as Apache Airflow.
  • Experience with Docker and containerization technologies is a plus.
  • Strong SQL skills and experience with relational databases, such as PostgreSQL, MySQL, or similar.
  • Familiarity with Apache Spark.
  • Knowledge of data processing frameworks such as Apache Beam, Apache Flink, or similar.
  • Strong problem-solving and troubleshooting skills, with attention to detail.
  • Excellent communication and interpersonal skills, with the ability to work collaboratively in a team environment


  • Bengaluru, Karnataka, India Astar Data Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Kindly find the Job Description Below.Job Title:Technical Lead- Data EngineerLocation: BangaloreYears of Experience: 8+ years of experienceSigmoidworks with a variety of clients from start-ups to fortune 500 companies. We are looking for a detailed oriented self-starter to assist our engineering and analytics teams in various roles as a Software...

  • Data Engineer

    1 week ago


    Bengaluru, Karnataka, India Mastek Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Data Engineer – NiFi / Cloudera / Iceberg / Snowflake / DatabricksOverviewWe are seeking a Data Engineer with strong Apache NiFi expertise to design and implement pipelines that move and transform data from Cloudera (HDFS/Hive/Impala) into Apache Iceberg tables, with downstream integration into Snowflake and Databricks. The ideal candidate will have...

  • Big Data Engineer

    5 days ago


    Bengaluru, Karnataka, India Etaclam Techno Services Full time ₹ 12,00,000 - ₹ 14,40,000 per year

    Job Title: Big Data EngineerLocation: BengaluruExperience Required: 5 to 8 yearsJob Description:We are looking for a skilled Big Data Engineer with strong hands-on experience in PySpark and SQL. This is a hybrid role, requiring the candidate to work both remotely and from the office as needed. The ideal candidate should be comfortable working on large-scale...

  • Big Data Engineer

    1 week ago


    Bengaluru, Karnataka, India Deqode Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    Profile: Big Data Engineer (System Design)Experience:5+ yearsLocation:BangaloreWork Mode:HybridAbout The RoleWe're looking for an experiencedBig Data Engineerwith system design expertise to architect and build scalable data pipelines and optimize big data solutions.Key ResponsibilitiesDesign, develop, and maintain data pipelines and ETL processes using...

  • Data Engineer

    6 days ago


    Bengaluru, Karnataka, India, Karnataka Mastek Full time

    Data Engineer – NiFi / Cloudera / Iceberg / Snowflake / DatabricksOverviewWe are seeking a Data Engineer with strong Apache NiFi expertise to design and implement pipelines that move and transform data from Cloudera (HDFS/Hive/Impala) into Apache Iceberg tables, with downstream integration into Snowflake and Databricks. The ideal candidate will have...

  • Data Engineer

    1 day ago


    Bengaluru, Karnataka, India Amiseq Full time ₹ 8,00,000 - ₹ 18,00,000 per year

    Title: Data Engineer (Neo4j, JanusGraph)Location: BangaloreLook for Exp. between 3-5 years -Must have graph databases (e.g., Neo4j, JanusGraph) and graph query languages - its must.Look for batch and real time streaming exp.Look with Kafka OR FlinkExp. Data structures/algorithmsHadoop ecosystems such as Hive, Iceberg, Spark SQL1 coding language is must -...

  • Big Data Engineer

    2 weeks ago


    Bengaluru, Karnataka, India Suzva Software Technologies Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Hiring: Big Data Engineer (PySpark)Client: [Details will be shared upon shortlisting]Location: Bangalore (Onsite)Experience: 6-8 years (Relevant)Joining: Immediate to 15 days Key Skills: Strong hands-on experience in PySpark Expertise in Big Data technologies Solid understanding of SQL, Data Pipelines, and ETLInterested candidates can share their resume...

  • Big Data Engineer

    2 weeks ago


    Bengaluru, Karnataka, India Innova ESI Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Role: Big Data EngineerExperience: 7+ YearsLocation: BangaloreNotice: Immediate Joiners OnlyJob Description:Azure Databricks, Azure Data Factory, Azure Function apps, Apache Spark, Scala, Java, Apache Kafka, event stream and Big DataOptional Skills: Airflow, PythonRoles & ResponsibilitiesOverall, 12 years of experience in IT industry, including 5 years in...


  • Bengaluru, Karnataka, India, Karnataka Sigmoid Full time

    Kindly find the Job Description Below.Job Title:Technical Lead-Azure Data EngineerLocation: BangaloreYears of Experience: 10+ years of experienceSigmoid works with a variety of clients from start-ups to fortune 500 companies. We are looking for a detailed oriented self-starter to assist our engineering and analytics teams in various roles as a Software...

  • Big Data Engineer

    4 days ago


    Bengaluru, Karnataka, India, Karnataka Tata Consultancy Services Full time

    Job Title :- Data Engineer - PysparkExperience: 5 to 8 YearsLocation: Pune/HyderabadJob DescriptionRequired Skills:5+ years of experience in Big data and pysparkMust-HaveGood work experience on Big Data Platforms like Hadoop, Spark, Scala, Hive, Impala, SQLGood-to-HaveGood Spark, Pyspark,Big Data experienceSpark UI/Optimization/debugging techniquesGood...