Big Data Developer

24 hours ago


Bengaluru, Karnataka, India ITC Infotech Full time ₹ 5,00,000 - ₹ 15,00,000 per year

Required Skills:

Demonstrated ability in designing, building, refactoring and releasing software written in Java, Python.

Strong experience with Big Data technologies including Hadoop, Spark, Flink, Hive, HDFS.

Ability to handle data integration, bug fixing, performance optimization, and feature enhancements for distributed data pipelines.

Having experience with building batch pipelines to support billion-plus-scale embedding generation for text, image and video is a big plus.

Experience with data quality and governance.

Having experience with vector similarity search and vector databases is a big plus.

Debugging and triaging skills.

Cloud technologies like Kubernetes, Docker and Linux fundamentals.

Familiar with DevOps practices and continuous testing.

DevOps pipeline and automations: app deployment/configuration & performance monitoring.

Test automations, Jenkins CI/CD.

Excellent communication, presentation, and leadership skills to be able to work and collaborate with partners, customers and engineering teams.

Well organized and able to manage multiple projects in a fast paced and demanding environment.

Good oral/reading/writing English ability


  • Big Data Developer

    2 days ago


    Bengaluru, Karnataka, India LION AND ELEPHANTS Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Job Description:We are looking for skilled Big Data Engineers using Java Spark with 5-10 years of experience in Big Data / legacy platforms, who can join immediately. We have openings in Bengaluru, Chennai, Hyderabad, Pune, Delhi.Desired candidates should have design, development and optimization of real-time & batch data pipelines experience in a Big Data...

  • Big Basket

    3 weeks ago


    Bengaluru, Karnataka, India big basket Full time

    What would you be doing/ Expected from this role ?- Collaborate with cross-functional teams including data scientists, engineers, and product managers to deliver AI-driven solutions.- Drive the architecture of machine learning pipelines from data collection and preprocessing to model training, evaluation, and deployment.- Implement scalable machine learning...

  • Big Basket

    3 weeks ago


    Bengaluru, Karnataka, India big basket Full time

    As a Software Engineer we are looking for developers who share our passion for building world class software. If you are excited about the prospect of changing the way India shops for groceries and being a pioneer then this a great home for you. Not to mention the thrill of building products that millions use daily and using cutting edge technology to make...

  • Big Data Developer

    3 weeks ago


    Bengaluru, Karnataka, India Kezan Consulting Full time

    Position : Big Data Engineer (Immediate Joiner)Experience : 5+ YearsLocation : (Gurugram / Bangalore)Joining : Immediate JoinerJob Summary : We're seeking an experienced Senior Big Data Engineer with 5+ years of experience in designing, developing, and implementing large-scale data systems using Redshift, AWS, Spark, and Scala.The ideal candidate will...

  • Big Data Developer

    3 weeks ago


    Bengaluru, Karnataka, India Tata Consultancy Services Full time

    Position - Big Data DeveloperExperience: 4 to 10 YearsNotice Period- 0-60 DaysLocation-BengaluruRequired Skill Set_ Hadoop, PySpark, Spark SQL, HIVEJob Description- Hands-on experience of PySpark, Spark, Hive, Hadoop Big Data Eco System Tools.- Strong SQL experience.- Should be able to develop, tweak queries and work on performance enhancement.- Solid...

  • Big Data Developer

    1 day ago


    Bengaluru, Karnataka, India Grid Dynamics Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    7 to 15 Years of experience in Big Data Developer (Mandatory Splunk to ClickHouse and Grafana)Essential FunctionsKey Responsibilities7 to 15 Years of experience in Big Data DeveloperDesign and develop scalable data pipelines to migrate user knowledge objects from Splunk to ClickHouse and Grafana.Implement data ingestion, transformation, and validation...

  • Big Data Developer

    3 weeks ago


    Bengaluru, Karnataka, India Tata Consultancy Services Full time

    Position - Big Data Developer Experience: 4 to 10 Years Notice Period- 0-60 Days Location-Bengaluru Required Skill Set_ Hadoop, PySpark, Spark SQL, HIVE Job Description Hands-on experience of PySpark, Spark, Hive, Hadoop Big Data Eco System Tools. Strong SQL experience. Should be able to develop, tweak queries and work on performance enhancement....

  • Big Data Developer

    3 weeks ago


    Bengaluru, Karnataka, India Tata Consultancy Services Full time

    Position - Big Data DeveloperExperience: 4 to 10 YearsNotice Period- 0-60 DaysLocation-BengaluruRequired Skill Set_ Hadoop, PySpark, Spark SQL, HIVEJob DescriptionHands-on experience of PySpark, Spark, Hive, Hadoop Big Data Eco System Tools.Strong SQL experience.Should be able to develop, tweak queries and work on performance enhancement.Solid understanding...

  • Big Data Developer

    2 days ago


    Bengaluru, Karnataka, India SP Software Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Preferred candidate profile - Currently serving Notice Period who can join with in days only 5+ Years of Experience is Mandate in AWS and BigdataRole & responsibilitiesExperience with Big Data technologies will be a plus (Hadoop, Spark, Kafka, HBase, etc)• Write SQL queries to validate the dashboard output• Working experience with database environment -...

  • Big Data Developer

    4 weeks ago


    Bengaluru, Karnataka, India Coders Brain Full time

    Job DescriptionRoles and Responsibilities:- 5+ years of experience working with cloud or on-prem Big Data/MPP analytics platform (i.e. AWS Glue/EMR, Google BigQuery, Azure Data Warehouse, Databricks, Snowflake, Hortonworks/Cloudera Clusters)- 3+ years of exp in writing Advanced SQLs- Pyspark is mandatory.- 3+ years of exp with building dimensional data...