Big Data Developer

3 weeks ago

Bengaluru, India Grid Dynamics Full time

7 to 15 Years of experience in Big Data Developer (
Mandatory Splunk to ClickHouse and Grafana)
Essential Functions
Key Responsibilities
7 to 15 Years of experience in Big Data Developer

  • Design and develop scalable data pipelines to migrate user knowledge objects from Splunk to ClickHouse and Grafana.
  • Implement data ingestion, transformation, and validation processes to ensure data integrity and performance.
  • Collaborate with cross-functional teams to automate and optimize data migration workflows.
  • Monitor and troubleshoot data pipeline performance and resolve issues proactively.
  • Work closely with observability engineers and analysts to understand data requirements and deliver solutions.
  • Contribute to the continuous improvement of the observability stack and migration automation tools.

Qualifications
Required Skills and Qualifications

  • Proven experience as a 7 to 15 Years Big Data Developer or Engineer working with large-scale data platforms.
  • Strong expertise with ClickHouse or other columnar databases, including query optimization and schema design.
  • Hands-on experience with Splunk data structures, dashboards, and reports.
  • Proficiency in data pipeline development using technologies such as Apache Spark, Kafka, or similar frameworks.
  • Strong programming skills in Python, Java, or Scala.
  • Experience with data migration automation and scripting.
  • Familiarity with Grafana for data visualization and monitoring.
  • Understanding of observability concepts and monitoring systems.

Would be a plus

  • Experience with Bosun or other alerting platforms.
  • Knowledge of cloud-based big data services and infrastructure as code.
  • Familiarity with containerization and orchestration tools (Docker, Kubernetes).
  • Experience working in agile POD-based teams.

We offer

  • Opportunity to work on bleeding-edge projects
  • Work with a highly motivated and dedicated team
  • Competitive salary
  • Flexible schedule
  • Benefits package - medical insurance, sports
  • Corporate social events
  • Professional development opportunities
  • Well-equipped office

About Us
Grid Dynamics (NASDAQ: GDYN) is a leading provider of technology consulting, platform and product engineering, AI, and advanced analytics services. Fusing technical vision with business acumen, we solve the most pressing technical challenges and enable positive business outcomes for enterprise companies undergoing business transformation. A key differentiator for Grid Dynamics is our 8 years of experience and leadership in enterprise AI, supported by profound expertise and ongoing investment in data, analytics, cloud & DevOps, application modernization and customer experience. Founded in 2006, Grid Dynamics is headquartered in Silicon Valley with offices across the Americas, Europe, and India.

  • Big Data Developer

    3 weeks ago

    Bengaluru, India LION AND ELEPHANTS Full time

    Job Description: We are looking for skilled Big Data Engineers using Java Spark with 5-10 years of experience in Big Data / legacy platforms, who can join immediately. We have openings in Bengaluru, Chennai, Hyderabad, Pune, Delhi. Desired candidates should have design, development and optimization of real-time & batch data pipelines experience in a Big Data...

  • Big Data Developer

    2 weeks ago

    Bengaluru, Karnataka, India LION AND ELEPHANTS Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Job Description:We are looking for skilled Big Data Engineers using Java Spark with 5-10 years of experience in Big Data / legacy platforms, who can join immediately. We have openings in Bengaluru, Chennai, Hyderabad, Pune, Delhi.Desired candidates should have design, development and optimization of real-time & batch data pipelines experience in a Big Data...

  • Itss-big Data/hadoop/splunk Developer-humjp00032981

    12 hours ago

    Bengaluru, Karnataka, India NTT DATA Full time

    **Req ID**: 325776 We are currently seeking a ITSS-Big Data/Hadoop/Splunk Developer-HUMJP00032981 to join our team in Bangalore, Karnātaka (IN-KA), India (IN). Azure Data Factory, Azure Synapse, and Databricks **About NTT DATA

  • Big Data Developer

    2 weeks ago

    Bengaluru, India Tata Consultancy Services Full time

    Position - Big Data DeveloperExperience: 4 to 10 YearsNotice Period- 0-60 DaysLocation-BengaluruRequired Skill Set_ Hadoop, PySpark, Spark SQL, HIVEJob Description- Hands-on experience of PySpark, Spark, Hive, Hadoop Big Data Eco System Tools.- Strong SQL experience.- Should be able to develop, tweak queries and work on performance enhancement.- Solid...

  • Big data developer

    3 weeks ago

    Bengaluru, India Tata Consultancy Services Full time

    Position - Big Data DeveloperExperience: 4 to 10 YearsNotice Period- 0-60 DaysLocation-BengaluruRequired Skill Set_ Hadoop, Py Spark, Spark SQL, HIVEJob DescriptionHands-on experience of Py Spark, Spark, Hive, Hadoop Big Data Eco System Tools.Strong SQL experience.Should be able to develop, tweak queries and work on performance enhancement.Solid...

  • Big Data Developer

    2 weeks ago

    Bengaluru, India Tata Consultancy Services Full time

    Position - Big Data DeveloperExperience: 4 to 10 YearsNotice Period- 0-60 DaysLocation-BengaluruRequired Skill Set_ Hadoop, PySpark, Spark SQL, HIVEJob DescriptionHands-on experience of PySpark, Spark, Hive, Hadoop Big Data Eco System Tools.Strong SQL experience.Should be able to develop, tweak queries and work on performance enhancement.Solid understanding...

  • Big Data Developer

    1 week ago

    Bengaluru, Karnataka, India Grid Dynamics Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    7 to 15 Years of experience in Big Data Developer (Mandatory Splunk to ClickHouse and Grafana)Essential FunctionsKey Responsibilities7 to 15 Years of experience in Big Data DeveloperDesign and develop scalable data pipelines to migrate user knowledge objects from Splunk to ClickHouse and Grafana.Implement data ingestion, transformation, and validation...

  • Big Data Developer

    4 weeks ago

    Bengaluru, Karnataka, India Tata Consultancy Services Full time

    Position - Big Data Developer Experience: 4 to 10 Years Notice Period- 0-60 Days Location-Bengaluru Required Skill Set_ Hadoop, PySpark, Spark SQL, HIVE Job Description Hands-on experience of PySpark, Spark, Hive, Hadoop Big Data Eco System Tools. Strong SQL experience. Should be able to develop, tweak queries and work on performance enhancement....

  • Big Data Developer

    4 weeks ago

    Bengaluru, Karnataka, India Tata Consultancy Services Full time

    Position - Big Data DeveloperExperience: 4 to 10 YearsNotice Period- 0-60 DaysLocation-BengaluruRequired Skill Set_ Hadoop, PySpark, Spark SQL, HIVEJob DescriptionHands-on experience of PySpark, Spark, Hive, Hadoop Big Data Eco System Tools.Strong SQL experience.Should be able to develop, tweak queries and work on performance enhancement.Solid understanding...

  • Big Data Developer

    3 weeks ago

    Bengaluru, India Tata Consultancy Services Full time

    Position - Big Data DeveloperExperience: 4 to 10 YearsNotice Period- 0-60 DaysLocation-BengaluruRequired Skill Set_ Hadoop, PySpark, Spark SQL, HIVEJob DescriptionHands-on experience of PySpark, Spark, Hive, Hadoop Big Data Eco System Tools.Strong SQL experience.Should be able to develop, tweak queries and work on performance enhancement.Solid understanding...