Big Data Specialist

2 days ago

bangalore district, India Brillio Full time

Role Overview

We are seeking a highly skilled Big Data Engineer to join our team. The ideal candidate will have strong experience in building, maintaining, and optimizing large-scale data pipelines and distributed data processing systems. This role involves working closely with cross-functional teams to ensure the reliability, scalability, and performance of data solutions.

Key Responsibilities

  • Design, develop, and maintain scalable data pipelines and ETL processes.
  • Work with large datasets using Hadoop ecosystem tools (Hive, Spark).
  • Build and optimize real-time and batch data processing solutions using Kafka and Spark Streaming.
  • Write efficient, high-performance SQL queries to extract, transform, and load data.
  • Develop reusable data frameworks and utilities in Python.
  • Collaborate with data scientists, analysts, and product teams to deliver reliable data solutions.
  • Monitor, troubleshoot, and optimize big data workflows for performance and cost efficiency.

Must-Have Skills

  • Strong hands-on experience with Hive and SQL for querying and data transformation.
  • Proficiency in Python for data manipulation and automation.
  • Expertise in Apache Spark (batch and streaming).
  • Experience working with Kafka for streaming data pipelines.

Good-to-Have Skills

  • Experience with workflow orchestration tools (Airflow etc.)
  • Knowledge of cloud-based big data platforms (AWS EMR, GCP Dataproc, Azure HDInsight).
  • Familiarity with CI/CD pipelines and version control (Git).

  • Architect - Big data and Cloud

    7 days ago

    bangalore district, India Societe Generale Global Solution Centre Full time

    Role: Cloud and Big data Architect Role Description We are looking for skilled and passionate Azure Cloud experts with a strong focus on Big Data management and data quality skills to join our team at Société Générale Global Solution Centre in Bengaluru. This is a full-time hybrid role for Digital & Data Solutions (DDS), offering flexibility for...

  • GCP Big Data Engineer

    7 days ago

    bangalore district, India Talentmatics Full time

    We are seeking an experienced GCP Big Data Engineer with 8–10 years of expertise in designing, developing, and optimizing large-scale data processing solutions. The ideal candidate will bring strong leadership capabilities, technical depth, and a proven track record of delivering end-to-end big data solutions in cloud environments. Key...

  • Big Data Specialist

    1 day ago

    pune district, India LTIMindtree Full time

    Greetings from LTIMindtree ! We are currently hiring for Bigdata Scala Spark. The position is ideal for professionals with 6–12 years of experience in Bigdata and related technologies. Experience : 6 to 12 Location : Coimbatore/Pune Work Mode : Hybrid Mode Notice Period : Upto 30 Days Interview Mode : In Person (Saturday, 13-Sep-2025) Key Skills...

  • Gcp big data engineer

    6 days ago

    Bangalore, India Talentmatics Full time

    We are seeking an experienced GCP Big Data Engineer with 8–10 years of expertise in designing, developing, and optimizing large-scale data processing solutions. The ideal candidate will bring strong leadership capabilities, technical depth, and a proven track record of delivering end-to-end big data solutions in cloud environments. Key...

  • Architect - Big data and Cloud

    13 hours ago

    Bangalore, India Societe Generale Global Solution Centre Full time

    Role: Cloud and Big data Architect We are looking for skilled and passionate Azure Cloud experts with a strong focus on Big Data management and data quality skills to join our team at Société Générale Global Solution Centre in Bengaluru. This is a full-time hybrid role for Digital & Data Solutions (DDS), offering flexibility for remote work. Required...

  • Architect - big data and cloud

    1 week ago

    Bangalore, India Societe Generale Global Solution Centre Full time

    Role: Cloud and Big data Architect Role Description We are looking for skilled and passionate Azure Cloud experts with a strong focus on Big Data management and data quality skills to join our team at Société Générale Global Solution Centre in Bengaluru. This is a full-time hybrid role for Digital & Data Solutions (DDS), offering flexibility for...

  • Architect - Big data and Cloud

    13 hours ago

    Bangalore, India Societe Generale Global Solution Centre Full time

    Role: Cloud and Big data Architect Role Description We are looking for skilled and passionate Azure Cloud experts with a strong focus on Big Data management and data quality skills to join our team at Société Générale Global Solution Centre in Bengaluru. This is a full-time hybrid role for Digital & Data Solutions (DDS), offering flexibility for...

  • Lead Data Engineer

    12 hours ago

    Bangalore, India ANSR Full time

    Martens is an iconic British brand founded in 1960 in Northamptonshire. Produced originally for workers looking for tough, durable boots, the brand was quickly adopted by diverse youth subcultures and associated musical movements. Martens has since transcended its working-class roots while still celebrating its proud heritage and, six decades later,...

  • GCP Big Data Engineer

    7 days ago

    bangalore, India Talentmatics Full time

    We are seeking an experienced GCP Big Data Engineer with 8–10 years of expertise in designing, developing, and optimizing large-scale data processing solutions. The ideal candidate will bring strong leadership capabilities, technical depth, and a proven track record of delivering end-to-end big data solutions in cloud environments.Key...

  • GCP Big Data Engineer

    4 days ago

    Bangalore, India Talentmatics Full time

    We are seeking an experienced GCP Big Data Engineer with 8–10 years of expertise in designing, developing, and optimizing large-scale data processing solutions. The ideal candidate will bring strong leadership capabilities, technical depth, and a proven track record of delivering end-to-end big data solutions in cloud environments. Key...