Big Data Engineer

14 hours ago

Bengaluru, Karnataka, India IT Firm Full time

Role Overview :

As a Big Data Engineer, you will be responsible for building and maintaining scalable data pipelines and architectures that support data analytics, reporting, and real-time processing. You will collaborate with data scientists, business analysts, and software engineers to design robust solutions that drive data-driven decisions.

Mandatory Skill Set :

- Extensive hands-on experience with the Hadoop ecosystem (HDFS, MapReduce, YARN).

- Strong expertise in Apache Spark for large-scale data processing and analytics.

- Proficiency in Hive writing complex HiveQL queries and managing Hive Metastore.

- Experience in developing and maintaining Apache Kafka-based streaming solutions.

- In-depth knowledge of HDFS storage management and optimization.

- Proven programming skills in Python or Scala for data pipeline development and automation.

- Strong expertise in writing complex SQL queries for data transformation and retrieval.

- Experience in workflow orchestration using Apache Airflow or Oozie to manage dependencies, schedule jobs, and monitor workflows.

Key Expectations :

- Proven experience implementing Big Data solutions in production environments theoretical knowledge is not sufficient.

- Ability to design and develop reliable, high-performance data pipelines to process large volumes of data.

- Strong debugging, optimization, and troubleshooting skills for distributed data applications.

- Good understanding of data modeling, schema design, and ETL best practices.

- Collaborative mindset to work effectively with cross-functional teams and deliver high-quality solutions.

Important Note :

We require candidates who have demonstrable, hands-on project experience in Big Data Engineering knowledge alone is not acceptable. Candidates with only academic or certification-level exposure will not be considered.

What We Offer :

- Opportunity to work on advanced Big Data technologies and real-time data processing solutions.

- Exposure to challenging data engineering projects across different domains.

- Collaborative and innovative work environment focused on learning and growth.

- Qualified and experienced candidates are encouraged to apply through the platform.

- Take this opportunity to advance your career by contributing to cutting-edge Big Data projects.

(ref:hirist.tech)

  • Big Data Engineer

    7 days ago

    Bengaluru, Karnataka, India Coders Brain Full time

    Job DescriptionRoles and Responsibilities:- Develop scalable infrastructure and platform to collect, analyze and process large amounts of structured and unstructured data with real-time data interpretation.- Work closely across an array of various teams and organizations in the company (including partners, customers)Basic Qualifications:- Bachelor's degree...

  • Big Data Engineer

    4 hours ago

    Bengaluru, Karnataka, India Reveille Technologies,Inc Full time ₹ 1,04,000 - ₹ 13,39,200 per year

    We're Hiring: Big Data Engineer – Full-TimeLooking for a skilledBig Data Engineerto join our team inBangaloreRole: Big Data EngineerGrade: G4 |TSRLocation: Bangalore (Onsite/Hybrid – specify if needed)Budget: ₹13,39,200Experience: 4–6 yearsSkills:Azure Databricks (ADB)PySparkSQLSpark (Scala/Python)TerraformAirflow & KubernetesData Warehousing &...

  • Big Data Engineer

    3 days ago

    Bengaluru, Karnataka, India Xebia Full time

    We're Hiring – Big Data Engineer (Scala + Spark)&## ; Location: Bangalore – Whitefield (Hybrid: 3 Days Office / Week)&##Availability: Immediate to Max 2 Weeks Notice Big Data & Hadoop Ecosystem Python Data Structures & Algorithms Design & Coding Skills Experience in distributed data processing & performance optimization At Xebia, you'll be part of a...

  • Big Data Engineer

    5 days ago

    Bengaluru, Karnataka, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Title: Big Data EngineerOverviewWe are seeking a highly skilled professional to design, develop and implement large-scale data engineering solutions.The ideal candidate will be part of a fast-paced team focused on delivering cutting-edge technology and product roadmaps.The team is responsible for developing marketing campaign tracking capabilities using...

  • Big Data Solutions Engineer

    19 hours ago

    Bengaluru, Karnataka, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 25,00,000

    Big Data Solutions EngineerWe are seeking a highly skilled and experienced Big Data Solutions Engineer to lead and manage our team of data engineers. As a key member of our organization, you will be responsible for designing, building, and maintaining scalable big data platforms and pipelines that meet the needs of our business.Your primary focus will be on...

  • Big Data Engineer

    7 days ago

    Bengaluru, Karnataka, India Xebia Full time

    We're Hiring – Big Data Engineer (Scala + Spark)Location: Bangalore – Whitefield (Hybrid: 3 Days Office / Week)Budget: Up to 30 LPAAvailability: Immediate to Max 2 Weeks NoticeMust Have Skills:Scala & Spark (Mandatory)Big Data & Hadoop EcosystemHive, Kafka, OoziePythonData Structures & AlgorithmsDesign & Coding SkillsCI/CD PipelinesProblem Solving...

  • Big Data Engineer

    3 weeks ago

    Bengaluru, Karnataka, India Xebia Full time

    ???? We're Hiring – Big Data Engineer (Scala + Spark)???? Location: Bangalore – Whitefield (Hybrid: 3 Days Office / Week)???? Budget: Up to 30 LPA???? Availability: Immediate to Max 2 Weeks NoticeMust Have Skills:Scala & Spark (Mandatory)Big Data & Hadoop EcosystemHive, Kafka, OoziePythonData Structures & AlgorithmsDesign & Coding SkillsCI/CD...

  • Big Data Engineer

    2 days ago

    Bengaluru, Karnataka, India beBeeData Full time ₹ 1,04,000 - ₹ 1,30,878

    Job Title: Big Data EngineerWe are seeking a highly skilled Big Data Engineer to join our team. As a key member of our data engineering team, you will play a critical role in designing, building, and maintaining large-scale data processing systems.This is an exceptional opportunity for a talented engineer who is passionate about working with big data...

  • Big Data Engineer

    6 days ago

    Bengaluru, Karnataka, India RiskInsight Consulting Pvt Ltd Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    ResponsibilitiesDesign, develop, and implement robust Big Data solutions using technologies such as Hadoop, Spark, and NoSQL databases. Build and maintain scalable data pipelines for effective data ingestion, transformation, and analysis. Collaborate with data scientists, analysts, and cross-functional teams to understand business requirements and translate...

  • Big Data Engineering Specialist

    7 days ago

    Bengaluru, Karnataka, India beBeeDataEngineer Full time ₹ 10,00,000 - ₹ 15,00,000

    Job OverviewThe role of a Data Solutions Engineer is to develop and implement large-scale data processing systems that can handle structured and unstructured data with real-time interpretation.Key ResponsibilitiesDesign and build scalable infrastructure for big data collection, analysis, and processing.Collaborate closely with cross-functional teams and...