Big Data Engineer

3 days ago

Bengaluru, Karnataka, India The IT Firm Full time ₹ 15,00,000 - ₹ 25,00,000 per year

Role Overview
As a Big Data Engineer, you will be responsible for building and maintaining scalable data pipelines and architectures that support data analytics, reporting, and real-time processing. You will collaborate with data scientists, business analysts, and software engineers to design robust solutions that drive data-driven decisions.

Mandatory Skill Set

  • Extensive hands-on experience with the Hadoop ecosystem (HDFS, MapReduce, YARN).
  • Strong expertise in Apache Spark for large-scale data processing and analytics.
  • Proficiency in Hive writing complex HiveQL queries and managing Hive Metastore.
  • Experience in developing and maintaining Apache Kafka-based streaming solutions.
  • In-depth knowledge of HDFS storage management and optimization.
  • Proven programming skills in Python or Scala for data pipeline development and automation.
  • Strong expertise in writing complex SQL queries for data transformation and retrieval.
  • Experience in workflow orchestration using Apache Airflow or Oozie to manage dependencies, schedule jobs, and monitor workflows.

Key Expectations

  • Proven experience implementing Big Data solutions in production environments theoretical knowledge is not sufficient.
  • Ability to design and develop reliable, high-performance data pipelines to process large volumes of data.
  • Strong debugging, optimization, and troubleshooting skills for distributed data applications.
  • Good understanding of data modeling, schema design, and ETL best practices.
  • Collaborative mindset to work effectively with cross-functional teams and deliver high-quality solutions.

Important Note
We require candidates who have demonstrable, hands-on project experience in Big Data Engineering knowledge alone is not acceptable. Candidates with only academic or certification-level exposure will not be considered.

What We Offer

  • Opportunity to work on advanced Big Data technologies and real-time data processing solutions.
  • Exposure to challenging data engineering projects across different domains.
  • Collaborative and innovative work environment focused on learning and growth.
  • Qualified and experienced candidates are encouraged to apply through the platform.
  • Take this opportunity to advance your career by contributing to cutting-edge Big Data projects.

)

  • Big Data Engineer

    1 week ago

    Bengaluru, Karnataka, India Etaclam Techno Services Full time ₹ 12,00,000 - ₹ 14,40,000 per year

    Job Title: Big Data EngineerLocation: BengaluruExperience Required: 5 to 8 yearsJob Description:We are looking for a skilled Big Data Engineer with strong hands-on experience in PySpark and SQL. This is a hybrid role, requiring the candidate to work both remotely and from the office as needed. The ideal candidate should be comfortable working on large-scale...

  • Big Data Engineer

    3 days ago

    Bengaluru, Karnataka, India Reveille Technologies,Inc Full time ₹ 16,00,000 - ₹ 24,00,000 per year

    We're Hiring: Big Data Engineer – Full-TimeLooking for a skilledBig Data Engineerto join our team inBangaloreRole: Big Data EngineerGrade: G4 |TSRLocation: Bangalore (Onsite/Hybrid – specify if needed)Budget: ₹13,39,200Experience: 4–6 yearsSkills:Azure Databricks (ADB)PySparkSQLSpark (Scala/Python)TerraformAirflow & KubernetesData Warehousing &...

  • Big Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Deqode Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    Profile: Big Data Engineer (System Design)Experience:5+ yearsLocation:BangaloreWork Mode:HybridAbout The RoleWe're looking for an experiencedBig Data Engineerwith system design expertise to architect and build scalable data pipelines and optimize big data solutions.Key ResponsibilitiesDesign, develop, and maintain data pipelines and ETL processes using...

  • Big Data Engineer

    3 days ago

    Bengaluru, Karnataka, India Fractal Analytics Private Limited Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    BigData Engineer It's fun to work in a company where people truly BELIEVE in what they are doing We're committed to bringing passion and customer focus to the business.About the Role:We are seeking highly skilled Big Data Engineers/Senior Engineers with a strong background in building and supporting big data solutions. The ideal candidate will have...

  • Big Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Suzva Software Technologies Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Hiring: Big Data Engineer (PySpark)Client: [Details will be shared upon shortlisting]Location: Bangalore (Onsite)Experience: 6-8 years (Relevant)Joining: Immediate to 15 days Key Skills: Strong hands-on experience in PySpark Expertise in Big Data technologies Solid understanding of SQL, Data Pipelines, and ETLInterested candidates can share their resume...

  • Big Data Engineer

    18 hours ago

    Bengaluru, Karnataka, India Nagarro Softwares Pvt. Ltd Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    Associate Staff Engineer, Big Data Engineer (LookML & Looker Studio Pro) Company Description We're Nagarro. We are a Digital Product Engineering company that is scaling in a big way We build products, services, and experiences that inspire, excite, and delight. We work at scale across all devices and digital mediums, and our people exist everywhere in...

  • Big Data Engineer

    7 days ago

    Bengaluru, Karnataka, India, Karnataka Tata Consultancy Services Full time

    Job Title :- Data Engineer - PysparkExperience: 5 to 8 YearsLocation: Pune/HyderabadJob DescriptionRequired Skills:5+ years of experience in Big data and pysparkMust-HaveGood work experience on Big Data Platforms like Hadoop, Spark, Scala, Hive, Impala, SQLGood-to-HaveGood Spark, Pyspark,Big Data experienceSpark UI/Optimization/debugging techniquesGood...

  • Big Data Engineers/Senior Engineers

    2 weeks ago

    Bengaluru, Karnataka, India Peoplelogic Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Role: Big Data Engineers/Senior Engineers About the Role:We are seeking highly skilled Big Data Engineers/Senior Engineers with a strong background inbuilding and supporting big data solutions. The ideal candidate will have expertise in big datatechnologies, data pipeline development, and performance optimization within a collaborativeand agile...

  • Big Data Engineer – Spark

    3 days ago

    Bengaluru, Karnataka, India POWER IT SERVICES Full time ₹ 6,00,000 - ₹ 12,00,000 per year

    Big Data Engineer – Spark & AnalyticsLocation- ( Bangalore, Maharashtra)Job Description•Gather operational intel on business processes and policies from multiple sources•Prepare periodical and ad-hoc reports using operational data•Develop semantic core to align data with business processes•Support operations team's work streams for data processing,...

  • Big Data Engineer – Azure

    7 days ago

    Bengaluru, Karnataka, India Innova ESI Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Role: Big Data Engineer – AzureExperience: 10+ YearsLocation: BangaloreImmediate Joiners OnlyBig Data :Mandatory Skills:Azure Databricks, Azure Data Factory, Azure Function apps, Apache Spark, Scala, Java, Apache Kafka, event stream and Big DataOptional Skills: Airflow, PythonRoles & ResponsibilitiesOverall, experience in IT industry, including 5 years in...