Big Data Engineer Position

2 days ago

Bengaluru, Karnataka, India beBeeData Full time
Job Title:

Senior Data Engineer (Big Data)

Job Description:

We are seeking an experienced Senior Data Engineer to join our team. As a key member of our data engineering group, you will be responsible for designing and implementing large-scale data processing workflows using Apache Spark and Scala.

Our ideal candidate has hands-on experience with Apache Spark, strong programming skills in Scala, and knowledge of Spark Core, Spark SQL, Spark Streaming, and MLlib.

Additionally, the successful candidate will have experience with Hadoop ecosystem components (HDFS, Hive, Kafka), familiarity with functional programming concepts, and expertise in data serialization formats (Parquet, Avro, ORC).

The chosen candidate will work closely with data engineers and analysts to deliver high-quality data solutions that meet business requirements.

In this role, you will also be responsible for optimizing Spark jobs for better performance and scalability, collaborating with cross-functional teams to ensure seamless integration of data systems, and troubleshooting issues in production big data environments.

Required Skills:
  • Expertise in Apache Spark, including Spark Core, Spark SQL, Spark Streaming, and MLlib
  • Hands-on experience with Hadoop ecosystem components (HDFS, Hive, Kafka)
  • Strong programming skills in Scala
  • Familiarity with functional programming concepts
  • Experience with data serialization formats (Parquet, Avro, ORC)
  • Version control (Git) and CI/CD understanding
  • Excellent problem-solving and communication skills

Benefits:

This is an exceptional opportunity to join a cutting-edge organization and contribute to the development of innovative data solutions.

As a Senior Data Engineer, you will have the chance to work on complex projects, collaborate with talented professionals, and grow your skills and expertise in the field of big data engineering.

How to Apply:

If you are a motivated and experienced data engineer looking for a new challenge, please submit your application along with your resume and cover letter.

  • Big Data Engineer

    4 days ago

    Bengaluru, Karnataka, India Coders Brain Full time

    Job DescriptionRoles and Responsibilities:- Develop scalable infrastructure and platform to collect, analyze and process large amounts of structured and unstructured data with real-time data interpretation.- Work closely across an array of various teams and organizations in the company (including partners, customers)Basic Qualifications:- Bachelor's degree...

  • Big Data Engineer

    1 day ago

    Bengaluru, Karnataka, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Title: Big Data EngineerOverviewWe are seeking a highly skilled professional to design, develop and implement large-scale data engineering solutions.The ideal candidate will be part of a fast-paced team focused on delivering cutting-edge technology and product roadmaps.The team is responsible for developing marketing campaign tracking capabilities using...

  • Big Data Engineer

    3 weeks ago

    Bengaluru, Karnataka, India Xebia Full time

    ???? We're Hiring – Big Data Engineer (Scala + Spark)???? Location: Bangalore – Whitefield (Hybrid: 3 Days Office / Week)???? Budget: Up to 30 LPA???? Availability: Immediate to Max 2 Weeks NoticeMust Have Skills:Scala & Spark (Mandatory)Big Data & Hadoop EcosystemHive, Kafka, OoziePythonData Structures & AlgorithmsDesign & Coding SkillsCI/CD...

  • Big Data Engineer

    3 days ago

    Bengaluru, Karnataka, India Xebia Full time

    We're Hiring – Big Data Engineer (Scala + Spark)Location: Bangalore – Whitefield (Hybrid: 3 Days Office / Week)Budget: Up to 30 LPAAvailability: Immediate to Max 2 Weeks NoticeMust Have Skills:Scala & Spark (Mandatory)Big Data & Hadoop EcosystemHive, Kafka, OoziePythonData Structures & AlgorithmsDesign & Coding SkillsCI/CD PipelinesProblem Solving...

  • Big Data Engineer

    3 days ago

    Bengaluru, Karnataka, India RiskInsight Consulting Pvt Ltd Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    ResponsibilitiesDesign, develop, and implement robust Big Data solutions using technologies such as Hadoop, Spark, and NoSQL databases. Build and maintain scalable data pipelines for effective data ingestion, transformation, and analysis. Collaborate with data scientists, analysts, and cross-functional teams to understand business requirements and translate...

  • Big Data Engineering Specialist

    3 days ago

    Bengaluru, Karnataka, India beBeeDataEngineer Full time ₹ 10,00,000 - ₹ 15,00,000

    Job OverviewThe role of a Data Solutions Engineer is to develop and implement large-scale data processing systems that can handle structured and unstructured data with real-time interpretation.Key ResponsibilitiesDesign and build scalable infrastructure for big data collection, analysis, and processing.Collaborate closely with cross-functional teams and...

  • Big Data Engineer

    4 weeks ago

    Bengaluru, Karnataka, India Xebia Full time

    We're Hiring – Big Data Engineer (Scala + Spark) Location: Bangalore – Whitefield (Hybrid: 3 Days Office / Week) Budget: Up to 30 LPA Availability: Immediate to Max 2 Weeks NoticeMust Have Skills:- Scala & Spark (Mandatory)- Big Data & Hadoop Ecosystem- Hive, Kafka, Oozie- Python- Data Structures & Algorithms- Design & Coding Skills- CI/CD Pipelines-...

  • Senior Big Data Engineer

    4 weeks ago

    Bengaluru, Karnataka, India Coforge Full time

    We are Hiring Senior Big Data Engineer at Coforge Ltd.Note:- We are currently prioritizing candidates who are available to join immediately, to meet the urgent timelines of our ongoing project.Job Locations:- Bangalore.Experience Required: 8 to 10 YearsPlease share your CV to Gaurav.2.Kumar@coforge.comWhatsApp 9667427662 for any queries.We are looking for a...

  • Big Data Engineer

    4 weeks ago

    Bengaluru, Karnataka, India Xebia Full time

    We're Hiring – Big Data Engineer (Scala + Spark) Location: Bangalore – Whitefield (Hybrid: 3 Days Office / Week) Budget: Up to 30 LPA Availability: Immediate to Max 2 Weeks NoticeMust Have Skills:Scala & Spark (Mandatory)Big Data & Hadoop EcosystemHive, Kafka, OoziePythonData Structures & AlgorithmsDesign & Coding SkillsCI/CD PipelinesProblem Solving &...

  • Big Data Engineer

    1 day ago

    Bengaluru, Karnataka, India Xebia Full time

    We're Hiring – Big Data Engineer (Scala + Spark) Location: Bangalore – Whitefield (Hybrid: 3 Days Office / Week) Budget: Up to 30 LPA Availability: Immediate to Max 2 Weeks Notice Must Have Skills: Scala & Spark (Mandatory) Big Data & Hadoop Ecosystem Hive, Kafka, Oozie Python Data Structures & Algorithms Design & Coding Skills CI/CD Pipelines...