Senior Big Data Engineer

2 days ago


Bengaluru, Karnataka, India beBeeBigData Full time ₹ 20,00,000 - ₹ 35,00,000

We are looking for a seasoned big data professional with expertise in Scala and cloud technologies to lead our data engineering efforts.

Job Description

The ideal candidate will have hands-on experience designing, developing, and optimizing data pipelines and ETL workflows using Hadoop, Apache Airflow, Kubernetes, and Containers. They will work closely with our team to implement data analytics and mining techniques to drive business insights and manage cloud-based big data solutions on GCP and Azure.

Key Responsibilities:
  • Data Pipeline Development: Design, develop, and optimize data pipelines and ETL workflows.
  • Big Data Engineering: Work with Hadoop ecosystem, Hive, Pig, and MapReduce.
  • Cloud Solutions: Manage cloud-based big data solutions on GCP and Azure.
  • Troubleshooting: Troubleshoot Hadoop log files and work with multiple data processing engines for scalable data solutions.
Required Skills & Qualifications:
  • Programming Languages: Proficiency in Scala, Spark, PySpark, Python, and SQL.
  • Big Data Experience: Strong hands-on experience with Hadoop ecosystem, Hive, Pig, and MapReduce.
  • ETL Experience: Experience in ETL, Data Warehouse Design, and Data Cleansing.
  • Orchestration Tools: Familiarity with data pipeline orchestration tools like Apache Airflow.
  • Cloud Platforms: Knowledge of Kubernetes, Containers, and cloud platforms such as GCP and Azure.
Becoming part of our team

  • Bengaluru, Karnataka, India beBeeDataEngineer Full time ₹ 1,04,000 - ₹ 1,30,878

    ">Big Data Engineer">Job Description: As a senior big data engineer, you will play a key role in designing and implementing large-scale data processing systems. You will work with cross-functional teams to develop and deploy data pipelines that integrate with various data sources and enable business insights.">Develop scalable and efficient data pipelines...


  • Bengaluru, Karnataka, India Coforge Full time

    We are Hiring Senior Big Data Engineer at Coforge Ltd.Note:- We are currently prioritizing candidates who are available to join immediately, to meet the urgent timelines of our ongoing project.Job Locations:- Bangalore.Experience Required: 8 to 10 YearsPlease share your CV to Gaurav.2.Kumar@coforge.comWhatsApp 9667427662 for any queries.We are looking for a...


  • Bengaluru, Karnataka, India Coforge Full time

    We are Hiring Senior Big Data Engineer at Coforge Ltd. Note:- We are currently prioritizing candidates who are available to join immediately, to meet the urgent timelines of our ongoing project. Job Locations:- Bangalore. Experience Required: 8 to 10 Years Please share your CV to WhatsApp 9667427662 for any queries. We are looking for a highly...


  • Bengaluru, Karnataka, India beBeeEngineering Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Senior Engineering ManagerDescriptionWe are seeking an experienced Senior Engineering Manager to lead our Big Data and Cloud Engineering team. The successful candidate will have a strong background in Big Data infrastructure and application development/operations, with experience in distributed Azure cloud environments.Key Responsibilities


  • Bengaluru, Karnataka, India beBeeData Full time

    Job Title:Senior Data Engineer (Big Data)Job Description:We are seeking an experienced Senior Data Engineer to join our team. As a key member of our data engineering group, you will be responsible for designing and implementing large-scale data processing workflows using Apache Spark and Scala.Our ideal candidate has hands-on experience with Apache Spark,...


  • Bengaluru, Karnataka, India POWER IT SERVICES Full time

    Big Data Engineer – Spark & Analytics Job Description • Gather operational intel on business processes and policies from multiple sources • Prepare periodical and ad-hoc reports using operational data • Develop semantic core to align data with business processes • Support operations team's work streams for data processing, analysis and reporting...


  • Bengaluru, Karnataka, India beBeeDataArchitect Full time ₹ 25,00,000 - ₹ 35,00,000

    Job SummaryWe are seeking a highly skilled Senior Big Data Architect to design and implement large-scale data architectures that drive business growth and innovation. The ideal candidate will have extensive experience in big data technologies, including data warehousing, ETL, and data visualization.Key ResponsibilitiesDesign and implement scalable data...

  • Big Data Engineer

    6 days ago


    Bengaluru, Karnataka, India Coders Brain Full time

    Job DescriptionRoles and Responsibilities:- Develop scalable infrastructure and platform to collect, analyze and process large amounts of structured and unstructured data with real-time data interpretation.- Work closely across an array of various teams and organizations in the company (including partners, customers)Basic Qualifications:- Bachelor's degree...

  • Big Data Engineer

    2 days ago


    Bengaluru, Karnataka, India Xebia Full time

    We're Hiring – Big Data Engineer (Scala + Spark)&## ; Location: Bangalore – Whitefield (Hybrid: 3 Days Office / Week)&##Availability: Immediate to Max 2 Weeks Notice Big Data & Hadoop Ecosystem Python Data Structures & Algorithms Design & Coding Skills Experience in distributed data processing & performance optimization At Xebia, you'll be part of a...

  • Big Data Engineer

    4 days ago


    Bengaluru, Karnataka, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Title: Big Data EngineerOverviewWe are seeking a highly skilled professional to design, develop and implement large-scale data engineering solutions.The ideal candidate will be part of a fast-paced team focused on delivering cutting-edge technology and product roadmaps.The team is responsible for developing marketing campaign tracking capabilities using...