Big Data Infrastructure Specialist

2 weeks ago


Thiruvananthapuram, Kerala, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

Job Overview:

Senior Big Data Engineer

As a senior big data engineer, you will lead distributed teams and manage multiple geographies and time zones. Your expertise in data engineering will drive business outcomes for enterprise companies undergoing transformation.

Key Responsibilities:

  • Lead cross-functional teams to develop scalable data infrastructure.
  • Collaborate with architects and product managers to ensure effective project delivery.
  • Develop and maintain large-scale data pipelines using Apache Spark and Flink.
  • Design and implement secure data storage solutions using Ceph or AWS S3.
  • Work closely with operations teams to optimize data infrastructure performance.

Requirements:

  • Strong background in Scala and Python programming languages.
  • Experience with Apache Spark (batch & streaming) and distributed blob storages like Ceph or AWS S3.
  • Deep knowledge of Apache Iceberg, Delta Lake, or Apache Hudi for schema evolution and ACID transactions.
  • Infrastructure-as-Code experience with Terraform and Helm.
  • Excellent communication skills and the ability to work in a fast-paced environment.

About the Role: This is an opportunity to work with a leading provider of technology consulting, platform and product engineering, and advanced analytics services. We enable positive business outcomes for enterprise companies undergoing business transformation by solving their most pressing technical challenges.


  • Big Data Specialist

    1 week ago


    Thiruvananthapuram, Kerala, India beBeeData Full time ₹ 9,00,000 - ₹ 12,00,000

    Job Title: Big Data Specialist We are seeking a skilled and experienced Big Data Specialist to join our team. As a key member of our analytics team, you will be responsible for designing and implementing data processing solutions using Hadoop and Spark. The ideal candidate will have a strong background in big data technologies, including Hadoop, Spark, and...


  • Thiruvananthapuram, Kerala, India beBeeData Full time ₹ 20,00,000 - ₹ 40,00,000

    Big Data Engineering OpportunitiesWe are seeking experienced professionals to spearhead the development of scalable big data analytics platforms. These platforms will utilize cutting-edge technologies like Spark, Druid, Drill, and ClickHouse.Design and develop sophisticated big data pipelines using a range of tools including Spark, Kafka, Glue, EMR, Hudi,...


  • Thiruvananthapuram, Kerala, India beBeeDataIngestion Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Title: Databricks Data Ingestion SpecialistWe are seeking a skilled data ingestion specialist to join our team. As an expert in designing and developing efficient data pipelines, you will play a key role in integrating multiple sources into Databricks.This is an exciting opportunity for individuals who are passionate about working with big data, cloud...

  • Big Data Expert

    1 week ago


    Thiruvananthapuram, Kerala, India beBeeBigData Full time ₹ 15,00,000 - ₹ 20,00,000

    Job Overview">We are seeking a skilled Big Data Engineer to join our delivery team, with a focus on hands-on project support and mentoring junior engineers. This role is ideal for a developer who thrives in a technical environment and is passionate about coaching and developing talent.You will work on live client projects, provide technical support,...


  • Thiruvananthapuram, Kerala, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    Senior Data Engineer PositionThis is an opportunity for a seasoned data engineer to design, develop, and maintain large-scale data pipelines in support of our consulting and analytics solutions.Key Responsibilities:Collaborate with cross-functional teams to design and develop data models, ETL processes, and data warehousing solutions.Experience with big data...


  • Thiruvananthapuram, Kerala, India beBeeBigDataDeveloper Full time ₹ 20,00,000 - ₹ 25,00,000

    Are you passionate about harnessing the power of big data to drive business growth?Job Overview:We are seeking a skilled Big Data Developer to join our team and contribute to the design, development, and implementation of scalable big data solutions.Key Responsibilities:Develop and implement high-performance big data pipelines using cutting-edge technologies...


  • Thiruvananthapuram, Kerala, India beBeeDataInfrastructure Full time ₹ 15,00,000 - ₹ 20,00,000

    Job Title: Senior Data Infrastructure SpecialistOverviewAs a key member of our team, you will play a vital role in designing and implementing cutting-edge data infrastructure solutions. Your primary responsibility will be to architect and deploy scalable data systems that meet the needs of our organization.Key ResponsibilitiesDesign and implement robust data...


  • Thiruvananthapuram, Kerala, India beBeeDataScience Full time ₹ 1,50,00,000 - ₹ 2,15,00,000

    ">Big Data DeveloperOur team is looking for a highly skilled Big Data Developer to join our crew. As a Big Data Developer, you will play a key role in designing and implementing large-scale data processing systems.">For this position, we are seeking an experienced professional with expertise in big data technologies such as Spark, SQL, Hive, and Scala. The...


  • Thiruvananthapuram, Kerala, India beBeeCloudInfrastructure Full time ₹ 1,50,00,000 - ₹ 2,25,00,000

    Job Title: Cloud Infrastructure SpecialistDescription:A cloud infrastructure specialist with experience in digital channel activities, data engineering, and AWS technologies is required to work on a project that involves integrating and processing channel activity data from multiple sources.The ideal candidate will possess strong knowledge of Python,...


  • Thiruvananthapuram, Kerala, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title">We are seeking an experienced Data Engineering Specialist to lead the development of our data infrastructure. The ideal candidate will have a strong background in designing and implementing scalable data architectures, including ETL processes and data governance.Designing and implementing technical solutions for data pipeline development and...