Big Data Integration Specialist

7 days ago


Palakkad, Kerala, India beBeeDataIntegration Full time ₹ 18,00,000 - ₹ 25,00,000

Job Title: Big Data Integration Specialist

We are seeking an experienced professional with expertise in data ingestion and pipeline development to join our team. This role requires a strong understanding of integrating various data sources into cloud-based platforms.

The ideal candidate will have hands-on experience with data pipelines, automation, and infrastructure management to support scalable and efficient ingestion workflows.

Key Responsibilities:

  • Design, develop, and optimize big data integration pipelines for integrating multiple sources into cloud-based systems.
  • Implement and maintain continuous integration and deployment (CI/CD) pipelines for data workflows.
  • Deploy and manage containerized applications using Kubernetes.
  • Ensure data integrity, security, and compliance throughout the ingestion process.
  • Collaborate with cross-functional teams to streamline data integration strategies.
  • Troubleshoot and optimize integration pipelines for performance and scalability.

Required Skills & Qualifications:

  • Proven experience in big data ingestion and pipeline development.
  • Hands-on experience with CI/CD tools (GitHub Actions, Jenkins, Azure DevOps, etc.).
  • Strong knowledge of Kubernetes and container orchestration.
  • Experience with cloud-based platforms such as AWS, Azure, or GCP.
  • Proficiency in Python, Scala, or SQL for data processing.
  • Familiarity with data lake architectures and Spark.
  • Strong problem-solving and analytical skills.

Benefits:

  • Opportunity to work with cutting-edge technologies.
  • Chance to collaborate with experienced professionals.
  • Ongoing training and skill development opportunities.


  • Palakkad, Kerala, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Senior Big Data SpecialistDescriptionWe are seeking a highly skilled Senior Big Data Specialist to join our team. The ideal candidate will have a minimum of 3-5 years of experience in designing and implementing data pipelines using various technologies.The successful candidate will be responsible for developing and maintaining large-scale data...


  • Palakkad, Kerala, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Opening for a Skilled Big Data DeveloperWe are seeking a skilled professional to join our team as a Big Data developer. The ideal candidate will have hands-on experience with Big Data development and engineering, as well as strong analytical skills.This role is ideal for a developer who thrives in a technical environment and has experience working on...

  • Big Data Engineer

    2 weeks ago


    Palakkad, Kerala, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    Job OverviewAs a skilled professional in Big Data engineering, you will be responsible for developing and implementing scalable data processing solutions using cutting-edge technologies.With 2+ years of experience in the field, you will have a solid understanding of Big Data concepts, Scala programming language, AWS cloud platform, and either Python or...

  • Big Data Specialist

    2 weeks ago


    Palakkad, Kerala, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Big Data DeveloperWe are seeking a skilled Data Engineer to join our growing team.Main Responsibilities:Design and develop end-to-end data pipelines for financial datasets.Integrate third-party APIs and data feeds into internal systems.Build and optimize data ingestion, storage, and transformation workflows (batch and real-time).Ensure data...

  • Big Data Architect

    2 weeks ago


    Palakkad, Kerala, India beBeeDataEngineer Full time ₹ 1,00,00,000 - ₹ 2,00,00,000

    Role OverviewThe Data Engineer II will design, execute, and manage large-scale distributed data systems to drive business insights and growth.Key Responsibilities:Design and execute complex distributed data systems.Monitor and optimize existing projects for performance.Research and integrate new big data tools and frameworks as required.Implement scalable...


  • Palakkad, Kerala, India beBeeData Full time ₹ 12,50,000 - ₹ 20,15,000

    Software Integration SpecialistWe are seeking an experienced software integration specialist to develop and maintain data integration solutions. The ideal candidate will have expertise in Informatica PowerCenter 9.x and onwards, as well as IICS/IDMC. Strong database skills, including Oracle, SQL server, and DB2, are essential.


  • Palakkad, Kerala, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 24,00,000

    Job Title: Data EngineerAbout the RoleWe are seeking a highly skilled professional to lead the design and implementation of big data solutions.The ideal candidate will have 5-12 years of experience in Big Data & Data related technology, with expertise in distributed computing principles and Apache Spark.Responsibilities:Designing and implementing big data...


  • Palakkad, Kerala, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Position OverviewOur organization is seeking a seasoned Data Engineer to spearhead the development of scalable data solutions.The ideal candidate will possess a deep understanding of big data technologies, including HDFS, Hive, and Spark architecture. Proficiency in working with Python and PySpark programming languages is also essential.Key...


  • Palakkad, Kerala, India beBeeDataEngineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Data EngineerWe are seeking a skilled professional to design, build, and maintain robust data pipelines for processing channel activity data. The ideal candidate will have experience in digital channel activities, data engineering, and cloud technologies.Key Responsibilities:Design and develop scalable data architectures using AWS cloud infrastructure and...

  • Big Data Visionary

    2 weeks ago


    Palakkad, Kerala, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job DescriptionWe are seeking a seasoned Big Data professional to lead our data engineering efforts. As a Senior Big Data Engineer, you will be responsible for designing and implementing large-scale data processing systems that drive business growth.Team Leadership: Proven experience in leading high-performing data engineering teams across multiple...