Senior Data Engineer Position

18 hours ago

Palakkad, Kerala, India beBeeDataEngineering Full time ₹ 23,20,000

Data Engineering Expert Wanted

We are looking for a seasoned Data Engineering professional to spearhead the development of a scalable data ingestion framework. This individual will be responsible for designing and implementing robust APIs for seamless data integration, leveraging deep expertise in building and managing big data pipelines using modern technologies.

Key Responsibilities:

  • Data Ingestion Framework Design & Development: The successful candidate will architect, develop, and maintain an end-to-end data ingestion framework that efficiently extracts, transforms, and loads data from diverse sources.
  • Framework Optimization: Utilize AWS services such as AWS Glue, Lambda, EMR, ECS, EC2, and Step Functions to build highly scalable, resilient, and automated data pipelines.

Data Quality & Validation:

  • Validation Processes: Develop and implement automated data quality checks, validation routines, and error-handling mechanisms to ensure the accuracy and integrity of incoming data.
  • Monitoring & Reporting: Establish comprehensive monitoring, logging, and alerting systems to proactively identify and resolve data quality issues.

API Development:

  • Design & Implementation: Architect and develop secure, high-performance APIs to enable seamless integration of data services with external applications and internal systems.
  • Documentation & Best Practices: Create thorough API documentation and establish standards for API security, versioning, and performance optimization.

Candidate Requirements:

  • Deep understanding of big data pipeline design and implementation.
  • Experience with AWS services such as AWS Glue, Lambda, EMR, ECS, EC2, and Step Functions.
  • Strong programming skills in languages such as Java, Python, or Scala.
  • Excellent communication and collaboration skills.

Benefits:

  • A competitive salary and benefits package.
  • A dynamic and supportive work environment.

  • Cloud Data Engineer Position

    2 days ago

    Palakkad, Kerala, India beBeeDataEngineering Full time ₹ 1,20,00,000 - ₹ 2,00,00,000

    Senior Data Engineering SpecialistWe are seeking a skilled data engineer to join our team and lead the development of large-scale data processing systems on Google Cloud Platform.

  • Data Engineer Position

    19 hours ago

    Palakkad, Kerala, India beBeeDataEngineering Full time ₹ 1,00,00,000 - ₹ 2,00,00,000

    Data Engineering ExpertWe are seeking an experienced Data Engineer to fill a key role in our team. The ideal candidate will have a strong background in designing, developing, and maintaining large-scale data systems.Key Responsibilities:Design, develop, and maintain complex data pipelines using Apache Spark (RDDs, DataFrames, Spark SQL, PySpark)Implement...

  • Senior Data Engineering Specialist

    2 hours ago

    Palakkad, Kerala, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title: Senior Data Engineering SpecialistDescription:Our organization is seeking a highly skilled data engineer to lead our data engineering practice and drive initiatives to develop and continuously improve the Data/AI Practice.Key Responsibilities:Develop, implement, and optimize data pipelines for large-scale structured and unstructured datasets using...

  • Senior Data Engineer

    6 days ago

    Palakkad, Kerala, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job OverviewAchieve success as a Senior Data Engineer with expertise in large-scale data processing and system design.Key Responsibilities:• Develop high-performance ETL workflows using Python and Pandas to handle complex supply chain operations and personalized customer experiences.• Implement data ingestion and transformation processes using Hive SQL...

  • Senior Splunk Engineer Position

    1 week ago

    Palakkad, Kerala, India beBeeSplunkDeveloper Full time ₹ 15,00,000 - ₹ 20,00,000

    **Job Opportunity:** Splunk DeveloperA remote position for an experienced developer is available. We seek a skilled professional with expertise in developing, configuring, and maintaining Splunk environments to support monitoring, alerting, and advanced analytics.The ideal candidate will have hands-on experience as a Splunk Developer/Engineer, with a deep...

  • Senior Data Engineer

    7 days ago

    Palakkad, Kerala, India beBeeDataEngineering Full time ₹ 1,00,00,000 - ₹ 1,50,00,000

    Job DescriptionAs a senior data engineering professional, you will design and implement large-scale data pipelines using Azure Databricks and Azure Data Lake. Your primary focus will be on building production-ready workflows for data ingestion, transformation, quality checks, lineage capture, access auditing, cost usage analysis, retention tracking, and...

  • Senior Data Engineering Specialist

    10 minutes ago

    Palakkad, Kerala, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 20,00,000

    Job Title: Data EngineerAbout the Position:We are seeking an accomplished data engineer to lead our team's technical efforts.Key Responsibilities:Develop, implement, and maintain large-scale data pipelines using Snowflake DB.Design and optimize complex SQL queries across vast datasets.Collaborate with cross-functional teams to identify and prioritize data...

  • Senior Big Data Engineer

    2 days ago

    Palakkad, Kerala, India beBeeData Full time ₹ 19,00,800 - ₹ 24,24,000

    Key ResponsibilitiesAs a Senior Data Engineer, you will be responsible for driving the design and development of large-scale data processing systems. Your key responsibilities include:Studying the existing technology landscape to identify areas for improvement.Developing and enhancing Spark jobs using Scala to meet new project needs.Performing performance...

  • Senior Data Engineer Wanted

    6 days ago

    Palakkad, Kerala, India beBeeData Full time ₹ 10,00,000 - ₹ 15,00,000

    Job OpportunityData Engineer PositionWe are seeking a highly skilled Data Engineer to design, develop, and maintain large-scale data systems using Google Cloud Platform (GCP).Key Responsibilities:Data Ingestion: Design and implement efficient data pipelines to ingest data from various sources into GCP.Data Processing: Develop and optimize data processing...

  • Back-end Software Engineer Position

    2 days ago

    Palakkad, Kerala, India beBeeBackend Full time ₹ 20,00,000 - ₹ 30,00,000

    Senior Backend Developer Position OverviewWe are seeking a highly skilled and experienced backend engineer to fill this key role.