Highly Skilled Data Engineer Wanted

1 day ago

Cochin, Kerala, India beBeeDataEngineer Full time ₹ 23,00,000

Senior Data Engineer Job Summary

We are seeking an experienced Senior Data Engineer to lead the development of a scalable data ingestion framework while ensuring high data quality and validation.

The ideal candidate will have at least 7 years of relevant experience in data engineering with a strong emphasis on analytical platform development. They should be proficient in Python and/or PySpark, SQL for developing ETL processes and handling large-scale data manipulation.

Our company requires the selected candidate to have extensive experience using AWS services including AWS Glue, Lambda, Step Functions, and S3 to build and manage data ingestion frameworks.

Additionally, they should be familiar with big data systems (e.g., AWS EMR, Apache Spark, Apache Iceberg) and databases like DynamoDB, Aurora, Postgres, or Redshift.

Data Ingestion Framework Development
  • Design & Development: Architect, develop, and maintain an end-to-end data ingestion framework that efficiently extracts, transforms, and loads data from diverse sources.
  • Framework Optimization: Use AWS services such as AWS Glue, Lambda, EMR, ECS, EC2, and Step Functions to build highly scalable, resilient, and automated data pipelines.
Data Quality & Validation
  • Validation Processes: Develop and implement automated data quality checks, validation routines, and error-handling mechanisms to ensure the accuracy and integrity of incoming data.
  • Monitoring & Reporting: Establish comprehensive monitoring, logging, and alerting systems to proactively identify and resolve data quality issues.
API Development
  • Design & Implementation: Architect and develop secure, high-performance APIs to enable seamless integration of data services with external applications and internal systems.
  • Documentation & Best Practices: Create thorough API documentation and establish standards for API security, versioning, and performance optimization.
Collaboration & Agile Practices
  • Cross-Functional Communication: Work closely with business stakeholders, data scientists, and operations teams to understand requirements and translate them into technical solutions.
  • Agile Development: Participate in sprint planning, code reviews, and agile ceremonies, while contributing to continuous improvement initiatives and CI/CD pipeline development.
Required QualificationsExperience & Technical Skills
  • Professional Background: At least 7 years of relevant experience in data engineering with a strong emphasis on analytical platform development.
  • Programming Skills: Proficiency in Python and/or PySpark, SQL for developing ETL processes and handling large-scale data manipulation.
  • AWS Expertise: Extensive experience using AWS services including AWS Glue, Lambda, Step Functions, and S3 to build and manage data ingestion frameworks.
  • Data Platforms: Familiarity with big data systems (e.g., AWS EMR, Apache Spark, Apache Iceberg) and databases like DynamoDB, Aurora, Postgres, or Redshift.
  • API Development: Proven experience in designing and implementing RESTful APIs and integrating them with external and internal systems.
  • CI/CD & Agile: Hands-on experience with CI/CD pipelines and Agile development methodologies.
Soft Skills
  • Strong problem-solving abilities and attention to detail.
  • Excellent communication and interpersonal skills with the ability to work independently and collaboratively.
  • Capacity to quickly learn and adapt to new technologies and evolving business requirements.

  • Highly Skilled Data Engineer Wanted

    3 days ago

    Cochin, Kerala, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Big Data Engineer OpportunityWe are seeking a highly skilled data engineer to join our team. The ideal candidate will have expertise in Scala, Spark, Python, NiFi, and Apache Kafka, as well as experience in building, scaling, and optimizing big data pipelines.The successful candidate will be responsible for designing, developing, and optimizing large-scale...

  • Highly Skilled Data Engineer

    1 week ago

    Cochin, Kerala, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Overview:We are seeking a highly skilled Data Engineering professional to join our team as a Senior Data Engineer. This key role involves designing, developing, and maintaining large-scale data processing systems. The ideal candidate will have extensive experience with distributed data processing systems, including Python, Pyspark, Azure Data Bricks,...

  • Highly Skilled Data Engineer Wanted

    2 weeks ago

    Cochin, Kerala, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Senior Data Engineer Job DescriptionWe are seeking an experienced Senior Data Engineer to join our organization.The ideal candidate will have a minimum of 4+ years of experience in data engineering and will be proficient in building scalable real-time and batch processing workflows using cloud-based technologies.The successful candidate will also have...

  • Highly Skilled Cloud Data Professional Wanted

    2 weeks ago

    Cochin, Kerala, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title: Cloud Data EngineerWe are seeking a highly skilled Cloud Data Engineer to join our team. The ideal candidate will have experience in designing, developing, and maintaining batch and streaming data pipelines using cloud-based technologies.The successful candidate will be responsible for:Designing and implementing scalable data pipelines using...

  • Highly Skilled Data Analyst Wanted

    3 days ago

    Cochin, Kerala, India beBeeAnalytics Full time ₹ 9,00,000 - ₹ 12,00,000

    Job Opportunity: Advanced Analytics SpecialistWe are seeking a highly skilled Advanced Analytics Specialist to join our team. As an Advanced Analytics Specialist, you will be responsible for designing and implementing advanced analytics solutions, developing and deploying machine learning models, and extracting insights from complex data sets.Key...

  • Highly Skilled Data Innovator Wanted

    2 weeks ago

    Cochin, Kerala, India beBeeDataScientist Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Lead Data InnovatorAt our organization, we're looking for a highly skilled Senior Data Scientist to spearhead data-driven projects. As a key member of our team, you will be responsible for driving innovation and developing cutting-edge solutions that leverage Machine Learning and Generative AI.This role requires a deep understanding of complex business...

  • Highly Skilled Data Analyst Wanted

    7 days ago

    Cochin, Kerala, India beBeeDataAnalyst Full time ₹ 5,00,000 - ₹ 10,00,000

    Data SpecialistAre you a detail-oriented professional with a passion for working with data? We are looking for someone to join our team as a Data Specialist.This role involves collaborating with our talented engineers who are pushing the boundaries of data science and automation. You will play an integral part in ensuring that our clients receive...

  • Highly Skilled Network Engineer Wanted

    7 days ago

    Cochin, Kerala, India beBeeWireless Full time ₹ 18,00,000 - ₹ 25,20,000

    About Us:We are a global technology consulting and digital solutions company that enables enterprises to reimagine business models and accelerate innovation through digital technologies.Our team of entrepreneurial professionals across the globe caters to over 700 clients with our extensive domain and technology expertise to help drive superior competitive...

  • Highly Skilled Unreal Engine Developer Wanted

    2 weeks ago

    Cochin, Kerala, India beBeeUnreal Full time ₹ 12,00,000 - ₹ 15,00,000

    About this positionWe are seeking a highly skilled Senior Unreal Engine Developer to drive the development of gameplay and mechanics for our project. As a senior, you will lead the programming team, ensure high-quality code, and contribute to the overall direction of the project.Key Responsibilities:Collaborate with game designers, artists, and other...

  • Highly Skilled PhD Peer Reviewer Wanted

    7 days ago

    Cochin, Kerala, India beBeeEngineering Full time ₹ 50,00,000 - ₹ 75,00,000

    Highly Skilled PhD Peer Reviewer WantedAs a prestigious academic institution, we are seeking a highly skilled PhD Peer Reviewer to join our esteemed team of experts.Key Responsibilities:Assess Novelty: Evaluate whether the manuscript is original and adds new knowledge or insights to the field of study.Evaluate Study Design and Methodology: Check whether the...