Senior Data Engineer

1 week ago

Kozhikode, Kerala, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 25,00,000

Data Engineering Position

This is an exciting opportunity to work on a project with a focus on integrating and processing channel activity data from multiple sources.

The ideal candidate will possess strong knowledge of AWS, Python, and has work experience in handling data from various sources such as Hadoop , and Terradata.

  • Design, build, and maintain robust data pipelines for processing channel activity data, focusing on digital channels and integrating multiple sources of data.
  • Work on AWS cloud infrastructure (including services like Pyspark ,Glue ,EMR ,lambda, Redshift , Athena, and other services) to ensure high availability, scalability, and performance.
  • Leverage Python for building automated data engineering solutions and data transformations.
  • Collaborate with cross-functional teams to ensure data from various digital channels is effectively ingested and processed.
  • Contribute to architecture decisions related to data lakes, data warehouses, and big data ecosystems.
  • Ensure data quality, governance, and integrity across all data systems.
Key Responsibilities:
  • Data pipeline design and maintenance
  • AWS cloud infrastructure management
  • Python-based data engineering solutions
  • Cross-functional team collaboration
  • Data architecture decision-making
  • Data quality and governance
Required Skills and Qualifications:
  • AWS: Strong hands-on experience with AWS technologies such as Pyspark ,Glue ,EMR ,lambda, Redshift , Athena, EC2 and S3.
  • Python: Proficiency in Python for data processing, automation, and pipeline development.
  • Big Data Platforms: Experience with big data technologies like Hadoop and Terradata.
  • Strong Analytical Skills: Ability to analyse and interpret data from different digital channels.
  • Collaboration: Ability to work closely with cross-functional teams, including business analysts, data scientists, and stakeholders.
Desirable Qualifications:
  • A degree in Computer Science, Engineering, or a related field.
  • Certifications or experience in AWS Cloud or relevant data engineering tools would be beneficial.

  • Senior Data Engineer

    1 week ago

    Kozhikode, Kerala, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Senior Data Engineer - AI/MLRole Summary:As a Senior Data Engineer with a focus on Artificial Intelligence (AI) and Machine Learning (ML), you will play a key role in driving our organization's digital transformation by designing, developing, and implementing scalable data architectures that support our business growth.Key Responsibilities:Design and...

  • Senior Data Engineer

    7 days ago

    Kozhikode, Kerala, India beBeeData Full time ₹ 18,00,000 - ₹ 25,00,000

    As a senior data engineer, you will play a key role in designing and implementing scalable data pipelines on cloud platforms.Key Responsibilities:Design and develop extract, transform, load (ETL) processes using cloud-based services such as storage solutions, messaging systems, data processing engines, and data warehousing platforms.Become proficient in...

  • Senior Cloud Data Engineering Specialist

    7 days ago

    Kozhikode, Kerala, India beBeeCloudDataEngineering Full time ₹ 15,00,000 - ₹ 20,00,000

    Job Title: Senior Cloud Data Engineering Specialist A senior cloud data engineering specialist is required to lead the design, development, and maintenance of large-scale data systems on Amazon Web Services (AWS). Job DescriptionThis role involves leading a team of data engineers to develop and implement data solutions that meet business requirements. The...

  • Master Data Engineer

    7 days ago

    Kozhikode, Kerala, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    Senior Data ArchitectWe are seeking a skilled Senior Data Architect to spearhead our data warehousing and engineering efforts. In this role, you will be responsible for designing, building, and maintaining large-scale data systems that drive business growth.

  • Senior Cloud Data Engineer

    2 weeks ago

    Kozhikode, Kerala, India beBeeCloudDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Title: Senior AWS Data EngineerAbout This Role:We are seeking an experienced and skilled AWS Data Engineer to design, deploy, and maintain large-scale data processing pipelines on the Amazon Web Services (AWS) cloud infrastructure. The ideal candidate will have a strong background in data engineering, AWS services, and software development.Key...

  • Senior Data Testing Engineer

    7 days ago

    Kozhikode, Kerala, India beBeeDataTesting Full time ₹ 9,00,000 - ₹ 12,15,000

    Data Testing SpecialistWe are seeking an experienced professional to fill the position of Senior Data Testing Engineer.Design, develop, and execute automated and manual test cases for data validation and transformation processes.Validate data integrity across various sources including APIs, databases.Collaborate with data engineers and developers to...

  • Senior Data Engineer Role

    6 days ago

    Kozhikode, Kerala, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Data Scientist PositionAt our organization, we are seeking a senior data scientist to lead the development and implementation of robust data-driven solutions. This role requires expertise in crafting intricate ETL pipelines for high-volume data processing and ensuring data precision, coherence, and system performance.We are looking for an individual with...

  • Senior Data Architect

    3 days ago

    Kozhikode, Kerala, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Senior Data ArchitectWe are seeking an experienced Senior Data Architect to join our team.Design, develop and maintain robust data architectures using various data platforms for the organization's centralized data warehouse.Conceptualize and own the build out of problem-solving data marts for consumption by data science and business intelligence teams,...

  • Senior AWS Data Engineer

    2 weeks ago

    Kozhikode, Kerala, India CYAN360 Full time

    Position: Senior AWS Data EngineerLocation: RemoteSalary: OpenWork Timings: 2:30 PM to 11:30 PM IST*** Need someone who can join immediately or in 15 days***Responsibilities:Design, develop, and deploy end-to-end data pipelines on AWS cloud infrastructure using services such as Amazon S3, AWS Glue, AWS Lambda, Amazon Redshift, etc.Implement data processing...

  • Senior IoT Data Engineering Specialist

    1 week ago

    Kozhikode, Kerala, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    We are seeking a Senior IoT Data Engineer to help implement an application for a large retailer.Key Responsibilities:Design and develop scalable data processing systems using Python and PysparkAnalyze telemetry data from IoT systems, including refrigeration units, HVAC systems, controllers, and sensorsCollaborate with business stakeholders to understand...