Data Engineer

1 week ago

Rajahmundry, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 20,00,000

Job Summary:

Develop innovative data acquisition pipelines for large volumes of structured and unstructured data, including batch and real-time processing. This involves designing a robust infrastructure to handle the ingestion, processing, and storage of vast amounts of data.

 

Data Engineering Responsibilities

Create complex datasets based on business requirements and construct scalable 'big data' pipeline architecture.

 

  • Identify opportunities for data acquisition via collaboration with stakeholders and business clients.
  • Translate business needs to technical requirements.
  • Leverage Google Cloud tools, such as Python, Data Flow, DataStream, CDC, Cloud Functions, Cloud Run, Pub Sub, BigQuery, and Cloud Storage, to integrate systems and data pipelines.
  • Use logs & alerts to effectively monitor pipelines.
  • Develop JSON messaging structure for integrating with various applications.
  • Implement DevOps and CI/CD practices, using GitHub and Terraform, to ensure the reliability and scalability of data pipelines.
  • Partition/Cluster and retrieve content in Big Query and use IAM roles & Policy Tags to secure the data.

 

Design and build an efficient ingestion pipeline using Rest API.

 

Recommend ways to improve data quality, reliability, and efficiency.

  • Data Engineering Expert

    1 week ago

    Rajahmundry, Andhra Pradesh, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    Unlocking Business Potential with Data EngineeringWe are seeking a seasoned data engineer to join our team and help us drive business success through data-driven insights. As a key member of our engineering team, you will be responsible for leading the migration of data warehousing and ETL processes from legacy systems to modern cloud...

  • Data Testing engineer

    2 weeks ago

    Rajahmundry, Andhra Pradesh, India Innova ESI Full time

    Hello Greetings we are hiring for Data Testing engineer for one of the MNC company with INNOVA.JD for Data Testing About the Role:We are seeking a highly skilled and detail-oriented Senior Data Testing Engineer to join our data engineering team. The ideal candidate will have strong experience in Python, Pandas, REST API and testing, with a solid...

  • Data Engineer

    2 weeks ago

    Rajahmundry, Andhra Pradesh, India Jade Business Services (JBS) Full time

    Role: Data Engineer – Microsoft Fabric & Azure SynapseExperience: Overall 6 years to 9 years with relevant 4 years to 5 years in Synapse- expert ,Should know the fundamentals of Synapse / Data Engand close to 1 year in Fabric (should have executed atleast 1 project in Fabric)Work Location: Anywhere in India (Remote) or Hyderabad (WFO in hybrid mode) or...

  • Data Engineer Lead

    2 weeks ago

    Rajahmundry, Andhra Pradesh, India beBeeDataEngineering Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Senior Data EngineerWe are seeking an experienced data professional to fill a key role in our organization.The ideal candidate will have a strong background in data engineering, with expertise in designing and building scalable data pipelines on cloud-based platforms. They will also have hands-on experience with big data processing technologies like Apache...

  • Data Engineering Leader

    2 weeks ago

    Rajahmundry, Andhra Pradesh, India beBeeDataEngineering Full time ₹ 2,50,00,000 - ₹ 3,00,00,000

    Senior Data Engineering LeadWe are seeking an experienced data engineering leader to drive our team's success.13+ years of experience in IT, with 6+ years in technical product management or delivery lead roles.

  • Data Engineer Tester

    2 weeks ago

    Rajahmundry, Andhra Pradesh, India beBeeTest Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    About UsWe are a global organization with numerous corporate opportunities worldwide.Our offices serve as dynamic innovation and operations hubs, designed to expand our talent base and in-house expertise.Our goal is to accelerate our ability to deliver impactful solutions for the business and our customers across the globe.Job SummaryIntegrated Test Lead –...

  • Mastering Data Engineering

    2 weeks ago

    Rajahmundry, Andhra Pradesh, India beBeeData Full time ₹ 18,00,000 - ₹ 25,00,000

    Senior Data EngineerWe are seeking a highly skilled data engineer to design and implement efficient data pipelines. The ideal candidate will have 3-5+ years of experience in data engineering and management, with a strong focus on data modeling, ETL, and Snowflake.The successful candidate will be responsible for developing complex SQL queries across large...

  • Data Engineering Specialist

    2 weeks ago

    Rajahmundry, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000

    About the RoleWe are seeking a highly experienced Data Engineering Specialist with 6+ years of experience in data engineering projects.Key Responsibilities:Collaborate with stakeholders to understand data requirements and translate them into technical solutions.Design, develop, and deploy scalable data pipelines and ETL processes using Databricks.Optimize...

  • Data Engineering Opportunities

    2 weeks ago

    Rajahmundry, Andhra Pradesh, India beBeeCloudDataEngineer Full time ₹ 12,00,000 - ₹ 15,00,000

    Job Title: Cloud Data EngineerThe ideal candidate will be responsible for designing, developing and maintaining large-scale data pipelines on Google Cloud Platform.Key Responsibilities:Develop scalable data processing pipelines utilizing BigQuery, Cloud Functions, and Cloud Storage.Build complex datasets based on business requirements using Cloud SQL and...

  • Data Engineering Leader

    2 weeks ago

    Rajahmundry, Andhra Pradesh, India beBeeFabric Full time ₹ 14,40,000 - ₹ 18,12,000

    **Job Opportunity**We are seeking a seasoned professional to fill the position of Fabric Lead.This role requires a strong understanding of data modeling, ETL/ELT processes, and data governance.Design and oversee the architecture of Microsoft Fabric solutions.Lead a team of data engineers, BI developers, and analysts in delivering scalable and secure data...