Data Engineer for Advanced Data Pipelines

2 weeks ago

Ellore, Andhra Pradesh, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000
Job Title: Data Ingestion Specialist

We are seeking a skilled engineer to fill the role of Data Ingestion Specialist.

Key Responsibilities:

  • Design, develop and optimize data ingestion pipelines for integrating multiple sources into Databricks.
  • Implement and maintain Continuous Integration/Continuous Deployment (CI/CD) pipelines for data workflows.
  • Deploy and manage containerized applications using Kubernetes.
  • Ensure data integrity, security, and compliance throughout the ingestion process.
  • Collaborate with Data Engineers and other stakeholders to streamline data ingestion strategies.
  • Troubleshoot and optimize ingestion pipelines for performance and scalability.

Required Skills & Qualifications:

  • Proven experience in data ingestion and pipeline development.
  • Hands-on experience with CI/CD tools (GitHub Actions, Jenkins, Azure DevOps, etc.).
  • Strong knowledge of Kubernetes and container orchestration.
  • Experience with Databricks, Spark, and data lake architectures.
  • Proficiency in Python, Scala or SQL for data processing.
  • Familiarity with cloud platforms such as AWS, Azure or GCP.
  • Strong problem-solving and analytical skills.

Benefits:

  • Opportunity to work on cutting-edge projects.
  • Collaborative and dynamic work environment.
  • Ongoing training and professional development opportunities.

Other Information:

The ideal candidate will have a strong passion for data engineering and a desire to learn and grow within the field. We encourage candidates from diverse backgrounds to apply.

  • Lead Data Pipeline Architect

    2 weeks ago

    Ellore, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 20,00,000

    **Data Engineer Position Overview**Seeking a skilled Data Engineer to design, build, and optimize scalable data pipelines. The ideal candidate will enable seamless data integration, transformation, and analytics to support business intelligence and advanced analytics initiatives.Design, build, and maintain ETL/ELT pipelines using AWS Glue, Lambda, and...

  • Data Pipeline Architect

    4 days ago

    Ellore, Andhra Pradesh, India beBeeData Full time ₹ 12,00,000 - ₹ 20,00,000

    Job Title: Data Pipeline ArchitectAs a key member of our data team, you will be responsible for designing and implementing scalable data pipelines to ensure seamless data flow and accessibility.Create interactive dashboards using Bold BI, Power BI, or Superset to provide actionable insights to stakeholders.Develop data pipelines and automation scripts using...

  • Data Pipeline Specialist

    5 days ago

    Ellore, Andhra Pradesh, India beBeeDataEngineer Full time US$ 1,00,000 - US$ 1,40,000

    Job Overview:As a seasoned Data Engineer, you will play a pivotal role in designing and developing scalable data pipelines that fuel our analytics and reporting capabilities.Key Responsibilities:Develop robust, high-quality data pipelines that support business needs.Integrate diverse data sources into data lakes and warehouses.Collaborate with...

  • A Pioneer in Scalable Data Pipelines

    1 week ago

    Ellore, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 1,29,74,400 - ₹ 2,03,60,600

    Data Engineering ProfessionalAs a skilled Data Engineer, you will play a pivotal role in designing and developing scalable data pipelines that drive business growth. Our innovative platform harnesses the power of big data to deliver real-time insights and strategic recommendations.Key Responsibilities:Design and build production-level data pipelines that...

  • Optimizing Data Pipelines

    5 days ago

    Ellore, Andhra Pradesh, India beBeeData Full time ₹ 12,60,000 - ₹ 20,16,000

    Job Role: Senior Data EngineerThe role of a Senior Data Engineer is to design and implement data pipeline architecture that is optimal.Key Responsibilities:Create and maintain data pipeline architecture that is efficient and scalable.Design and implement events/streaming based architecture/design.Identify and implement internal process improvements.Build the...

  • Advanced Pipeline Tester

    1 week ago

    Ellore, Andhra Pradesh, India beBeeTestEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    We are seeking a skilled Test Engineer to develop and maintain test cases for Azure Data Factory ETL pipelines using Python and Pytest.This role involves working with data transformations, data mappings, and data integrity through SQL queries and data profiling.Design and develop manual and automated test cases for Azure Data Factory ETL pipelines using...

  • Senior Data Engineer

    2 days ago

    Ellore, Andhra Pradesh, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Senior Data EngineerAbout the RoleWe are seeking a highly skilled data engineer to join our team for an exciting in-house project. The ideal candidate will have extensive experience in ETL development and a strong background in Python, SQL, and automation.Key Responsibilities:Design and implement complex data pipelines using Python and SQL.Develop...

  • Advanced Data Architectural Specialist

    1 week ago

    Ellore, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 2,00,00,000 - ₹ 3,00,00,000

    About Foodsmart:We provide a leading telenutrition and foodcare solution, backed by a robust network of Registered Dietitians. Our platform fosters healthier food choices, drives lasting behavior change, and delivers long-term health outcomes.Our 2.2 million members are guided on a tailored journey to eating well while saving time and money through our...

  • Data Pipeline Specialist

    3 days ago

    Ellore, Andhra Pradesh, India beBeeAbInitioDeveloper Full time ₹ 18,00,000 - ₹ 25,00,000

    Job Opportunity: Ab Initio DeveloperAbout the RoleWe are seeking a skilled Ab Initio Developer to join our team. As an Ab Initio Developer, you will be responsible for designing and implementing data pipelines using Ab Initio.Main Responsibilities:Design and implement efficient data pipelines using Ab Initio, ensuring seamless integration with existing...

  • Senior Data Pipeline Developer

    4 days ago

    Ellore, Andhra Pradesh, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Opportunity: Data Engineering SpecialistWe are seeking a highly skilled Data Engineering Specialist to lead the design, development, and deployment of scalable data pipelines and ETL processes using Databricks.Responsibilities:Collaborate with stakeholders to understand data requirements and develop technical solutions that meet their needs.Design,...