Senior Data Ingestion Specialist

2 days ago

Bengaluru, Karnataka, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 24,00,000
Join Our Data Engineering Team

We are seeking a skilled Associate Software Engineer II to join our data engineering team. As a key member of our team, you will play a crucial role in developing and deploying scalable data ingestion mechanisms for generative AI-powered solutions.

This is an exciting opportunity to work with cutting-edge technology and contribute to the advancement of health optimization on a global scale.

Job Description:

Our ideal candidate will have a strong background in software development life cycle (SDLC) and excellent written and verbal communication skills. Proficiency in developing data pipelines and automating workflows using Python in Azure Databricks is essential.

The successful candidate will also have knowledge of integrating generative AI tools in development activities and consuming web APIs. Good exposure to SQL (like Oracle and SQL Server) and NoSQL (like MongoDB, Cassandra) to handle diverse data structures is also required.

Responsibilities:

  • Developing and deploying scalable data ingestion mechanisms for generative AI-powered solutions
  • Understanding and implementing enterprise data governance policies and standards
  • Adaptable to need based on working hours if required
  • Comply with the terms and conditions of the employment contract, company policies and procedures, and any and all directives

Qualifications:

  • Sound knowledge of SDLC
  • Proven excellent written and verbal communication skills
  • Proficient in developing data pipelines and automating workflows using Python in Azure Databricks
  • Proficient in using Azure data management services like Azure Data Factory, Azure Synapse, and Azure Stream Analytics
  • Knowledge of integrating generative AI tools in development activities
  • Knowledge of consuming web APIs
  • Good exposure to SQL (like Oracle and SQL Server) and NoSQL (like MongoDB, Cassandra) to handle diverse data structures

Preferred Qualifications:

  • Working experience in other Azure-based cloud technologies
  • Experience of working on Agile-based development approach

What We Offer:

We offer a comprehensive benefits package, including comprehensive health insurance, 401(k) matching, and paid time off. Our team members also enjoy opportunities for career growth and development through training programs and mentorship.

At our organization, we value diversity, equity, and inclusion. We believe that everyone deserves equal access to opportunities and resources. If you share our values and are passionate about making a difference, please apply today

],

  • Databricks Ingestion Specialist

    5 days ago

    Bengaluru, Karnataka, India beBeeIngestion Full time ₹ 18,00,000 - ₹ 20,00,000

    Job Title:Databricks Ingestion SpecialistWe are seeking an experienced Databricks ingestion specialist with expertise in CI/CD and Kubernetes to design, develop, and optimize data ingestion pipelines.The ideal candidate will have hands-on experience with data pipelines, automation, and infrastructure management to support scalable and efficient ingestion...

  • Data Ingestion Specialist

    1 day ago

    Bengaluru, Karnataka, India beBeeDataExpert Full time ₹ 80,00,000 - ₹ 1,50,00,000

    Job DescriptionData Pipeline Management and ValidationBuild and manage ingestion workflows using Spark, Hive, Trino, and Kafka.Validate data ingestion, debug pipeline outputs, and support delta loads.Create and schedule Airflow DAGs for recurring ingestion processes.Automation and Scripting ExpertiseUtilize Python and Bash (or PowerShell) to automate...

  • Unlock Business Insights as Senior ETL Specialist

    3 days ago

    Bengaluru, Karnataka, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Description:As a senior ETL specialist in data analytics, you will play a crucial role in unlocking business insights and driving results for our clients. Leveraging smarter data analytics is key to making impactful decisions that give our clients a competitive edge.With expertise in data pipelines, ETL processes, and Spark-based workflows, you will be...

  • Senior Data Architect

    1 day ago

    Bengaluru, Karnataka, India beBeeData Full time ₹ 1,00,00,000 - ₹ 2,00,00,000

    Lead Data SpecialistThe ideal candidate will be responsible for designing and implementing data-driven solutions, working with both relational and NoSQL databases, and collaborating with product and analytics teams to deliver high-quality, actionable insights.Key Responsibilities :Develop efficient data pipelines for ingestion, transformation, and...

  • Senior Data Architect

    2 weeks ago

    Bengaluru, Karnataka, India beBeeEngineering Full time

    Job DescriptionAs a senior engineering manager, you will be responsible for designing and implementing scalable data platforms, pipelines, and ingestion systems. This includes building OLAP stacks and supporting reporting products using big data technologies.Key deliverables include leading end-to-end delivery of mission-critical data projects, driving...

  • Data Engineering Specialist

    1 day ago

    Bengaluru, Karnataka, India beBeeDataEngineer Full time ₹ 1,04,000 - ₹ 1,30,878

    Job Title: Data Engineering SpecialistWe are seeking a highly skilled Data Engineering Specialist to join our team. This role will be responsible for designing, building, and maintaining large-scale data processing systems.Key Responsibilities:Data Ingestion: Develop and implement data ingestion pipelines using Azure Databricks (ADB) and Azure Data Factory...

  • Data Ingestion Specialist

    7 days ago

    Bengaluru, Karnataka, India beBeeBackend Full time ₹ 80,00,000 - ₹ 1,40,00,000

    Backend EngineerWe are seeking a skilled Backend Engineer to join our team.The ideal candidate will have experience in writing clean, maintainable code and be able to explain technical concepts to both technical and non-technical stakeholders.This is an exciting opportunity for a talented engineer to take on new challenges and contribute to the growth of our...

  • Senior Data Engineering Specialist

    3 days ago

    Bengaluru, Karnataka, India beBeeData Full time ₹ 17,54,000 - ₹ 24,30,000

    Job Title: Senior Data Engineering SpecialistJob SummaryWe are seeking a highly skilled Data Engineer to join our organization. As a key member of the team, you will be responsible for designing, developing, and maintaining large-scale data systems using Snowflake, AWS Glue, Kafka, and API.Key Responsibilities:Design and develop complex data pipelines using...

  • Senior Data Engineer

    5 days ago

    Bengaluru, Karnataka, India HealthyMe Ai Full time

    About the RoleWe are seeking a Senior Data Engineer with deep expertise in building data pipelines and integrating healthcare data. You will report to the Head of AI and Engineering and be responsible for designing, building, and operating the backbone of our AI-powered applications. This is a critical role where you will create scalable pipelines that...

  • Senior Sustainability Data Specialist

    3 days ago

    Bengaluru, Karnataka, India beBeeSustainability Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Title: Senior Sustainability Data SpecialistOur organization seeks an experienced professional to fill the role of a Senior Sustainability Data Specialist. The ideal candidate will possess strong analytical skills, excellent communication abilities, and a proven track record in sustainability data collection, management, analysis, and reporting.