Data Ingestion Specialist

2 weeks ago


Tirupati, Andhra Pradesh, India beBeeDataIngestion Full time ₹ 90,00,000 - ₹ 1,50,00,000
Job Title: Data Ingestion Specialist

This role requires a highly skilled professional with expertise in data ingestion processes, focusing on integrating various data sources into Databricks.

The ideal candidate will have a strong understanding of data ingestion pipelines, CI/CD tools, and Kubernetes. They will design, develop, and optimize data ingestion pipelines for integrating multiple sources into Databricks, implement and maintain CI/CD pipelines for data workflows, deploy and manage containerized applications using Kubernetes, and ensure data integrity, security, and compliance throughout the ingestion process.

Key Responsibilities:

  • Design and develop data ingestion pipelines for integrating multiple sources into Databricks
  • Implement and maintain CI/CD pipelines for data workflows
  • Deploy and manage containerized applications using Kubernetes
  • Ensure data integrity, security, and compliance throughout the ingestion process

Required Skills & Qualifications:

  • Proven experience in data ingestion and pipeline development
  • Hands-on experience with CI/CD tools (GitHub Actions, Jenkins, Azure DevOps, etc.)
  • Strong knowledge of Kubernetes and container orchestration
  • Experience with Databricks, Spark, and data lake architectures
  • Proficiency in Python, Scala, or SQL for data processing
  • Familiarity with cloud platforms such as AWS, Azure, or GCP
  • Strong problem-solving and analytical skills

Benefits:

  • Opportunity to work with cutting-edge technology
  • Collaborative and dynamic work environment
  • Professional growth and development opportunities

What We Offer:

  • Competitive compensation package
  • Benefits package including health insurance, retirement savings plan, and paid time off
  • Opportunities for professional growth and development


  • Tirupati, Andhra Pradesh, India beBeeDataEngineering Full time ₹ 18,00,000 - ₹ 25,00,000

    Job Title: Data Engineering SpecialistWe are seeking a highly skilled professional to design, develop, and maintain large-scale data acquisition pipelines in the Google Cloud Ecosystem.Key Responsibilities:Develop and maintain data acquisition pipelines for structured and unstructured data using tools such as Python, Data Flow, DataStream, CDC (Change Data...


  • Tirupati, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000

    Cloud Data EngineerJob DescriptionAs a Cloud Data Engineer, you will play a pivotal role in designing and developing scalable ETL pipelines using Azure services. Your primary responsibility will be to process, transform, and load large datasets into AWS Datalake or other data stores.Key ResponsibilitiesDesign and develop cloud-based ETL pipelines using Azure...


  • Tirupati, Andhra Pradesh, India beBeeData Full time ₹ 20,00,000 - ₹ 30,00,000

    Job Opportunity: Senior Data Engineer (Azure)Key Responsibilities:Design, develop, and implement large-scale data pipelines using Azure Data Factory, Databricks, and PySpark.Maintain and optimize high-performance data warehouses on Azure SQL DB, Synapse, and Redshift.Collaborate with cross-functional teams to integrate data into business intelligence tools...


  • Tirupati, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Unlock Data PotentialAs a technology consulting and delivery company, we partner with businesses to transform data into actionable insights, leverage the cloud for agility and scalability, and ultimately thrive in the digital age.Our mission is to empower businesses to optimize their technology infrastructure and drive data-driven success. We provide expert...

  • Data engineer

    4 weeks ago


    Tirupati, Andhra Pradesh, India Firstsource Full time

    Key Skills and Responsibilities:We are seeking a Senior Data Engineer with a strong background in cloud-native data engineering, primarily on Microsoft Azure, and familiarity with AWS and GCP. The ideal candidate will have deep expertise in building scalable data pipelines, implementing enterprise-grade data governance, security, and AI-powered engineering...


  • Tirupati, Andhra Pradesh, India beBeeData Full time ₹ 1,00,00,000 - ₹ 2,00,00,000

    Job Title: Senior Data EngineerAbout the Position:We are seeking an experienced Data Architect with a strong background in designing, building and optimizing scalable data pipelines and architectures.Key Responsibilities:Design and develop large-scale data solutions using Azure Data Factory and Azure Synapse Analytics.Build and optimize data warehouse...


  • Tirupati, Andhra Pradesh, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Cloud Data Engineer PositionWe are seeking a highly skilled Cloud Data Engineer to join our team and take on the challenge of designing and implementing scalable data pipelines, data lakes, and data warehouses.The ideal candidate will have extensive experience with cloud-native ETL tools, AWS, Azure, and GCP, as well as strong proficiency in data platforms...


  • Tirupati, Andhra Pradesh, India beBeeDataSpecialist Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Seeking a talented Data Specialist to join our dynamic team.This is an excellent opportunity to work with cutting-edge technologies and contribute to the growth of our organization.The ideal candidate will have experience in designing, developing, stabilizing, and enhancing SQL programs, as well as creating and updating data model designs and/or stored...


  • Tirupati, Andhra Pradesh, India beBeeDataAnalytics Full time ₹ 8,00,000 - ₹ 12,00,000

    We are seeking a skilled Chief Data Insights Specialist to join our team. This is a full-time remote role responsible for collecting, analyzing, and interpreting data to drive business decisions.Key Responsibilities:Analyze complex data sets to identify trends and patternsDevelop and implement data models to support business objectivesPresent findings...


  • Tirupati, Andhra Pradesh, India beBeeMedicalContent Full time ₹ 8,00,000 - ₹ 15,00,000

    Job Title: Medical Content SpecialistKey Responsibilities:Extract, enter and quality-check healthcare datasets.Develop and manage market definitions, including NDC codes, ICD codes and disease-related coding.Conduct comprehensive profiling of healthcare professionals using secondary research methodologies.Validate medical data for industry...