Expert Data Ingestion Specialist

4 days ago

Allahabad, Uttar Pradesh, India beBeeDataIngestion Full time ₹ 15,00,000 - ₹ 20,00,000
Job Title: Azure Databricks Engineer with Injection Experience

Description:

We are seeking a seasoned Data Ingestion Expert to join our team and lead the design, development, and optimization of data ingestion pipelines for integrating multiple sources into Databricks.

Key Responsibilities:

  • Develop scalable and efficient data ingestion workflows using data pipelines, automation, and infrastructure management.
  • Implement and maintain Continuous Integration/Continuous Deployment (CI/CD) pipelines for data workflows.
  • Deploy and manage containerized applications using Kubernetes.
  • Ensure data integrity, security, and compliance throughout the ingestion process.
  • Collaborate with Data Engineers and other stakeholders to streamline data ingestion strategies.
  • Troubleshoot and optimize ingestion pipelines for performance and scalability.

Required Skills & Qualifications:

  • Proven experience in data ingestion and pipeline development.
  • Hands-on experience with CI/CD tools (GitHub Actions, Jenkins, Azure DevOps, etc.).
  • Strong knowledge of Kubernetes and container orchestration.
  • Experience with Databricks, Spark, and data lake architectures.
  • Proficiency in Python, Scala, or SQL for data processing.
  • Familiarity with cloud platforms such as AWS, Azure, or GCP.
  • Strong problem-solving and analytical skills.

Preferred Qualifications:

  • Experience with Infrastructure as Code (Terraform, Helm, etc.).
  • Background in streaming data ingestion (Kafka, Kinesis, etc.).
  • Knowledge of data governance and security best practices.

  • Innovative Data Ingestion Specialist

    2 days ago

    Allahabad, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 12,00,000 - ₹ 15,00,000

    Job Title: Azure Databricks Engineer with Injection ExperienceWe are seeking an experienced engineer to lead our data ingestion efforts, utilizing expertise in CI/CD and Kubernetes. The ideal candidate will have hands-on experience with data pipelines, automation, and infrastructure management to support scalable and efficient ingestion workflows.Key...

  • Data Engineering Specialist

    19 hours ago

    Allahabad, Uttar Pradesh, India beBeeBigData Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job Title: Data Engineering SpecialistJob Overview:As a Data Engineering Specialist, you will play a pivotal role in designing and developing large-scale data processing systems using cutting-edge technologies.This challenging position requires expertise in big data technologies, including PySpark and Hive. Familiarity with Spark, HBase, and data quality...

  • Senior Data Transformation Specialist

    23 hours ago

    Allahabad, Uttar Pradesh, India beBeeDataTransformation Full time ₹ 15,00,000 - ₹ 20,00,000

    Job Title: Data Transformation SpecialistExperience: 5-7 years of experience in data transformation and quality assurance is required for this position.The role of a data transformation specialist is pivotal in ensuring the smooth functioning of data pipelines. As a key member of our team, you will be responsible for designing and executing test cases to...

  • Data Conversion Expert

    1 day ago

    Allahabad, Uttar Pradesh, India beBeeDataConversion Full time ₹ 10,00,000 - ₹ 15,00,000

    Job Title:Data Conversion ExpertAbout the Role:As a Data Conversion Specialist, you will be instrumental in ensuring data accuracy and integrity during system migrations. You will collaborate closely with stakeholders to drive data migration efforts, perform quality assurance, and enhance data processes.Your Responsibilities:Conduct data conversion,...

  • Big Data Expert

    2 days ago

    Allahabad, Uttar Pradesh, India beBeeData Full time ₹ 20,00,000 - ₹ 40,00,000

    Greetings from our organizationOur Team is Looking for a Talented Big Data ProfessionalYears of Experience: 6 - 12 yearsLocation: Pune/ Mumbai/ ChennaiNotice Period: 0 - 45 daysJob Description:We are Seeking Highly Skilled Professionals to Join Our TeamPySparkHiveKey Skills:SparkHBaseData Quality toolsAgile Scrum methodologiesData ingestion from multiple...

  • AI Expert Opportunity

    3 days ago

    Allahabad, Uttar Pradesh, India beBeeMachineLearning Full time ₹ 1,80,00,000 - ₹ 2,00,00,000

    Machine Learning Specialist OpportunityExcelgig is hiring an AI expert to contribute to impactful, large-scale AI solutions with a global team. The ideal candidate will be responsible for designing and developing custom machine learning models for business-specific problems (NLP, computer vision, predictive modeling, recommendation systems, etc.). They will...

  • Data Architect Specialist

    3 days ago

    Allahabad, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 80,00,000 - ₹ 1,20,00,000

    Data Architect SpecialistWe are seeking a Senior Data Engineer to join our team of experts in cloud-native data engineering. The ideal candidate will have deep expertise in building scalable data pipelines, implementing enterprise-grade data governance, security, and AI-powered engineering automation.

  • Data Quality Specialist

    3 days ago

    Allahabad, Uttar Pradesh, India beBeeDataQuality Full time US$ 10,000 - US$ 15,000

    Data Quality ExpertWe are seeking a highly skilled Data Quality Expert to join our team in India. The ideal candidate will have experience managing large datasets and ensuring data accuracy.Manually review financial transaction data to ensure accuracy and consistency.Collaborate closely with the Data Product team to identify and resolve data quality...

  • Data Expert

    2 days ago

    Allahabad, Uttar Pradesh, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title: Data Expert - Financial Analytics SpecialistKey Responsibilities:Develop predictive models using statistical techniques to forecast financial performance and drive business decisions.Analyze large datasets to identify trends, patterns, and insights that inform strategic planning.Collaborate with cross-functional teams to integrate data-driven...

  • Claims Expert Facets Specialist

    2 days ago

    Allahabad, Uttar Pradesh, India beBeeClaims Full time ₹ 18,00,000 - ₹ 25,00,000

    Job Title: Claims Expert Facets SpecialistWe are seeking a skilled Claims Expert Facets Specialist to join our team. As a key member of our organization, you will be responsible for creating test data within the Facets system in the Claims domain.Key Responsibilities:Develop and maintain test data within the Facets system.Collaborate with cross-functional...