Data Ingestion Strategist

5 days ago

Ghaziabad, Uttar Pradesh, India beBeeIngestion Full time ₹ 20,00,000 - ₹ 25,00,000
Lead Data Ingestion EngineerA renowned organization seeks an accomplished Data Ingestion Engineer to spearhead the development and optimization of data ingestion pipelines. This pivotal role demands a deep understanding of data ingestion processes, focusing on integrating diverse data sources into Databricks. The ideal candidate will possess hands-on experience with data pipelines, automation, and infrastructure management to support scalable and efficient ingestion workflows.
Key Responsibilities:
  • Design, develop, and optimize data ingestion pipelines for integrating multiple sources into Databricks.
  • Implement and maintain Continuous Integration/Continuous Deployment (CI/CD) pipelines for data workflows.
  • Deploy and manage containerized applications using Kubernetes.
  • Ensure data integrity, security, and compliance throughout the ingestion process.
  • Collaborate with Data Engineers and other stakeholders to streamline data ingestion strategies.
  • Troubleshoot and optimize ingestion pipelines for performance and scalability.
Required Skills & Qualifications:
  • Proven experience in data ingestion and pipeline development.
  • Hands-on experience with CI/CD tools (GitHub Actions, Jenkins, Azure DevOps, etc.).
  • Strong knowledge of Kubernetes and container orchestration.
  • Experience with Databricks, Spark, and data lake architectures.
  • Proficiency in Python, Scala, or SQL for data processing.
  • Familiarity with cloud platforms such as AWS, Azure, or GCP.
  • Strong problem-solving and analytical skills.
Benefits:
  • Opportunity to work on complex data ingestion projects.
  • Chance to collaborate with experienced Data Engineers.
  • Potential for career growth and professional development.
Other Opportunities:
  • Develop expertise in data governance and security best practices.
  • Become proficient in infrastructure as code (Terraform, Helm, etc.).

  • Advanced Data Ingestion Specialist

    6 days ago

    Ghaziabad, Uttar Pradesh, India beBeeDataIngestion Full time ₹ 1,20,00,000 - ₹ 1,50,00,000

    Job Title: Azure Databricks Engineer with Injection experienceWe are seeking a skilled professional to design, develop, and optimize data ingestion pipelines for integrating multiple sources into Databricks.Key Responsibilities:

  • High-Throughput Web Data Ingestion Specialist

    2 days ago

    Ghaziabad, Uttar Pradesh, India beBeeDataIngestion Full time ₹ 25,00,000 - ₹ 30,10,000

    Web Data Ingestion PipelineWe are building a scalable product data ingestion pipeline across numerous domains.About the Role:Crawl and scrape structured specs, images, and PDFs into our schema.The Challenge:Design a high-performance crawler with Playwright fallback for JS-heavy pages.Implement sitemap diffing and conditional GETs for incremental runs.Build a...

  • Data Analyst and Strategist

    2 weeks ago

    Ghaziabad, Uttar Pradesh, India beBeeDataAnalyst Full time ₹ 15,00,000 - ₹ 20,00,000

    Job Title: Data Analyst and StrategistWe are seeking a skilled Data Analyst and Strategist to join our team. As a Data Analyst and Strategist, you will be responsible for developing and implementing data pipelines using Python.You will work closely with the team to design, develop, and maintain data pipelines using Python, as well as create reports using...

  • Data Strategist

    1 week ago

    Ghaziabad, Uttar Pradesh, India beBeeDataStrategy Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    **Job Summary:**We are seeking a skilled Data Strategist to join our team.The ideal candidate will have expertise in machine learning, predictive modeling, and Python coding. Key responsibilities include building and deploying financial models, analyzing large datasets, and communicating complex technical concepts to both specialist and non-specialist...

  • Data Pipeline Architect

    1 week ago

    Ghaziabad, Uttar Pradesh, India beBeeData Full time ₹ 60,00,000 - ₹ 1,20,00,000

    Job Title: Data Pipeline ArchitectWe are seeking an experienced professional to design, develop, and optimize data ingestion pipelines.About the Role:Design and implement data ingestion pipelines for integrating multiple sources into Databricks.Implement and maintain CI/CD pipelines for data workflows.Deploy and manage containerized applications using...

  • Data Strategist

    7 days ago

    Ghaziabad, Uttar Pradesh, India beBeeDataStrategist Full time ₹ 20,00,000 - ₹ 40,00,000

    Data ScientistAs a data-driven organization, we are seeking a skilled Data Strategist to join our team. In this role, you will be responsible for uncovering insights from complex data sets and leveraging predictive models to drive business decisions.About the Position:The successful candidate will have a strong background in statistical modeling, machine...

  • Chief Cloud Data Strategist

    1 day ago

    Ghaziabad, Uttar Pradesh, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    Senior Data Architect PositionWe are seeking an accomplished Senior Data Architect to spearhead the development of cutting-edge data pipelines, lakehouse architectures, and high-performance data solutions. This is an exceptional opportunity for a seasoned expert in Microsoft Azure to utilize their skills in designing and optimizing scalable data systems.Key...

  • Principal Data Strategist

    4 days ago

    Ghaziabad, Uttar Pradesh, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Job OpportunityWe are seeking an experienced professional to join our team as a Senior Data Architect. As a key member, you will be responsible for designing and implementing large-scale data solutions using cloud-native technologies and big data platforms.About the Role:Data Architecture: Define data architecture blueprints for our products, including data...

  • Mastering Data Governance

    1 week ago

    Ghaziabad, Uttar Pradesh, India beBeeDataGovernance Full time ₹ 20,00,000 - ₹ 25,00,000

    Data Governance SpecialistYou will be responsible for managing and maintaining data catalogs to ensure adherence to data governance principles.Key Responsibilities:Metadata Ingestion: You will work with the Collibra Data Intelligence Platform to ingest metadata from various sources, including ETL tools, BI platforms, and databases.Data Lineage Stitching: You...

  • Cloud Data Information Strategist

    2 days ago

    Ghaziabad, Uttar Pradesh, India beBeeDataStrategist Full time ₹ 1,00,00,000 - ₹ 2,00,00,000

    Cloud Data Information Strategist Job Description:We are seeking a seasoned CLOUD DATA INFORMATION ARCHITECT to lead our team in implementing cloud data pipelines using AWS Databricks. The ideal candidate will have a strong background in AWS, with hands-on experience in implementing cloud data pipelines, and expertise in tools such as Snowflake, Python,...