Data Ingestion Strategist

2 weeks ago

Morādābād, Uttar Pradesh, India beBeeDataIngestion Full time ₹ 15,00,000 - ₹ 25,00,000
Job Title: Data Ingestion Specialist

We are seeking an experienced professional to lead our data ingestion efforts. This role requires a strong understanding of data pipelines, focusing on integrating various data sources into Databricks.

The ideal candidate will have hands-on experience with data processing, automation, and infrastructure management to support scalable and efficient ingestion workflows.

Key Responsibilities:
  • Design, develop, and optimize data ingestion pipelines for integrating multiple sources into Databricks.
  • Implement and maintain Continuous Integration/Continuous Deployment (CI/CD) pipelines for data workflows.
  • Deploy and manage containerized applications using Kubernetes.
  • Ensure data integrity, security, and compliance throughout the ingestion process.
  • Collaborate with Data Engineers and other stakeholders to streamline data ingestion strategies.
  • Troubleshoot and optimize ingestion pipelines for performance and scalability.

Required Skills & Qualifications:

  • Proven experience in data ingestion and pipeline development.
  • Hands-on experience with CI/CD tools such as GitHub Actions, Jenkins, and Azure DevOps.
  • Strong knowledge of Kubernetes and container orchestration.
  • Experience with Databricks, Apache Spark, and data lake architectures.
  • Proficiency in programming languages such as Python, Scala, or SQL for data processing.
  • Familiarity with cloud platforms including AWS, Azure, or Google Cloud Platform.
  • Strong problem-solving and analytical skills.

Preferred Qualifications:

  • Experience with Infrastructure as Code (IaC) tools like Terraform or Helm.
  • Background in streaming data ingestion technologies such as Apache Kafka or Amazon Kinesis.
  • Knowledge of data governance and security best practices.

  • Data Strategy Leader

    1 week ago

    Morādābād, Uttar Pradesh, India beBeeDataStrategy Full time ₹ 45,00,000 - ₹ 55,00,000

    Senior Finance Data StrategistWe are seeking an experienced Senior Finance Data Strategist to help clients reinvent their corporate finance function by leveraging advanced analytics.

  • Chief Data Strategist

    2 weeks ago

    Morādābād, Uttar Pradesh, India beBeeDataArchitect Full time ₹ 15,00,000 - ₹ 25,00,000

    Job OpportunityWe are seeking a seasoned Data Architect to join our team. As a key member of our organization, you will be responsible for designing and implementing end-to-end data architecture solutions leveraging Snowflake and Matillion for data ingestion, transformation, and storage. Your expertise will play a crucial role in shaping our data strategy...

  • Data Engineer

    2 weeks ago

    Morādābād, Uttar Pradesh, India beBeeData Full time ₹ 15,00,000 - ₹ 22,50,000

    Job Title: Analytics SpecialistWe are seeking a highly skilled Analytics Specialist to join our data engineering team. The successful candidate will be responsible for designing, building, and maintaining scalable and reusable data models using tools like dbt (Data Build Tool). As a key member of the team, you will work closely with data engineers to ingest...

  • Senior Data Migration Expert

    2 weeks ago

    Morādābād, Uttar Pradesh, India beBeeDataMigration Full time ₹ 15,00,000 - ₹ 20,00,000

    Job DescriptionWe are seeking a skilled Data Migration Specialist to join our team. This is a critical role that requires hands-on experience with data migration, ETL pipelines, and diverse database systems.The successful candidate will be responsible for migrating ETL pipelines and plugins from Fivetran into Nexla/Snowflake, building automation for...

  • Chief Data Architect

    2 weeks ago

    Morādābād, Uttar Pradesh, India beBeeDatabase Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    High-Performance Database Expert WantedWe are seeking a highly skilled database expert to design, develop and maintain high-performance database systems for handling vast volumes of financial market data.Key Responsibilities:Design and implement database schemas for storing time-series financial data.Develop ETL processes for ingesting real-time market...

  • Senior Azure Data Engineer

    2 weeks ago

    Morādābād, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 25,00,000

    Job Title: Senior Azure Data EngineerWe are seeking a skilled Senior Azure Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining large-scale data pipelines using Azure technologies such as Azure Data Factory, Databricks, and PySpark.Your expertise in data modeling,...

  • Cloud Data Solutions Engineer

    2 weeks ago

    Morādābād, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 1,80,00,000 - ₹ 2,40,00,000

    Job DescriptionWe are seeking an experienced Cloud Data Solutions Engineer to join our team. As a key member of our data engineering group, you will design and implement scalable data pipelines using Azure services.Key Responsibilities:Data Pipeline Development: Design and build efficient ETL/ELT pipelines using Azure Data Factory (ADF), Azure Databricks...

  • Chief Data Processing Specialist

    2 weeks ago

    Morādābād, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 12,00,000 - ₹ 18,00,000

    Senior Data Engineer with GCPWe are seeking a highly skilled data professional to design, develop, and maintain large-scale data processing systems.The ideal candidate will have extensive experience in designing, developing, and maintaining large-scale data processing systems using Google Cloud services.Create efficient ETL pipelines utilizing GCP Cloud...

  • Senior IoT Data Solutions Specialist

    2 weeks ago

    Morādābād, Uttar Pradesh, India beBeeDataEngineering Full time ₹ 20,00,000 - ₹ 25,00,000

    Job OpportunityWe are seeking a specialist with 5-7 years of experience in AWS IoT Data Engineering and strong Python skills to design and implement scalable IoT data solutions.The ideal candidate will have hands-on experience in designing, developing, and deploying scalable IoT data pipelines using AWS services.Key Responsibilities:Design, develop, and...

  • Data Strategist

    2 weeks ago

    Morādābād, Uttar Pradesh, India beBeeDataScience Full time US$ 1,20,000 - US$ 2,00,000

    Unlock Business Insights with Data ScienceAs a highly skilled data science professional, you will be responsible for conducting in-depth analysis to inform business decisions across various domains. Your expertise will drive strategic growth and help our organization stay ahead of the curve.Key Responsibilities:Develop and implement analytical solutions that...