Data Ingestion Specialist

5 hours ago

Kannur, Kerala, India beBeeDataIngestion Full time ₹ 18,00,000 - ₹ 21,00,000

Data Ingestion Specialist - Seamlessly Integrate Data Sources

About the Role:

The position of a Data Ingestion Specialist plays a vital role in ensuring the smooth integration of diverse data sources into Databricks. As a key member of our team, you will be responsible for designing and developing efficient data ingestion pipelines that cater to the complex needs of our organization.

Key Responsibilities:
  • Pipeline Design and Development: Create scalable and efficient data ingestion pipelines that integrate multiple sources into Databricks.
  • Automated Pipeline Management: Implement, maintain, and optimize CI/CD pipelines for data workflows to ensure seamless automation.
  • Kubernetes Infrastructure Management: Deploy and manage containerized applications using Kubernetes to support efficient infrastructure management.
  • Data Integrity and Security: Ensure the integrity, security, and compliance of data throughout the ingestion process.
  • Collaboration and Troubleshooting: Collaborate with Data Engineers and stakeholders to streamline data ingestion strategies and troubleshoot and optimize ingestion pipelines for performance and scalability.

To succeed in this role, you should possess a strong understanding of data ingestion processes, expertise in CI/CD and Kubernetes, and hands-on experience with data pipelines, automation, and infrastructure management. Your proficiency in Python, Scala, or SQL for data processing and familiarity with cloud platforms such as AWS, Azure, or GCP will also be valuable assets. Experience with Infrastructure as Code (Terraform, Helm, etc.), background in streaming data ingestion (Kafka, Kinesis, etc.), and knowledge of data governance and security best practices are highly desirable.

Requirements:
  • Strong understanding of data ingestion processes
  • Expertise in CI/CD and Kubernetes

  • Data Ingestion Developer

    5 days ago

    Kannur, Kerala, India beBeeIngestion Full time ₹ 15,00,000 - ₹ 20,00,000

    Job Description:We are seeking a skilled Data Ingestion Specialist to oversee the design, development and optimization of data ingestion pipelines.Key Responsibilities:Analyzing and refining data ingestion processes for integrating multiple sources into Databricks.Implementing and maintaining CI/CD pipelines for data workflows using tools like GitHub Actions...

  • Ingestion Engineer

    4 days ago

    Kannur, Kerala, India Saxon Global Full time

    Hi Hope you are doing good todayKindly go through the JD and let me know your interest you can reach me at SAI.K@SAXONGLOBAL.COMTitle: Ingestion Engineer Opportunity Available for Immediate Joining Location - Anywhere from India TIMINGS - 10.00 AM IST to 7.00 PM ISTNeed good comm skills – they will be coordinating with Americans on daily basesWe are...

  • Chief Data Engineering Specialist

    2 days ago

    Kannur, Kerala, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 20,00,000

    Job TitleWe are seeking a highly skilled Data Engineer to join our team.ETL Pipeline Development: Develop and maintain ETL pipelines using FiveTran, DBT Cloud, and custom frameworks.Data Transformations: Implement client-specific data transformations for HighTouch integration.Data Ingestion and Quality Checks: Support data ingestion and quality checks during...

  • Data Engineering Specialist

    14 hours ago

    Kannur, Kerala, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 20,00,000

    Job Title: Data Engineering SpecialistWe are seeking a highly skilled and experienced data engineer to join our team.About the RoleThe ideal candidate will have a strong background in data engineering, with experience working on large-scale data pipelines and a proven track record of delivering high-quality solutions.The role will involve designing,...

  • Data Visualization Specialist

    11 hours ago

    Kannur, Kerala, India beBeeSplunkDeveloper Full time ₹ 12,00,000 - ₹ 15,00,000

    Job Title: Splunk DeveloperWe are seeking a seasoned Splunk expert to support the development and maintenance of our monitoring, alerting, and advanced analytics solutions.The ideal candidate will have strong expertise in developing, configuring, and optimizing Splunk environments to meet the needs of our organization. This includes designing and...

  • Data Engineering Lead

    1 day ago

    Kannur, Kerala, India beBeeDataEngineering Full time ₹ 12,00,000 - ₹ 21,60,000

    Job Title: Data Engineering LeadTo succeed in this pivotal role, you will be responsible for crafting data ingestion and transformation frameworks that fuel real-time and batch analytics across our data platform.The ideal candidate will have extensive expertise in building large-scale data pipelines, implementing enterprise-grade data governance, security,...

  • Data Platform Architect

    5 days ago

    Kannur, Kerala, India beBeeSnowflake Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Platform LeadWe are seeking a seasoned technology leader to spearhead the development and deployment of our multitenant modern data platform.This role requires hands-on experience in managing Snowflake environments, designing data pipeline orchestration, enforcing platform standards, and ensuring observability, performance, and security across...

  • Senior Data Solutions Architect

    16 hours ago

    Kannur, Kerala, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Data EngineerAs a seasoned data engineer, you will play a pivotal role in designing, developing, and maintaining large-scale data pipelines. Your expertise in architecting scalable data solutions will drive business growth and inform strategic decision-making.Key Responsibilities:Develop and maintain ETL/ELT data pipelines to ingest data from various sources...

  • Data Analytics Specialist

    2 days ago

    Kannur, Kerala, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    Job Title: Data Analytics Specialist

  • Databricks Pipeline Developer

    2 days ago

    Kannur, Kerala, India beBeePipeline Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Databricks Pipeline Developer We seek an experienced Databricks pipeline developer to design and implement robust data ingestion pipelines for integrating multiple sources into Databricks.Key Responsibilities:Develop high-performance data ingestion pipelines for integrating multiple sources into Databricks.Implement and maintain continuous...