Optimizing Data Flows

1 day ago

Guntur, Andhra Pradesh, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000
Senior Data Ingestion Specialist

We are seeking an experienced Senior Data Ingestion Specialist to optimize our data ingestion workflows. This role involves designing, developing, and maintaining scalable and efficient data pipelines for integrating multiple sources into Databricks.

Key Responsibilities:
  • Design and develop data ingestion pipelines using industry-leading tools and technologies.
  • Implement and maintain Continuous Integration/Continuous Deployment (CI/CD) pipelines for data workflows.
  • Deploy and manage containerized applications using Kubernetes.
  • Ensure data integrity, security, and compliance throughout the ingestion process.
  • Collaborate with Data Engineers and other stakeholders to streamline data ingestion strategies.
  • Troubleshoot and optimize ingestion pipelines for performance and scalability.
Required Skills & Qualifications:
  • Proven experience in data ingestion and pipeline development.
  • Hands-on experience with CI/CD tools such as GitHub Actions, Jenkins, Azure DevOps, etc.
  • Strong knowledge of Kubernetes and container orchestration.
  • Experience with Databricks, Spark, and data lake architectures.
  • Proficiency in Python, Scala, or SQL for data processing.
  • Familiarity with cloud platforms such as AWS, Azure, or GCP.
  • Strong problem-solving and analytical skills.
  • Preferred Qualifications:
  • Experience with Infrastructure as Code (Terraform, Helm, etc.).
  • Background in streaming data ingestion (Kafka, Kinesis, etc.).
  • Knowledge of data governance and security best practices.

  • Chief Data Optimization Specialist

    3 days ago

    Guntur, Andhra Pradesh, India beBeeDataIntegrity Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Optimize Data Integrity and Drive Process InnovationThis is a role that will challenge you to improve data accuracy and integrity.Responsibilities:Identify opportunities for optimization, scalability, and/or automationManage and communicate optimization projects end to endMaintain steady progress on open projectsProvide effective and frequent communication...

  • Optimize Supply Chain Flow

    2 days ago

    Guntur, Andhra Pradesh, India beBeeWarehouse Full time ₹ 10,00,000 - ₹ 15,00,000

    As a Warehouse Management Specialist, you will design, build, and implement WMS solutions to drive operational efficiency.Key Responsibilities:WMS Solution Design: Document the design, including configuration, technical, and code changes.Inventory Management: Manage inbound receipts, replenishment, outbound logistics, internal warehouse transfers, inventory...

  • Senior Data Engineer

    3 weeks ago

    Guntur, Andhra Pradesh, India Aptus Data Labs Full time

    Job Title: Senior Data EngineerLocation: RemoteExperience: 4+Employment Type: Full-TimeNotice- Looking for immediate joiners or who can join within 15-20 days.About the RoleAptus Data Labs is looking for a talented and proactive Senior Data Engineer to help build the backbone of our enterprise data and AI initiatives. You'll work on modern data lake...

  • Senior Data Integration Specialist

    3 days ago

    Guntur, Andhra Pradesh, India beBeeData Remote Work Freelance Full time ₹ 12,00,000 - ₹ 17,00,000

    Cloud Solutions DeveloperWe are seeking an experienced Cloud Solutions Developer to design and implement cloud-based solutions using Azure and Google Cloud platforms.This is a key role in our team, responsible for automating data pipelines to facilitate efficient data flow and processing.Design and implement cloud-based solutions using Azure and Google Cloud...

  • Finance Executive – Cash Flow Specialist

    3 days ago

    Guntur, Andhra Pradesh, India beBeeReceivable Full time ₹ 10,00,000 - ₹ 15,00,000

    About Pinch: At Pinch, we transform everyday home management into seamless experiences. Our dedicated lifestyle managers and specialists ensure meticulous attention to detail, handling everything from housekeeping and groceries to personalized home needs.Role Summary: We're looking for a proactive finance executive to join our team. You'll manage critical...

  • Chief Data Strategist

    6 days ago

    Guntur, Andhra Pradesh, India beBeeDataArchitect Full time ₹ 10,00,000 - ₹ 15,00,000

    Job Title: Data ArchitectWe are seeking an experienced and skilled Data Architect to join our organization. The successful candidate will be responsible for designing, building, and maintaining scalable data systems.The ideal candidate will have expertise in data integration, processing, and storage. They should also have knowledge of data optimization...

  • Senior Data Architect

    1 week ago

    Guntur, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    Job DescriptionWe are seeking a talented Data Engineer to design, build and maintain scalable data pipelines for data ingestion, processing and storage. The ideal candidate will have expertise in data integration, processing and storage, as well as experience with cloud data platforms and their data services.The successful candidate will be responsible for...

  • Transformative Data Integration Expert

    3 days ago

    Guntur, Andhra Pradesh, India beBeeData Full time ₹ 11,00,000 - ₹ 17,00,000

    Unlock your career potential in data integration and ETL.As a Freelance Azure Data Factory Specialist, you'll drive business growth by leveraging strong expertise in Azure ADF pipelines, data orchestration, and transformations.Key Responsibilities:Design, build, and maintain scalable and secure data pipelines for ETL and ELT processes ensuring smooth and...

  • Chief Data Engineering Specialist

    6 days ago

    Guntur, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 1,00,00,000 - ₹ 2,00,00,000

    Key Data Engineer RoleWe are looking for an experienced data engineer with strong expertise in designing and building scalable data pipelines using various tools and technologies. This is a key role that requires hands-on experience in Snowflake, AWS Lambda, Glue, DBT, and SQL to drive business success.About the JobIn this position, you will be responsible...

  • Senior Data Streaming Expert

    4 days ago

    Guntur, Andhra Pradesh, India beBeeStreaming Full time ₹ 18,00,000 - ₹ 25,00,000

    Job Title: Senior Data Streaming ExpertWe are seeking a seasoned expert to lead our data streaming efforts. As a key member of our team, you will be responsible for deploying and managing production-grade Kafka clusters, ensuring high availability and fault tolerance.Data Cluster Management: Deploy and upgrade Kafka clusters using tools like Ansible and...