Mastering Data Ingestion Pipelines

1 day ago


Rajkot, Gujarat, India beBeeEngineering Full time ₹ 80,00,000 - ₹ 1,60,00,000

Job Title:

Big Data Engineer

We are seeking an experienced Big Data Engineer to join our team. The ideal candidate will have hands-on experience with data pipelines, automation, and infrastructure management to support scalable and efficient data ingestion workflows.

Key Responsibilities:

  • Design, develop, and optimize data ingestion pipelines for integrating multiple sources into Databricks.
  • Implement and maintain CI/CD pipelines for data workflows.
  • Deploy and manage containerized applications using Kubernetes.
  • Ensure data integrity, security, and compliance throughout the ingestion process.
  • Collaborate with Data Engineers and other stakeholders to streamline data ingestion strategies.
  • Troubleshoot and optimize ingestion pipelines for performance and scalability.

Required Skills & Qualifications:

  • Proven experience in data ingestion and pipeline development.
  • Hands-on experience with CI/CD tools (GitHub Actions, Jenkins, Azure DevOps, etc.).
  • Strong knowledge of Kubernetes and container orchestration.
  • Experience with Databricks, Spark, and data lake architectures.
  • Proficiency in Python, Scala, or SQL for data processing.
  • Familiarity with cloud platforms such as AWS, Azure, or GCP.
  • Strong problem-solving and analytical skills.

Benefits:

  • Opportunity to work on complex data engineering projects.
  • Collaborative and dynamic work environment.
  • Professional growth and development opportunities.


  • Rajkot, Gujarat, India beBeeIntegration Full time ₹ 1,20,00,000 - ₹ 2,00,00,000

    Job Title:A Data Integration Specialist will design and develop scalable data ingestion pipelines for integrating multiple sources into Databricks.Main Responsibilities:Design and implement data ingestion pipelines to integrate various data sources into Databricks.Develop and maintain continuous integration and deployment pipelines for data workflows.Deploy...

  • Data Expert

    1 day ago


    Rajkot, Gujarat, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 20,00,000

    Expert Data Engineer WantedWe are seeking an experienced professional to assume the role of a Data Engineer and contribute to the successful implementation of data-driven initiatives. As a key member of our team, you will be responsible for designing, building, and optimizing data pipelines and ETL workflows.Key Responsibilities:Design, build, and optimize...

  • Data Engineer

    3 weeks ago


    Rajkot, Gujarat, India Enterprise Minds, Inc Full time

    At Enterprise Minds, we empower businesses through intelligent systems, data-driven solutions, and agile digital transformation.Headquartered in San Ramon, California, with thriving tech hubs in Hyderabad and Pune, we are a fast-growing company redefining how AI, ML, and automation drive real-world results.Why Work with Us?Innovation-First Culture:...

  • Chief Data Architect

    15 hours ago


    Rajkot, Gujarat, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    About the RoleWe are seeking a seasoned Data Engineering Expert to join our team. As a pivotal member, you will design, develop, and optimize data ingestion, transformation, and governance frameworks to enable real-time and batch data analytics across our platform.Key Responsibilities:Design and implement scalable, robust, and secure data pipelines using...


  • Rajkot, Gujarat, India beBeeData Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Senior Data EngineerAs a key member of our data engineering team, you will design, develop and govern scalable data architectures and pipelines to meet the business's ever-evolving needs.We are seeking an experienced and skilled professional with expertise in designing robust data architectures for enterprise data platforms. The ideal candidate will have a...


  • Rajkot, Gujarat, India beBeeDataIntegration Full time ₹ 90,00,000 - ₹ 1,20,00,000

    Data Integration EngineerDevelop scalable data pipelines using Azure Data Factory, Synapse Analytics, and Data Lake.Achieve seamless data ingestion and harmonization from various sources, including AWS-based data lakes/warehouses (S3, Redshift) and SAP systems.Key Responsibilities:Data Engineering & Automation: Design, build, and maintain real-time and batch...


  • Rajkot, Gujarat, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Develop highly scalable data platforms for large enterprises using modern data engineering tools and practices.Key Responsibilities:Design robust data pipelines for ingestion, transformation, and analytics.Maintain expertise in cloud-based ecosystems.Develop scalable workflows using orchestration tools.Write efficient transformation logic using...


  • Rajkot, Gujarat, India beBeeDataQuality Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Summary:The incumbent is responsible for conceptualizing and implementing master data management solutions that align with business objectives and address data quality requirements.Key Responsibilities:Designing MDM solutions to define data models and metadata structures that address data quality requirements and align with business objectives.Developing...


  • Rajkot, Gujarat, India beBeeDataEngineer Full time ₹ 12,00,000 - ₹ 24,00,000

    Key Data Engineering RoleAbout the PositionThe ideal candidate will have hands-on experience working with large-scale data processing workflows and designing efficient data engineering solutions.ResponsibilitiesJob OverviewDesign, develop, and maintain scalable ETL pipelines for batch data ingestion and egress using Azure services.Implement data...


  • Rajkot, Gujarat, India beBeeDataIntegration Full time ₹ 20,00,000 - ₹ 25,00,000

    Job TitleWe are seeking a seasoned Data Integration Professional to spearhead the development and maintenance of scalable data pipelines using IBM DataStage, AWS Glue, and Snowflake.Key Responsibilities:Design, build, and optimize ETL pipelines using IBM DataStage (CP4D) and AWS Glue/Lambda for data ingestion from various sources.Collaborate with...