Innovative Data Engineer

6 days ago


Jamnagar, Gujarat, India beBeeData Full time US$ 1,20,000 - US$ 1,40,000

Job Overview:

A Data Ingestion Specialist is required to design and develop efficient data ingestion pipelines for integrating multiple sources into Databricks. The ideal candidate will have hands-on experience with data pipelines, automation, and infrastructure management to support scalable and efficient ingestion workflows.

The role involves collaborating with Data Engineers and other stakeholders to streamline data ingestion strategies, ensuring data integrity, security, and compliance throughout the ingestion process.

Key Responsibilities:

Design and Develop Data Ingestion Pipelines

    Design, develop, and optimize data ingestion pipelines for integrating multiple sources into Databricks.

Implement and Maintain CI/CD Pipelines

    Implement and maintain CI/CD pipelines for data workflows.

Deploy and Manage Containerized Applications

    Deploy and manage containerized applications using Kubernetes.

Ensure Data Integrity and Security

    Ensure data integrity, security, and compliance throughout the ingestion process.

Troubleshoot and Optimize Ingestion Pipelines

    Troubleshoot and optimize ingestion pipelines for performance and scalability.

Required Skills & Qualifications:

Proven Experience in Data Ingestion

    Proven experience in data ingestion and pipeline development.

Hands-on Experience with CI/CD Tools

    Hands-on experience with CI/CD tools (GitHub Actions, Jenkins, Azure DevOps, etc.).

Strong Knowledge of Kubernetes

    Strong knowledge of Kubernetes and container orchestration.

Experience with Databricks and Data Lake Architectures

    Experience with Databricks, Spark, and data lake architectures.

Proficiency in Programming Languages

    Proficiency in Python, Scala, or SQL for data processing.

Familiarity with Cloud Platforms

    Familiarity with cloud platforms such as AWS, Azure, or GCP.

Strong Problem-Solving Skills

    Strong problem-solving and analytical skills.

],

  • Jamnagar, Gujarat, India beBeeInnovation Full time ₹ 1,81,25,000 - ₹ 2,02,50,000

    Drive Technology Innovation as a results-driven Engineering Manager.Key ResponsibilitiesDevelop and manage product development processes, ensuring timely delivery and high-quality outcomes.Lead cross-functional teams and assign tasks to engineering and technical personnel, leveraging your expertise in project management and team leadership.Drive innovation...


  • Jamnagar, Gujarat, India beBeeArtificial Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job DescriptionWe are seeking a highly skilled professional with expertise in artificial intelligence and machine learning to join our team. The ideal candidate will have experience in advanced AI techniques, including generative models and large language models.Key Responsibilities:Develop and implement machine learning algorithms using Python and relevant...

  • Data Innovator

    7 hours ago


    Jamnagar, Gujarat, India beBeeDataScience Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Data Scientist RoleMerging data and technology to create innovative solutions is at the heart of this role.Developing predictive models to enhance decision-making processes.Designing experiments to evaluate the effectiveness of new strategies.Creating data visualizations to facilitate cross-functional collaboration.This position requires a strong foundation...


  • Jamnagar, Gujarat, India beBeeEngineering Full time ₹ 1,80,00,000 - ₹ 2,50,00,000

    We are seeking a talented Data Engineer to join our dynamic team. As a key member of our data infrastructure, you will play a critical role in designing and implementing scalable data solutions to support our business initiatives.Job Responsibilities:Design and develop efficient data pipelines and ETL processes to ingest, transform, and store data from...


  • Jamnagar, Gujarat, India beBeeDataScience Full time ₹ 15,000 - ₹ 25,000

    Job OverviewAs a Data Science Intern, you will be responsible for developing and maintaining our machine learning engines and micro-services pipelines. This is an exciting opportunity to work with cutting-edge technologies and contribute to the advancement of society's capacity to withstand shocks and stresses.We are looking for a highly motivated and...


  • Jamnagar, Gujarat, India beBeeDataScience Full time US$ 80,000 - US$ 1,50,000

    Seeking a Data Science Innovator to drive cutting-edge commercial and research projects forward. This exciting opportunity is perfect for professionals passionate about innovation and pushing the boundaries of AI technology.Key Responsibilities:Develop and optimize Python-based data science solutions using public datasets to deliver actionable...


  • Jamnagar, Gujarat, India beBeeInnovation Full time ₹ 40,00,000 - ₹ 50,00,000

    Job Description:We are seeking a highly skilled Data Science Innovation Leader to join our team. As a key member of our organization, you will play a critical role in designing and developing cutting-edge AI solutions that drive business growth and customer satisfaction.About the Role:The ideal candidate will have extensive experience in Natural Language...


  • Jamnagar, Gujarat, India beBeeData Full time US$ 80,000 - US$ 1,50,000

    A leading organization is seeking a Data Scientist to collaborate on innovative AI-driven projects. This role offers a unique opportunity for professionals passionate about pushing the boundaries of AI technology.Key Responsibilities:Develop and optimize data science solutions using Python and public datasets.Conduct peer code reviews, ensuring best...


  • Jamnagar, Gujarat, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job DescriptionWe are seeking a skilled Big Data Engineer with expertise in Scala, Spark, Python, NiFi, and Apache Kafka to join our data engineering team.The ideal candidate will have a proven track record in building, scaling, and optimizing big data pipelines, and hands-on experience in distributed data systems and cloud-based solutions.This is an...

  • Cloud Data Engineer

    4 hours ago


    Jamnagar, Gujarat, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000

    We are seeking a talented professional to lead the design and implementation of scalable data pipelines and ETL solutions in a cloud environment. The ideal candidate will have hands-on experience with AWS services, including EMR, Glue, PySpark, Airflow, and Python.Requirements:A minimum of 5 years of experience in data engineering or related roles.Strong...