Data and DevOps Engineer

2 months ago

India Staffing Ninja Full time

Job Title: Data & DevOps Engineer


About:

Our client is a pioneering company that employs AI-driven technology to provide businesses with rapid concept and campaign validation. Our state-of-the-art platform utilizes AI and advanced techniques to generate virtual environments that simulate real-world consumer behavior. We are seeking an experienced Senior Deep Learning Engineer to lead our team, manage projects, and help us scale our unique platform.


Responsibilities:

1. Design, build, and maintain scalable data pipelines for generative AI-powered applications and real-time data ingestion systems.

2. Collaborate with the AI engineering teams to build robust and well-architected software systems, ensuring smooth integration with both relational and non-relational databases.

3. Optimize and scale database solutions to handle high-volume data flows, ensuring efficient performance and reliability.

4. Scale and maintain infrastructure using containerization (Docker, Kubernetes) to deploy, manage, and monitor AI applications.

5. Set up and maintain monitoring and observability stacks (e.g., Grafana, Prometheus, ELK stack) to ensure the stability and performance of the data pipelines.

6. Work with cloud engineering services (AWS, GCP, Azure) to scale data pipelines and infrastructure, ensuring cost-effectiveness and reliability.

7. Automate infrastructure deployments using CI/CD pipelines.


Requirements:

1. 5-5+ years of experience in data engineering, with a focus on building and maintaining scalable data pipelines and database integrations.

2. Proficiency in Python (preferred) or similar programming languages, especially for data processing (e.g., Pandas, Spark).

3. Experience with SQL and relational databases (e.g., PostgreSQL), including performance optimization and scalability.

4. Strong understanding of data engineering principles, including data integration, pipeline reliability, and scaling to handle high-volume data.\

5. Solid understanding of software engineering principles, including modularity, scalability, version control, and testing for building robust, maintainable systems.

6. Hands-on experience with cloud services (AWS, GCP, or Azure) for data architecture, infrastructure scaling, and cost management.

7. Experience with containerization (Docker) and container orchestration (Kubernetes) for deploying and managing applications.

8. Solid foundation in statistics and data analysis to support data-driven decision-making.

9. Ability to learn new technologies quickly and thrive in a fast-changing startup environment.


Nice-to-Have Qualifications:

1. Experience with non-relational databases (e.g., MongoDB).

2. Understanding of MLOps/LLMOps practices, particularly around deploying, monitoring, and scaling machine learning or large language models.

3. Experience with web scraping tools and libraries for real-time data ingestion.

4. Familiarity with monitoring and observability tools (e.g., Grafana, Prometheus, ELK stack) to ensure stability and performance of data-driven systems.

5. Familiarity with modern deep learning techniques, especially transformer models and their applications.

6. Familiarity with infrastructure as code (IaC) tools, such as Terraform or CloudFormation, for automating cloud infrastructure management.

  • DevOps Data Engineer

    2 weeks ago

    Anywhere in India/Multiple Locations Dotflick Solutions Full time

    Job Description: We are seeking a highly skilled DevOps Data Engineer to join our team at Dotflick Solutions. As a DevOps Data Engineer, you will be responsible for setting up tools and required infrastructure, defining and setting development, test, release, update, and support processes for DevOps operation, and ensuring the security and compliance of the...

  • DevOps Engineer

    3 weeks ago

    india SourceBae Full time

    Job Title: DevOps Engineer with Data and Azure ExpertiseLocation: RemoteExperience: 6+ yearsKey Skills: Classic Pipeline, PowerShell, YAML, Bicep, ARM Template/Terraform, CI/CD, Azure Data Lake & AnalyticsMost Important Skills: Data background with Azure & PowerShellJob Description:We are seeking a skilled DevOps Engineer with a strong background in Azure...

  • DevOps Engineer

    3 weeks ago

    India SourceBae Full time

    Job Title : DevOps Engineer with Data and Azure Expertise Location : Remote Experience : 6+ years Key Skills : Classic Pipeline, PowerShell, YAML, Bicep, ARM Template/Terraform, CI/CD, Azure Data Lake & Analytics Most Important Skills : Data background with Azure & PowerShell Job Description: We are seeking a skilled DevOps Engineer with a...

  • DevOps & Data Engineer

    5 months ago

    Anywhere in India/Multiple Locations, IN Dotflick Solutions Full time

    Profile : DevOps and Data EngineerJob description : This role is a Hybrid DevOps and Data Engineering.Mode : WFO/WFHRoles & responsibilities : - Setting up tools and required infrastructure- Defining and setting development, test, release, update, and support processes for DevOps operation- Have the technical skill to review, verify, and validate the...

  • DevOps Engineer

    2 weeks ago

    India SourceBae Full time

    Job Title : DevOps Engineer with Data and Azure Expertise Location : Remote Experience : 6+ years Key Skills : Classic Pipeline, PowerShell, YAML, Bicep, ARM Template/Terraform, CI/CD, Azure Data Lake & Analytics Most Important Skills : Data background with Azure & PowerShell Job Description: We are seeking a skilled DevOps Engineer ...

  • DevOps Engineer

    2 weeks ago

    india SourceBae Full time

    Job Title : DevOps Engineer with Data and Azure Expertise Location : Remote Experience : 6+ years Key Skills : Classic Pipeline, PowerShell, YAML, Bicep, ARM Template/Terraform, CI/CD, Azure Data Lake & Analytics Most Important Skills : Data background with Azure & PowerShell Job Description: We are seeking a skilled DevOps Engineer with a strong background...

  • Data and DevOps Engineer

    2 months ago

    India Staffing Ninja Full time

    Job Title: Data & DevOps Engineer About: Our client is a pioneering company that employs AI-driven technology to provide businesses with rapid concept and campaign validation. Our state-of-the-art platform utilizes AI and advanced techniques to generate virtual environments that simulate real-world consumer behavior. We are seeking an experienced Senior...

  • Azure DevOps Engineer

    3 weeks ago

    India YALLO Retail | Strategy & Talent Unified Full time

    Location: Remote Job type: 6 months contract (extendable) Job Summary: As an Azure DevOps Engineer, you will be responsible for designing, implementing, and managing CI/CD pipelines, as well as maintaining our Azure environments. A strong background in Azure Data Factory and Azure Databricks is essential to support our data engineering efforts and drive...

  • Azure DevOps Engineer

    3 weeks ago

    india YALLO Retail | Strategy & Talent Unified Full time

    Location: RemoteJob type: 6 months contract (extendable)Job Summary:As an Azure DevOps Engineer, you will be responsible for designing, implementing, and managing CI/CD pipelines, as well as maintaining our Azure environments. A strong background in Azure Data Factory and Azure Databricks is essential to support our data engineering efforts and drive data...

  • DevOps Engineer

    3 weeks ago

    india Marx Enterprise Transformation Architecture Full time

    Job Title: Azure DevOps EngineerPosition Type: Full-TimeExperience Required: 8-10 yearsJob Description:We are seeking an experienced Azure DevOps Engineer to join our innovative team. The ideal candidate will have 8-10 years of experience in DevOps with a strong focus on security within Microsoft Azure environments. This role involves designing,...

  • DevOps Engineer

    3 weeks ago

    India Marx Enterprise Transformation Architecture Full time

    Job Title: Azure DevOps Engineer Position Type: Full-Time Experience Required: 8-10 years Job Description: We are seeking an experienced Azure DevOps Engineer to join our innovative team. The ideal candidate will have 8-10 years of experience in DevOps with a strong focus on security within Microsoft Azure environments. This role involves designing,...

  • Lead DevOps Engineer

    3 weeks ago

    India HiroJet Full time

    Lead DevOps Engineer Location - Remote About The Company We are a Bay-Area (California) based security data platform that enables teams to be more effective by building the infrastructure modern security teams need to most effectively use their security data. Through its AI-enabled “Security Engineer” (SE), the company is able to reduce analyst...

  • Azure DevOps Engineer

    3 weeks ago

    India YALLO Retail | Strategy & Talent Unified Full time

    Location: RemoteJob type: 6 months contract (extendable)Job Summary:As an Azure DevOps Engineer, you will be responsible for designing, implementing, and managing CI/CD pipelines, as well as maintaining our Azure environments. A strong background in Azure Data Factory and Azure Databricks is essential to support our data engineering efforts and drive data...

  • Azure DevOps Engineer

    3 weeks ago

    India YALLO Retail | Strategy & Talent Unified Full time

    Location: Remote Job type: 6 months contract (extendable) Job Summary: As an Azure DevOps Engineer, you will be responsible for designing, implementing, and managing CI/CD pipelines, as well as maintaining our Azure environments. A strong background in Azure Data Factory and Azure Databricks is essential to support our data engineering efforts and drive...

  • Lead DevOps Engineer

    3 weeks ago

    india HiroJet Full time

    Lead DevOps Engineer Location - RemoteAbout The CompanyWe are a Bay-Area (California) based security data platform that enables teams to be more effective by building the infrastructure modern security teams need to most effectively use their security data. Through its AI-enabled “Security Engineer” (SE), the company is able to reduce analyst workloads...

  • GCP DevOps Engineer

    4 weeks ago

    India Enterprise Minds, Inc Full time

    About Enterprise Minds, IncWe are a Product Engineering company headquartered in San Francisco, with offices in India. Our team has extensive experience in Digital experience, Data engineering, DevOps engineering, AI/ML with Product companies across US and India.Job DescriptionWe are seeking a Lead DevOps Engineer with a solid foundation in Google Cloud...

  • GCP DevOps Engineer

    3 weeks ago

    india Enterprise Minds, Inc Full time

    About us:Enterprise Minds India is a Product Engineering company headquartered in San Francisco, In India Bangalore. Hyderabad and Pune, Tirupati, Puducherry. The company was established in 2017 and has worked extensively in Digital experience, Data engineering, DevOps engineering, AI/ML with Product companies across US and India. We are spread across...

  • DevOps Engineer with Azure Expertise

    4 weeks ago

    India SourceBae Full time

    Job Title: DevOps Engineer with Azure ExpertiseWe are seeking a skilled DevOps Engineer with a strong background in Azure Data Services and PowerShell automation. The ideal candidate will have extensive experience with DevOps practices, including CI/CD pipelines, infrastructure as code (IaC) tools, and working with Azure's data and analytics technologies.Key...

  • GCP DevOps Engineer

    3 weeks ago

    India Enterprise Minds, Inc Full time

    About us: Enterprise Minds India is a Product Engineering company headquartered in San Francisco, In India Bangalore. Hyderabad and Pune, Tirupati, Puducherry. The company was established in 2017 and has worked extensively in Digital experience, Data engineering, DevOps engineering, AI/ML with Product companies across US and India. We are spread across...

  • DevOps Engineer with Azure Expertise

    3 weeks ago

    India SourceBae Full time

    Job Title : DevOps Engineer with Azure Expertise Location : Remote Experience : 6+ years Key Skills : Classic Pipeline, PowerShell, YAML, Bicep, ARM Template/Terraform, CI/CD, Azure Data Lake & Analytics Most Important Skills : Data background with Azure & PowerShell Job Description: We are seeking a skilled DevOps Engineer with a strong background in Azure...