DataOps Engineer

3 days ago

Bengaluru, India Neemtree Full time

Responsibilities :

- Promote a DataOps approach to Data science, engineering, and analytics delivery processes to automate the provision of data, testing, and monitoring, and shorten CI/CD.

- Collaborate with data & ML leads and create and build an optimal data pipeline architecture for the data solutions, including data science products.

- Ensure the data pipelines are scalable and performant, as well as create and maintain a service to connect data products.

- Create dashboards and other tools required to efficiently monitor our data and ML infrastructure, pipelines, ETL, and analytics delivery processes.

- Building an end-to-end event instrumentation and alerting system to detect and alert to any anomaly in the system or in the data.

- Assist in managing our data and ML infrastructure (upgrading, monitoring, optimising).

- Collaborate with IT DevOps engineers and participate in enterprise DevOps activities.

- Exchange your knowledge on infra and data standards with other developers and be part of our tech community. Promote the use of engineering best practices.

- Contribute to innovative POCs with our data & engineering teams.

- Remain flexible towards technology approaches to ensure that the best advantage is being taken by new technologies.

Requirements :

- Strong drive to solve problems, communicate clearly, and contribute positively to a DevOps/DataOps culture.

- Knowledge of the latest DevOps tools and practices.

- Experience with data pipelines within AWS (Glue, DataPipeline, Athena, EMR, DMS, Spark).

- Experience with Database Replication and databases like Aurora, MySQL, MariaDB, etc.

- Efficient in building CI/CD pipelines for containerized Java/Python codestack.

- Comfortable with Git workflow.

- Experience with applications deployed in AWS.

- Experience with configuration management and provisioning tools (e. g., Ansible, CloudFormation, Terraform).

- Knowledge of one or more scripting languages - Orchestration/containerisation using Docker and Kubernetes.

- Basic knowledge of data science & ML engineering.

- Bachelor's Degree in computer science or a similar degree, or Big Data Background from top-tier universities.

- Experience: 8+ years of experience.


(ref:hirist.tech)

  • DataOps Engineer

    1 week ago

    Bengaluru, Karnataka, India Neemtree Full time

    Responsibilities :- Promote a DataOps approach to Data science, engineering, and analytics delivery processes to automate the provision of data, testing, and monitoring, and shorten CI/CD.- Collaborate with data & ML leads and create and build an optimal data pipeline architecture for the data solutions, including data science products.- Ensure the data...

  • Senior DataOps Engineer

    4 days ago

    Bengaluru, Karnataka, India Terralogic Software Solutions Full time

    Job DescriptionJob descriptionThe ideal candidate has an emphasis on data infrastructure to help operationalize and maintain machine learning models and pipelines. The candidate will love automating via Infrastructure as code (IaC), be comfortable with AWS cloud services, and can design and implement end-to-end data and analytic infrastructure solutions.As...

  • DataOps Engineer

    3 days ago

    Bengaluru, India TESTQ Technologies Limited Full time

    Role : DataOps EngineerLocation : Bengaluru, Karnataka, IndiaPosition Type : PermanentExperience Level : 6 - 8 YearsAbout the Role : We are hiring a DataOps Engineer to manage data platform infrastructure, ensure network security, and streamline CI/CD for analytics and engineering teams.Key Responsibilities : - Manage and maintain data platform...

  • DataOps Lead

    3 days ago

    Bengaluru, India Sigmoid Full time

    Job Description As a DataOps Lead, you will be responsible for managing, design highly-scalable and Available solution for data pipelines that provides the foundation for collecting, storing, modeling, and analyzing massive data sets from multiple channels. This position reports to Devops Architect. Responsibilities: - Align Sigmoid with key Client...

  • DataOps Lead

    2 weeks ago

    Bengaluru, Karnataka, India Sigmoid Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    As a DataOps Lead, you will be responsible for managing, design highly-scalable and Available solution for data pipelines that provides the foundation for collecting, storing, modeling, and analyzing massive data sets from multiple channels.This position reports to Devops Architect.Responsibilities:- Align Sigmoid with key Client initiatives- Interface daily...

  • DataOps Lead 15h Left

    2 weeks ago

    Bengaluru, Karnataka, India Sigmoid Full time

    Job DescriptionAs a DataOps Lead, you will be responsible for managing, design highly-scalable and Available solution for data pipelines that provides the foundation for collecting, storing, modeling, and analyzing massive data sets from multiple channels.This position reports to Devops Architect.Responsibilities:- Align Sigmoid with key Client initiatives-...

  • DataOps Engineer

    2 weeks ago

    Bengaluru, Karnataka, India FirstHive Full time

    Designation : Data Ops EngineerLocation : BengaluruResponsibilities : - Experience with the system development lifecycle, such as gathering and refining requirements, data analysing and data profiling, designing and implementing solution, handling sensitive data sets, production deployment, troubleshooting and data conversion, etc.- Experience in developing...

  • DataOps Engineer

    2 weeks ago

    Bengaluru, Karnataka, India FirstHive Full time ₹ 3,00,000 - ₹ 3,50,000 per year

    Designation – Data Ops EngineerLocation: BengaluruResponsibilities:Experience with the system development lifecycle, such as gathering and refining requirements, data analysing and data profiling, designing and implementing solution, handling sensitive data sets, production deployment, troubleshooting and data conversion, etc.Experience in developing ETL...

  • DataOps Engineer

    7 hours ago

    Bengaluru, India FirstHive Full time

    Designation – Data Ops Engineer Location: Bengaluru Responsibilities: Experience with the system development lifecycle, such as gathering and refining requirements, data analysing and data profiling, designing and implementing solution, handling sensitive data sets, production deployment, troubleshooting and data conversion, etc. Experience in developing...

  • Dataops

    1 week ago

    Bengaluru, Karnataka, India NdimensionZ Full time

    -1-3 years As per industry standards | | Full time Bengaluru - 77 Days Ago - No of vacancies: 5 **Job description** - what you will do: - as an integral part of the data engineering team, onboard various data sources by - creating ETL pipelines - you will provide resolutions and/ or workaround to data pipeline related - queries/issues as appropriate - you...