DataOps Engineer

4 weeks ago


Bengaluru, Karnataka, India Neemtree Full time

Responsibilities :

- Promote a DataOps approach to Data science, engineering, and analytics delivery processes to automate the provision of data, testing, and monitoring, and shorten CI/CD.

- Collaborate with data & ML leads and create and build an optimal data pipeline architecture for the data solutions, including data science products.

- Ensure the data pipelines are scalable and performant, as well as create and maintain a service to connect data products.

- Create dashboards and other tools required to efficiently monitor our data and ML infrastructure, pipelines, ETL, and analytics delivery processes.

- Building an end-to-end event instrumentation and alerting system to detect and alert to any anomaly in the system or in the data.

- Assist in managing our data and ML infrastructure (upgrading, monitoring, optimising).

- Collaborate with IT DevOps engineers and participate in enterprise DevOps activities.

- Exchange your knowledge on infra and data standards with other developers and be part of our tech community. Promote the use of engineering best practices.

- Contribute to innovative POCs with our data & engineering teams.

- Remain flexible towards technology approaches to ensure that the best advantage is being taken by new technologies.

Requirements :

- Strong drive to solve problems, communicate clearly, and contribute positively to a DevOps/DataOps culture.

- Knowledge of the latest DevOps tools and practices.

- Experience with data pipelines within AWS (Glue, DataPipeline, Athena, EMR, DMS, Spark).

- Experience with Database Replication and databases like Aurora, MySQL, MariaDB, etc.

- Efficient in building CI/CD pipelines for containerized Java/Python codestack.

- Comfortable with Git workflow.

- Experience with applications deployed in AWS.

- Experience with configuration management and provisioning tools (e. g., Ansible, CloudFormation, Terraform).

- Knowledge of one or more scripting languages - Orchestration/containerisation using Docker and Kubernetes.

- Basic knowledge of data science & ML engineering.

- Bachelor's Degree in computer science or a similar degree, or Big Data Background from top-tier universities.

- Experience: 8+ years of experience.

(ref:hirist.tech)

  • Bengaluru, Karnataka, India Terralogic Software Solutions Full time

    Job DescriptionJob descriptionThe ideal candidate has an emphasis on data infrastructure to help operationalize and maintain machine learning models and pipelines. The candidate will love automating via Infrastructure as code (IaC), be comfortable with AWS cloud services, and can design and implement end-to-end data and analytic infrastructure solutions.As...

  • DataOps Lead

    1 week ago


    Bengaluru, Karnataka, India Sigmoid Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    As a DataOps Lead, you will be responsible for managing, design highly-scalable and Available solution for data pipelines that provides the foundation for collecting, storing, modeling, and analyzing massive data sets from multiple channels.This position reports to Devops Architect.Responsibilities:- Align Sigmoid with key Client initiatives- Interface daily...

  • DataOps Engineer

    1 week ago


    Bengaluru, Karnataka, India FirstHive Full time ₹ 3,00,000 - ₹ 4,00,000 per year

    Designation – Data Ops EngineerLocation: BengaluruResponsibilities:Experience with the system development lifecycle, such as gathering and refining requirements, data analysing and data profiling, designing and implementing solution, handling sensitive data sets, production deployment, troubleshooting and data conversion, etc.Experience in developing ETL...

  • DevOps Engineer

    1 day ago


    Bengaluru, Karnataka, India Lenskart Full time ₹ 2,00,000 - ₹ 12,00,000 per year

    Recruitement Drive - Lenskart is Hiring (Share it in your network to help those who are looking out for an opportunity) Im excited to share that we are currently conducting a recruitment drive to fill multiple DevOps Engineer roles across levels - from Junior to Mid-Senior positions. Were also looking for passionate individuals for Junior-level DataOps...

  • Data Engineer

    1 day ago


    Bengaluru, Karnataka, India Weekday AI Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    This role is for one of the Weekday's clientsMin Experience: 3 yearsLocation: BangaloreJobType: full-timeWe are seeking a highly skilled and motivated Data Engineer to join our data team. In this role, you will design, build, and maintain scalable data infrastructure that powers data-driven decision-making across the organization.Key Responsibilities Manage...

  • Data Engineer

    1 day ago


    Bengaluru, Karnataka, India Weekday AI Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    This role is for one of the Weekday's clientsMin Experience: 3 yearsLocation: BangaloreJobType: full-timeWe are seeking a highly skilled and motivated Data Engineer to join our data team. In this role, you will design, build, and maintain scalable data infrastructure that powers data-driven decision-making across the organization.RequirementsKey...


  • Bengaluru, Karnataka, India FirstHive | CDP+AI Data Platform Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Designation: Data Ops EngineerLocation :BengaluruResponsibilitiesExperience with the system development lifecycle, such as gathering and refining requirements, data analysing and data profiling, designing and implementing solution, handling sensitive data sets, production deployment, troubleshooting and data conversion, etc.Experience in developing ETL...

  • Data Engineer

    1 week ago


    Bengaluru, Karnataka, India First Mile Consulting Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Integrate various technologies and data sources within the Microsoft Azure ecosystemStrong proficiency in Python, SQL, and DatabricksHands-on experience with Azure data services and cloud-based data integrationFamiliarity with DataOps principles

  • Data Engineer

    1 week ago


    Bengaluru, Karnataka, India Volvo Car Manufacturing Malaysia Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    KeywordLocationShow More OptionsLoading...Search by Career AreasAllCountry/RegionAllInternational AssignmentAllClearSelect How Often (in Days) To Receive An AlertSelect how often (in days) to receive an alert:Apply now »Start apply with LinkedInApply NowPlease wait...Data EngineerSoftware, the fuel for mobilityWe bring bold digital visions to life. So we're...


  • Bengaluru, Karnataka, India The Family Office Company BSC (c) Full time ₹ 5,00,000 - ₹ 12,00,000 per year

    Join The Family Office as an Associate AI EngineerAre you a recent graduate in Computer Science, Software Engineering, or Data Science, ready to turn your passion for AI into real-world impact?We're looking for anAssociate AI Engineerto join our team atThe Family Office (TFO). This role offers hands-on experience with cutting-edge AI projects, mentorship...