DataOps Lead

3 days ago

Bengaluru India Sigmoid Full time

Job Description

As a DataOps Lead, you will be responsible for managing, design highly-scalable and Available solution for data pipelines that provides the foundation for collecting, storing, modeling, and analyzing massive data sets from multiple channels.

This position reports to Devops Architect.

Responsibilities:

- Align Sigmoid with key Client initiatives
- Interface daily with customers across leading Fortune 500 companies to understand strategic requirements
- Connect with VP and Director level clients on a regular
- Travel to client locations
- Ability to understand business requirements and tie them to technologysolutions
- Strategically support Technical Initiatives

- Design, manage & deploy highly scalable and fault-tolerant distributed components using Big data
- Ability to evaluate and choose technology stacks that best fit client data strategy and constraints
- Drive Automation and massive deployments

- Ability to drive good engineering practices from bottom up
- Develop industry leading CI/CD, monitoring and support practices inside the team
- Develop scripts to automate devops processes to reduce team effort
- Work with the team to develop automation and resolve issue

- Support TB scale pipelines

- Perform root cause analysis for production errors
- Support developers in day to day devops operations
- Excellent experience in Application support, integration development and data
- Design roster and escalation matrix for team

- Provide technical leadership and manage it day to day basis

- Guiding devops in day to day design, automation b support tasks
- Play a key role in hiring technical talents to build the future of
- Conduct training for technology stack for developers in house and outside

- Culture

- Must be a strategic thinker with the ability to think unconventional / out:of:box.
- Analytical and data driven
- Raw intellect, talent and energy are
- Entrepreneurial and Agile : understands the demands of a private, high growth
- Ability to be both a leader and hands on 'doer'.

Qualifications: -

8 - 12 years track record of relevant work experience and a computer Science or a related technical discipline is required

- Proven track record of building and shipping large-scale engineering products and/or knowledge of cloud infrastructure such as GCP/AWS preferred
- Experience in Shell, Python or any scripting language
- Experience in managing linux systems, build and release tools like jenkins
- Effective communication skills (both written and verbal)
- Ability to collaborate with a diverse set of engineers, data scientists and product managers
- Comfort in a fast-paced start-up environment

Preferred Qualification:

- Support experience in Big Data domain
- Architecting, implementing and maintaining Big Data solutions
- Experience with Hadoop ecosystem (HDFS, MapReduce, Oozie, Hive, lmpala, Spark,
- Kerberos, KAFKA, etc)
- Experience in container technologies like Docker, Kubernetes Et configuration management systems

  • DataOps Lead

    2 weeks ago

    Bengaluru, Karnataka, India Sigmoid Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    As a DataOps Lead, you will be responsible for managing, design highly-scalable and Available solution for data pipelines that provides the foundation for collecting, storing, modeling, and analyzing massive data sets from multiple channels.This position reports to Devops Architect.Responsibilities:- Align Sigmoid with key Client initiatives- Interface daily...

  • DataOps Engineer

    1 week ago

    Bengaluru, Karnataka, India Neemtree Full time

    Responsibilities :- Promote a DataOps approach to Data science, engineering, and analytics delivery processes to automate the provision of data, testing, and monitoring, and shorten CI/CD.- Collaborate with data & ML leads and create and build an optimal data pipeline architecture for the data solutions, including data science products.- Ensure the data...

  • DataOps Lead 15h Left

    2 weeks ago

    Bengaluru, Karnataka, India Sigmoid Full time

    Job DescriptionAs a DataOps Lead, you will be responsible for managing, design highly-scalable and Available solution for data pipelines that provides the foundation for collecting, storing, modeling, and analyzing massive data sets from multiple channels.This position reports to Devops Architect.Responsibilities:- Align Sigmoid with key Client initiatives-...

  • DataOps Engineer

    3 days ago

    Bengaluru, India Neemtree Full time

    Responsibilities :- Promote a DataOps approach to Data science, engineering, and analytics delivery processes to automate the provision of data, testing, and monitoring, and shorten CI/CD.- Collaborate with data & ML leads and create and build an optimal data pipeline architecture for the data solutions, including data science products.- Ensure the data...

  • Lead IT Operations Analyst

    15 hours ago

    Bengaluru, India Nalco Water Full time

    Job Description Job Role: - Senior Data Engineer or Data Platform Engineer - Depending on the organization's job title structure, it could also be titled: - Senior Production Support Engineer Data Platform - DevOps Data Engineer - DataOps Engineer Functional Area / Department: - Data Engineering / Data Platform - IT Operations / Production Support -...

  • Urgent Search! Product Engineer Lead

    15 hours ago

    India BlackRock Real Estate Full time

    Job Description Job Description: Are you passionate about Data and Analytics (D&A) and excited about how it can completely transform the way an enterprise works Do you have the strategic vision, technical expertise, and leadership skills to drive data-driven solutions Do you want to work in a dynamic, fast-growing category If so, you might be the ideal...

  • DataOps Engineer

    2 weeks ago

    Bengaluru, Karnataka, India FirstHive Full time

    Designation : Data Ops EngineerLocation : BengaluruResponsibilities : - Experience with the system development lifecycle, such as gathering and refining requirements, data analysing and data profiling, designing and implementing solution, handling sensitive data sets, production deployment, troubleshooting and data conversion, etc.- Experience in developing...

  • DataOps Engineer

    2 weeks ago

    Bengaluru, Karnataka, India FirstHive Full time ₹ 3,00,000 - ₹ 3,50,000 per year

    Designation – Data Ops EngineerLocation: BengaluruResponsibilities:Experience with the system development lifecycle, such as gathering and refining requirements, data analysing and data profiling, designing and implementing solution, handling sensitive data sets, production deployment, troubleshooting and data conversion, etc.Experience in developing ETL...

  • DataOps Engineer

    11 hours ago

    Bengaluru, India FirstHive Full time

    Designation – Data Ops Engineer Location: Bengaluru Responsibilities: Experience with the system development lifecycle, such as gathering and refining requirements, data analysing and data profiling, designing and implementing solution, handling sensitive data sets, production deployment, troubleshooting and data conversion, etc. Experience in developing...

  • Chief AI Architect

    2 weeks ago

    India beBeeAI Full time ₹ 15,00,000 - ₹ 20,00,000

    We're seeking a seasoned AI Architect to spearhead the development of cutting-edge AI/ML solutions.As a key member of our team, you'll be responsible for designing and implementing scalable, secure, and high-performance architectures on AWS for AI/ML applications.The ideal candidate will have expertise in architecting multi-tenant, enterprise-grade AI/ML...