Lead DataOps Engineer

4 weeks ago


Pune, India RS Consulting Full time

Job Title: Lead DataOps Engineer

Location: Pune, India

Experience: 10+ Years


Job Description: As a DataOps Engineer, you will be responsible for managing data operations in a Cloud Data Lakehouse environment. You will lead the DataOps team and ensure the smooth functioning of the Azure Databricks Data & Analytics platform.


Key Responsibilities:

  1. Build the DataOps team and run day-to-day operations of the Azure Databricks Data & Analytics platform.
  2. Ensure data pipelines run smoothly and efficiently.
  3. Guarantee service availability and data availability as per SLA.
  4. Implement proactive monitoring and follow-up actions to ensure accuracy, timeliness, and completeness of data.
  5. Ensure adherence to security guidelines and audit control measures.
  6. Investigate, analyze, and resolve data/batch incidents within SLA.
  7. Conduct root cause analysis (RCA) and implement proactive preventive measures.
  8. Provide technical advice to the team and assist in issue resolution with strong competency in Cloud and Databricks.
  9. Provide on-call support and after-hours/weekend support as needed.
  10. Participate in Major Incident calls and lead the team for incident resolution.
  11. Fulfill service requests related to the Data Analytics platform.
  12. Plan and execute regular housekeeping, maintenance, and capacity management activities.
  13. Own and drive modern Data Operations.
  14. Develop and maintain operational-related SOPs and guidelines.
  15. Collaborate with other IT divisions and relevant vendors to participate in Group IT initiatives.


Qualifications:

  • Minimum 10 years of experience in the data analytics field.
  • At least 6 years of experience in running operations and support in a Cloud Data Lakehouse environment.
  • Proficiency in Azure Databricks.
  • Strong experience in building and optimizing data pipelines and architectures.
  • Excellent programming skills in Scala or Python.
  • Ability to troubleshoot and optimize complex queries on the Spark platform.
  • Knowledge of data access and storage techniques for both structured and unstructured data.
  • Experience with DevOps tools and environments.


Technical / Professional Skills:

  • Azure Databricks
  • Python / Scala / Java
  • HIVE / HBase / Impala / Parquet
  • Sqoop, Kafka, Flume
  • SQL and RDBMS
  • Airflow
  • Jenkins / Bamboo
  • Github / Bitbucket
  • Nexus


  • Lead DataOps Engineer

    3 weeks ago


    pune, India RS Consulting Full time

    Job Title: Lead DataOps EngineerLocation: Pune, IndiaExperience: 10+ YearsJob Description: As a DataOps Engineer, you will be responsible for managing data operations in a Cloud Data Lakehouse environment. You will lead the DataOps team and ensure the smooth functioning of the Azure Databricks Data & Analytics platform.Key Responsibilities:Build the...

  • Lead DataOps Engineer

    3 weeks ago


    Pune, India RS Consulting Full time

    Job Title: Lead DataOps Engineer Location: Pune, India Experience: 10+ Years Job Description: As a DataOps Engineer, you will be responsible for managing data operations in a Cloud Data Lakehouse environment. You will lead the DataOps team and ensure the smooth functioning of the Azure Databricks Data & Analytics platform. Key Responsibilities: Build...

  • DataOps Engineer

    4 months ago


    Hyderabad/Pune/Bangalore, India iMind Your Business Solutions Private Limited Full time

    We are hiring data operations engineers for the leaders in analytics and cloud applications, headquartered in San Francisco with offices in India.Our client provides strategic guidance and technology systems for clients wishing to solve their most complex and interesting business challenges involving cloud applications, big data, business intelligence, and...


  • Pune, India Leading executive search firm Full time

    Job Description :- Responsible for steering the investments made in our data and analytics platforms and underlying infrastructure to enable new or enhance existing capabilities with strong collaboration with data product management, data architecture, governance and engineering teams to achieve our shared goals and the desire to drive our emerging data...


  • Pune, India LEAD School Full time

    Company Description LEAD Group is India's largest and fastest-growing School Edtech company dedicated to transforming schools through innovative, technology-driven solutions. With a mission to provide excellent education to every child in India, LEAD Group revolutionizes the learning experience for students and enhances teaching effectiveness in over 8000...

  • CRM- Agm

    3 months ago


    Pune, India ENGINEER HORIZON Full time

    **Job Title**:Assistant General Manager (AGM) - CRM (Customer Relationship Management) **Job Type**: Full-time **No of openings**: 01 **Location**: Baner, Pune **Industry**: Real Estate preferred **Education**: Bachelor's degree in Human Resources, Organizational Development, or a related field (Master's degree preferred). **Experience**: 10-15...

  • Solar Sales Executive

    2 weeks ago


    Pune, Maharashtra, India Lead feet Full time

    What you will do: - You will initiate and lead the sales conversation for new inbound leads/ prospective customers - Strategise and work to achieve team & individual business goals - Grow revenue & gain market share in the Lithium Battery Business - Serve as the lead point of contact for all assigned customers & account management matters - Build and...

  • Lead Engineer

    4 days ago


    pune, India Velotio Technologies Full time

    Velotio Technologies is a product engineering company working with innovative startups and enterprises. We are a certified Great Place to Work® and recognized as one of the best companies to work for in India. We have provided full-stack product development for 110+ startups across the globe building products in the cloud-native, data engineering, B2B...


  • Pune, Maharashtra, India Simplify Healthcare Full time

    **Description**: As a Data Scientist, you will bring your experience in developing models and data pipelines for Analytics, Visualization and/or AI/ML to Simplify Healthcare in developing new products and/or enhancing existing products with AI/ML capabilities and efficiencies. **Responsibilities**: In your day-to-day journey, you will: - Work on use case...


  • Pune, Maharashtra, India Simplify Healthcare Full time

    **Role**: As a Full Stack Data Scientist, you will bring your experience in developing models and data pipelines for Analytics, Visualization, and/or AI/ML to Simplify Healthcare in developing new products and/or enhancing existing products with AI/ML capabilities and efficiencies. **Responsibilities**: In your day-to-day journey, you will: - Work on use...


  • Pune, India People First Consultants Full time

    Job Title: Engineering Project Lead Engineer Experience: 812 years Job Description Experience: 8 to 12 years of experience in component engineering or technical projects management. Experience of leading a small team is an asset. Experience with thermodynamics stress calculations and component design is a...


  • pune, India Searce Inc Full time

    Role: to deliver faster, smarter, better business outcomes for our clients & partners. What are we looking for? This technology lead position challenges the client status quo by helping them re-imagine the art of what is possible using a consulting mindset and business strategy skills. This position oversees the delivery of Software Engineering Project/s...


  • pune, India Searce Inc Full time

    Role: to deliver faster, smarter, better business outcomes for our clients & partners.What are we looking for?This technology lead position challenges the client status quo by helping them re-imagine the art of what is possible using a consulting mindset and business strategy skills.This position oversees the delivery of Software Engineering Project/s and...


  • Pune, India Searce Inc Full time

    Role: to deliver faster, smarter, better business outcomes for our clients & partners. What are we looking for? This technology lead position challenges the client status quo by helping them re-imagine the art of what is possible using a consulting mindset and business strategy skills. This position oversees the delivery of Software Engineering...


  • Pune, India Searce Inc Full time

    Role: to deliver faster, smarter, better business outcomes for our clients & partners. What are we looking for? This technology lead position challenges the client status quo by helping them re-imagine the art of what is possible using a consulting mindset and business strategy skills. This position oversees the delivery of Software Engineering Project/s...


  • Pune, India Searce Inc Full time

    Role: to deliver faster, smarter, better business outcomes for our clients & partners.What are we looking for?This technology lead position challenges the client status quo by helping them re-imagine the art of what is possible using a consulting mindset and business strategy skills.This position oversees the delivery of Software Engineering Project/s and...

  • Lead Data Engineer

    4 months ago


    Pune, India Epam Full time

    Description EPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, our employees, and our communities. We embrace a dynamic and inclusive culture. Here you will collaborate with multi-national teams, contribute to a myriad of innovative projects that...


  • pune, India People First Consultants Full time

    Job Title:Engineering Project LeadEngineer Experience: 812years JobDescription Experience: 8 to 12 years of experience in component engineering ortechnical projects management. Experience of leading a small team is an asset. Experience with thermodynamicsstress calculations and component design is a must. Experience with boiler...


  • Pune, India People First Consultants Full time

    Job Title:Engineering Project LeadEngineerExperience: 812yearsJobDescription Experience: 8 to 12 years of experience in component engineering ortechnical projects management. Experience of leading a small team is an asset. Experience with thermodynamicsstress calculations and component design is a must. Experience with boiler constructioncodes or...


  • pune, India People First Consultants Full time

    Job Title:Engineering Project LeadEngineerExperience: 812yearsJobDescription Experience: 8 to 12 years of experience in component engineering ortechnical projects management. Experience of leading a small team is an asset. Experience with thermodynamicsstress calculations and component design is a must. Experience with boiler constructioncodes or...