Senior Data Engineering and Machine Learning Tester

1 month ago

Delhi, Delhi, India VSHR UNNATI LLP Full time

Estimated Salary: 1,200,000 - 1,920,000 INR per annum

Job Overview:

VSHR UNNATI LLP is seeking an experienced Senior Data Engineering and Machine Learning Tester to join our Quality Assurance team. The ideal candidate will have strong expertise in testing data pipelines, machine learning models, and large-scale data processing systems within the Databricks environment.

Key Responsibilities:

  • Test Planning and Strategy:
    • Develop comprehensive test plans, test cases, and test scripts for data engineering and machine learning workflows.
    • Collaborate with data engineers, data scientists, and product managers to understand requirements and define testing strategies tailored to the Databricks environment.
  • Data Pipeline Testing:
    • Validate data ingestion, transformation, and processing workflows within Databricks.
    • Perform end-to-end testing of ETL/ELT processes to ensure data accuracy, consistency, and performance.
    • Verify data integrity across different stages of the pipeline and ensure that data meets business requirements.
  • Machine Learning Model Testing:
    • Test and validate machine learning models developed on Databricks, ensuring they meet accuracy, performance, and reliability standards.
    • Develop and execute tests for model training, validation, and deployment pipelines.
    • Evaluate the performance of models on large datasets and ensure that they generalize well to unseen data.
  • Automation and Continuous Integration:
    • Implement automated testing solutions for data pipelines and machine learning models using tools compatible with Databricks.
    • Integrate automated testing processes into the CI/CD pipeline to ensure continuous quality checks. Azure DevOps experience is a plus.
    • Leverage Databricks notebooks and workflows for test automation where applicable.
  • Performance Testing:
    • Conduct performance testing of data pipelines and machine learning models to identify bottlenecks and optimize processing time.
    • Test the scalability of data engineering solutions to handle large volumes of data efficiently.
  • Collaboration and Communication:
    • Work closely with cross-functional teams, including data engineers, data scientists, and DevOps, to resolve technical challenges and ensure the quality of data solutions.
    • Provide clear and concise feedback on test results and collaborate with teams to address issues.
    • Participate in sprint reviews and retrospectives, providing insights on test outcomes and quality metrics.

Qualifications:

Technical Skills:

  • Strong experience with Databricks and related tools (Apache Spark, Delta Lake, MLflow).
  • Proficiency in Python, SQL, and testing frameworks relevant to data engineering and machine learning.
  • Experience with big data technologies on Azure platform.
  • Knowledge of testing automation tools and CI/CD pipelines.
  • Understanding of data governance, data quality, and data privacy practices.

Experience:

  • 3+ years of experience in testing data engineering workflows and machine learning models, with a focus on big data environments.
  • Proven experience working within Databricks or similar platforms.
  • Prior experience in an Agile development environment is preferred.

Soft Skills:

  • Excellent analytical and problem-solving skills.
  • Strong communication skills, both verbal and written.
  • Ability to work independently and as part of a collaborative team.

Benefits:

  • Opportunities for professional growth and development.
  • Collaborative and innovative work environment.

  • Machine Learning Architect

    2 weeks ago

    Delhi, Delhi, India Merit Data and Technology Full time

    Senior NLP Developer PositionWe are seeking a highly skilled and experienced Senior NLP Developer to contribute to our dynamic team.The ideal candidate will have a strong background in machine learning (ML), deep learning (DL), and large language models (LLMs).NLP Model Development:Design, develop, and implement ML models and algorithms to solve complex...

  • Machine Learning Architect

    2 weeks ago

    Delhi, Delhi, India Merit Data and Technology Full time

    Job Summary: Merit Data and Technology is seeking an experienced Machine Learning Architect to join our team. As a key member of our AI engineering group, you will design, develop, and implement cutting-edge machine learning models and algorithms to drive business growth. About the Role: We are looking for a highly skilled professional with a strong...

  • Databricks Machine Learning Tester

    2 weeks ago

    Delhi, Delhi, India VSHR UNNATI LLP Full time

    Job Title: Senior Data Quality Assurance ExpertEstimated Salary: ₹12.5 LPAVSHR UNNATI LLP is looking for a Senior Data Quality Assurance Expert to join our team. As a key member of our Quality Assurance team, you will be responsible for ensuring the quality, accuracy, and reliability of our data engineering workflows and machine learning...

  • Senior Machine Learning Engineer

    3 weeks ago

    Delhi, Delhi, India iHub-Data, IIIT Hyderabad Full time

    iHub-Data, IIIT Hyderabad is seeking a highly skilled Senior Machine Learning Engineer with expertise in Computer Vision to join our innovative team. With a strong background in machine learning and deep learning, you will play a crucial role in designing, developing, and optimizing our machine learning solutions to solve complex problems and drive...

  • Senior Machine Learning Engineer

    2 weeks ago

    Delhi, Delhi, India Wingify Full time

    About the JobWe are seeking an experienced Senior Machine Learning Engineer to join our data science team at Wingify.About WingifyWingify is a leading global SaaS company specializing in creating and marketing powerful digital experience optimization products.Key ResponsibilitiesDevelop AI-powered features that enable customers to make data-driven decisions,...

  • Senior Machine Learning Engineer

    3 weeks ago

    Delhi, Delhi, India Markovate Full time

    Company Overview:Markovate is a leading organization in the field of data science, committed to delivering innovative solutions that drive business growth and success. Salary:We offer a competitive salary range of $140,000 - $200,000 per annum, commensurate with experience. Job Description:As a Senior Machine Learning Engineer at Markovate, you will play a...

  • Senior Cloud Machine Learning Engineer

    2 weeks ago

    Delhi, Delhi, India Coffeee Full time

    At Coffeee, we are looking to hire a highly skilled Senior Cloud Machine Learning Engineer to join our IT Department. The ideal candidate will have 8+ years of experience as an AWS Engineer, DevOps Engineer, or Cloud Engineer, with a focus on CI/CD pipelines and machine learning solutions.The successful candidate will work closely with data scientists, model...

  • Deep Learning Solutions Engineer

    2 weeks ago

    Delhi, Delhi, India Merit Data and Technology Full time

    Deep Learning Solutions Engineer Merit Data and Technology is seeking an experienced Deep Learning Solutions Engineer to join our AI engineering team. In this role, you will design, develop, and implement cutting-edge deep learning models and algorithms to drive business growth. About the Role: We are looking for a highly skilled professional with a strong...

  • Data Scientist with Expertise in Machine Learning

    3 weeks ago

    Delhi, Delhi, India Hexaview Technologies private Limited Full time

    Job Description:We are seeking a highly motivated and experienced Senior Data Scientist to join our team at Hexaview Technologies Private Limited.About the Role:This is an exciting opportunity for a skilled professional to work on complex business challenges and develop innovative machine learning solutions. As a Senior Data Scientist, you will be...

  • Senior Machine Learning Specialist

    3 weeks ago

    Delhi, Delhi, India RecourseTech Full time

    We are looking for a highly skilled Senior Machine Learning Specialist to join our team at Recourse Tech. This is a fully remote role offering opportunities for growth and innovation.Job DescriptionThe ideal candidate will have 1-3 years of experience in data science or machine learning roles, with a strong background in Python and relevant libraries...

  • Lead Machine Learning Developer

    2 weeks ago

    Delhi, Delhi, India Merit Data and Technology Full time

    Lead Machine Learning Developer Position Overview:The Lead Machine Learning Developer will lead the development of cutting-edge machine learning models to improve our products. This individual will work closely with cross-functional teams to ensure seamless integration of ML solutions into our applications.About the Role:This is a critical role that requires...

  • Machine Learning Engineer for Data Insights

    3 weeks ago

    Delhi, Delhi, India CSM Technologies Full time

    At CSM Technologies, we are seeking a highly skilled Machine Learning Engineer to join our team. As a key member of our data insights group, you will play a crucial role in developing and implementing cutting-edge machine learning models that drive business growth.About the Role:We are looking for an experienced professional with a strong background in...

  • Machine Learning Engineer

    2 weeks ago

    Delhi, Delhi, India MNR Solutions Full time

    Job Title: Machine Learning EngineerSalary Range: ₹50,00,000 - ₹90,00,000 per annumCompany Overview: MNR Solutions is a leading provider of data-driven solutions to various industries. We are committed to delivering high-quality services and fostering a collaborative work environment.Job Description: As a Machine Learning Engineer at MNR Solutions, you...

  • Senior Data Scientist with Machine Learning Expertise

    1 month ago

    Delhi, Delhi, India Markovate Full time

    We are seeking a highly skilled Senior Machine Learning Engineer to join our team at Markovate. With over 5 years of experience in developing and deploying machine learning models, you will play a key role in driving the development and implementation of cutting-edge solutions.Job ResponsibilitiesLead the design, development, and deployment of machine...

  • Machine Learning Engineer

    2 weeks ago

    Delhi, Delhi, India RANDOMTREES PRIVATE LIMITED Full time

    Job DescriptionWe are seeking a highly skilled Machine Learning Engineer to join our team at RANDOMTREES PRIVATE LIMITED. As a key member of our data science team, you will be responsible for designing, developing, and deploying production-grade machine learning models.With a strong focus on recommender systems, you will conduct exploratory data analysis to...

  • Senior Backend Engineer with Machine Learning Focus

    3 weeks ago

    Delhi, Delhi, India Hooman Digital Full time

    Machine Learning and Backend DeveloperRole Overview:We are seeking a highly skilled Senior Backend Engineer to join our team at Hooman Digital. This role combines backend development with machine learning, focusing on integrating cutting-edge tools and libraries. As a Senior Backend Engineer, you will have the opportunity to work with modern machine learning...

  • Data Scientist

    2 weeks ago

    Delhi, Delhi, India HashRoot Full time

    Job Description:We are looking for a highly skilled Data Scientist - Machine Learning Engineer to join our team at HashRoot. In this role, you will design, develop, and deploy machine learning solutions using AWS services.Responsibilities:Develop and implement machine learning models and AI systems using AWS SageMaker and other AWS services.Leverage...

  • Machine Learning Engineer

    2 weeks ago

    Delhi, Delhi, India HashRoot Full time

    Are you a skilled Machines Learning Engineer - Cloud and Big Data professional looking for a new challenge? HashRoot is seeking an experienced engineer to join our dynamic team and contribute to the development of cutting-edge machine learning and artificial intelligence solutions.About the RoleThis is an excellent opportunity for someone who wants to work...

  • Senior Machine Learning Professional

    2 weeks ago

    Delhi, Delhi, India Markovate Full time

    Markovate is seeking a talented Senior Machine Learning Engineer to lead our machine learning initiatives. This role offers an exciting opportunity to leverage your expertise in machine learning to drive business growth and innovation.Key Responsibilities:Design, develop, and deploy machine learning models and algorithms to enhance our products and...

  • Machine Learning Solutions Architect

    3 weeks ago

    Delhi, Delhi, India Collabera Digital Full time

    We are seeking a skilled Senior Engineer – Machine Learning to join our team at Collabera Digital. As a key player in our MLOps capabilities, you will design and implement solutions to scale machine learning models efficiently within large data-intensive applications.About the RoleThis Senior Engineer position is focused on enhancing MLOps capabilities for...