Senior Data Automation Specialist

7 days ago

Delhi Mumbai Kolkata, India beBeeDataEngineer Full time ₹ 9,00,000 - ₹ 12,00,000

Data Engineer Position

This position involves developing, configuring, and optimizing data processing workflows using Apache DolphinScheduler. The ideal candidate will have strong experience with DolphinScheduler in a production environment, proficiency in Java, Python, or Scala for workflow scripting and automation, and knowledge of big data technologies like Hadoop, Spark, Hive, Flink, and Kafka.

Responsibilities
  • Design and implement ETL pipelines, job scheduling, and workflow orchestration solutions.
  • Troubleshoot and resolve performance, scalability, and reliability issues in DolphinScheduler.
  • Integrate DolphinScheduler with big data tools and collaborate with cross-functional teams to enhance workflow automation.
  • Develop custom plugins and extensions for DolphinScheduler as needed.
  • Monitor and optimize job execution, resource allocation, and workflow efficiency.
Requirements
  • Strong experience with Apache DolphinScheduler in a production environment.
  • Proficiency in Java, Python, or Scala for workflow scripting and automation.
  • Experience with big data technologies like Hadoop, Spark, Hive, Flink, and Kafka.
  • Understanding of workflow orchestration, DAG execution, and scheduling strategies.
  • Strong problem-solving skills and ability to work in a fast-paced environment.
Benefits

This role offers opportunities for professional growth and development in a collaborative environment.

Education

Bachelor's degree in Computer Science or related field; Master's degree preferred.

  • Senior Data Automation Specialist

    5 days ago

    Delhi, Kolkata, Mumbai, India beBeeData Full time ₹ 18,00,000 - ₹ 24,00,000

    Job Title: Senior Data Automation SpecialistWe are seeking a highly skilled and experienced data automation specialist to join our team. The successful candidate will have expertise in designing, developing, and optimizing data processing workflows using Apache DolphinScheduler.Key Responsibilities:- Develop and implement ETL pipelines, job scheduling, and...

  • Senior Workflow Automation Specialist

    6 days ago

    Kolkata, Delhi, Mumbai, India beBeeWorkflow Full time US$ 90,000 - US$ 1,20,000

    Senior Workflow Automation SpecialistThis role involves developing and implementing automated workflows across various business functions to increase efficiency and productivity.

  • Senior Data Validation Specialist

    1 week ago

    Kolkata, West Bengal, India beBeeData Full time ₹ 2,50,000 - ₹ 5,00,000

    Senior Data Validation SpecialistWe are seeking a highly skilled and experienced Senior Data Validation Specialist to join our team.About the Role:Primary Responsibility: Validate data to ensure accuracy and integrity.Secondary Skills: Automation using Java/Python programming languages.Requirements:4-8 years of experience in ETL Testing.Proficiency in...

  • Senior Test Automation Specialist

    2 days ago

    Mumbai, Maharashtra, India beBeeAutomation Full time ₹ 15,00,000 - ₹ 28,00,000

    Senior Test Automation SpecialistWe are seeking a seasoned Senior Test Automation Specialist to join our team.Job Description:The Senior Test Automation Specialist will be responsible for designing, developing and maintaining automation frameworks and scripts to support our testing efforts.Key Responsibilities:Design and develop automation frameworks and...

  • Senior Software Automation Specialist

    2 weeks ago

    Kolkata, Delhi, Mumbai, India beBeeAutomation Full time US$ 90,000 - US$ 1,20,000

    Job Description:We are seeking a highly skilled Senior Software Automation Specialist to join our team. The ideal candidate will have a strong background in software automation development and a passion for delivering high-quality products.As a key member of our team, you will be responsible for designing, developing, and implementing automated tests for our...

  • Senior Data Engineer and Automation Specialist

    11 hours ago

    Kolkata, West Bengal, India beBeeDataEngineering Full time ₹ 80,00,000 - ₹ 1,20,00,000

    Join a dynamic team of experts in data engineering and automation to drive business growth through innovative solutions.Job DescriptionAs a senior associate in our data and analytics engineering group, you will play a crucial role in designing and developing robust data solutions for clients. You will work closely with cross-functional teams to leverage...

  • Senior Cloud Data Specialist

    7 days ago

    Kolkata, West Bengal, India beBeeAWS Full time ₹ 15,00,000 - ₹ 25,00,000

    Senior Cloud Data SpecialistA challenging opportunity has arisen for a highly skilled Senior Cloud Data Specialist to join our organization.Proficiency in Python, SQL, PySpark, and data modeling is essential for this role.

  • Data Management and Automation Specialist

    5 days ago

    Mumbai, Maharashtra, India beBeeHsw Full time ₹ 1,04,000 - ₹ 1,30,878

    HSW SpecialistWe are seeking a skilled HSW specialist to join our team. As an HSW specialist, you will be responsible for developing and implementing automated systems and tools to streamline data collection and reporting processes.

  • Senior Test Automation Specialist

    6 days ago

    Delhi, Mumbai, Kolkata, India beBeeAutomation Full time ₹ 5,00,000 - ₹ 10,00,000

    Seeking a qualified Test Automation Specialist to join our team. As a Test Automation Specialist, you will be responsible for designing, developing and executing automated test cases for various software applications.You will work closely with developers and other stakeholders to resolve issues and improve software quality. This role requires strong...

  • Senior QA Automation Specialist

    6 days ago

    Delhi, Mumbai, India beBeeAutomation Full time ₹ 1,04,000 - ₹ 1,30,878

    Explore a challenging role as a Senior QA Automation Engineer.Job DescriptionAs a key member of our team, you will lead the development of automated test frameworks for financial data pipelines. Utilize PySpark/Python and AWS services to create efficient and scalable solutions. Collaborate with cross-functional teams to ensure data quality and consistency...