Sr Data Engineer

1 week ago


India Photon Group Full time ₹ 12,00,000 - ₹ 24,00,000 per year
Description

Key Responsibilities:

  • Develop, configure, and optimize Apache DolphinScheduler workflows for data processing and automation.
  • Design and implement ETL pipelines, job scheduling, and workflow orchestration solutions.
  • Troubleshoot and resolve performance, scalability, and reliability issues in DolphinScheduler.
  • Integrate DolphinScheduler with big data tools such as Hadoop, Spark, Flink, Hive, and Kafka.
  • Work closely with data engineers, DevOps, and software teams to enhance workflow automation.
  • Develop custom plugins and extensions for DolphinScheduler as needed.
  • Monitor and optimize job execution, resource allocation, and workflow efficiency.
  • Maintain best practices for CI/CD, version control, and infrastructure automation.

Required Skills & Qualifications:

  • Strong experience with Apache DolphinScheduler in a production environment.
  • Proficiency in Java, Python, or Scala for workflow scripting and automation.
  • Experience with big data technologies like Hadoop, Spark, Hive, Flink, and Kafka.
  • Understanding of workflow orchestration, DAG execution, and scheduling strategies.
  • Strong problem-solving skills and ability to work in a fast-paced environment.

  • Data Engineer

    2 weeks ago


    Bengaluru, India NTT Data Full time

    Job Description NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer to join our team in Bangalore, Karntaka (IN-KA), India (IN). Job Duties: Snowflake - working experience...


  • Bengaluru, India NTT DATA North America Full time

    Job Description Req ID: 342869 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Sr. Data Engineer Data Science to join our team in Bangalore, Karntaka (IN-KA), India (IN). -...

  • Java Developer

    5 days ago


    Remote, India NTT Data Full time

    Job Description NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Java Developer - Digital Engineering Sr. Engineer to join our team in Remote, Telangana (IN-TG), India (IN). Job...


  • Panchkula, Haryana, India, Haryana SR Paryavaran Full time

    Job Summary:SR Paryavaran, a leading name in the water and wastewater treatment industry, is seeking an experienced and results-driven Digital Marketing Manager/Sr Executive/Exectuivee to lead the company’s online marketing initiatives. The role focuses on strengthening brand presence, driving qualified leads, and promoting sustainable water management...

  • Sr ETL Data Engineer

    2 weeks ago


    India BigRio Full time

    Job Title: Sr ETL Data Engineer -HL7 Location: Remote – India (UK Shift) Type: Full-Time BigRio is a remote-based, technology consulting firm headquartered in Boston, MA. We specialize in delivering advanced software solutions that include custom development, cloud data platforms, AI/ML integrations, and data analytics. With a diverse portfolio of clients...

  • Data Engineer

    2 weeks ago


    India Crayon Data Full time ₹ 5,00,000 - ₹ 15,00,000 per year

    Job DescriptionData Engineer – ChennaiBuild the foundation of data intelligence — design, develop, and optimize data pipelines that power AI-driven insights.Location: Chennai, IndiaExperience: 2–3 years in data engineering or data-driven product developmentRole OverviewAs a Data Engineer, you will be responsible for building and maintaining scalable...


  • India ProArch Full time US$ 60,000 - US$ 1,20,000 per year

    ProArch is seeking a highly skilled Sr. AWS Data Engineer to join our growing team. In this role, you will leverage your expertise in AWS to design, implement, and manage robust data solutions that enable our organization to capture, store, and analyze vast amounts of data. You will work closely with data scientists, analysts, and other engineering teams to...

  • Sr ETL Data Engineer

    2 weeks ago


    India BigRio Full time

    Job Title: Sr ETL Data Engineer -HL7 Location: Remote – India (UK Shift) Type: Full-Time About BigRio: BigRio is a remote-based, technology consulting firm headquartered in Boston, MA. We specialize in delivering advanced software solutions that include custom development, cloud data platforms, AI/ML integrations, and data analytics. With a diverse...

  • Sr ETL Data Engineer

    2 weeks ago


    India BigRio Full time

    Job Title: Sr ETL Data Engineer -HL7 Location: Remote – India (UK Shift) Type: Full-Time About BigRio: BigRio is a remote-based, technology consulting firm headquartered in Boston, MA. We specialize in delivering advanced software solutions that include custom development, cloud data platforms, AI/ML integrations, and data analytics. With a diverse...

  • MuleSoft Developer

    3 weeks ago


    Delhi, India NTT Data Full time

    Job Description NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a MuleSoft Developer - Digital Engineering Sr. Engineer to join our team in Delhi, Delhi (IN-DL), India (IN). Once You...