Sr Data Engineer

5 days ago

Bengaluru Chennai Pune, India Photon Full time ₹ 8,00,000 - ₹ 12,00,000 per year

About The Role  

Key Responsibilities: 

- Develop, configure, and optimize Apache DolphinScheduler workflows for data processing and automation.
- Design and implement ETL pipelines, job scheduling, and workflow orchestration solutions.
- Troubleshoot and resolve performance, scalability, and reliability issues in DolphinScheduler.
- Integrate DolphinScheduler with big data tools such as Hadoop, Spark, Flink, Hive, and Kafka.
- Work closely with data engineers, DevOps, and software teams to enhance workflow automation.
- Develop custom plugins and extensions for DolphinScheduler as needed.
- Monitor and optimize job execution, resource allocation, and workflow efficiency.
- Maintain best practices for CI/CD, version control, and infrastructure automation.

Required Skills & Qualifications: 

- Strong experience with Apache DolphinScheduler in a production environment.
- Proficiency in Java, Python, or Scala for workflow scripting and automation.
- Experience with big data technologies like Hadoop, Spark, Hive, Flink, and Kafka.
- Understanding of workflow orchestration, DAG execution, and scheduling strategies.
- Strong problem-solving skills and ability to work in a fast-paced environment.

  • Sr. Data Science

    5 days ago

    Bengaluru, Karnataka, India NTT DATA, Inc. Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    We are currently seeking a Sr. Data Science & AIML, GenAI Lead/Engineer to join our team in Bangalore, Karntaka (IN-KA), India (IN).Job Duties: Job Title: Data Science & AIML, GenAI Lead/EngineerKey Responsibilities: Develop and implement traditional machine learning algorithms. Deploy at least one model in a production environment. Write and maintain Python...

  • Sr. Data Engineer Data Science

    5 days ago

    Bengaluru, Karnataka, India NTT DATA Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    Req ID: 342869NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Sr. Data Engineer Data Science to join our team in Bangalore, Karnātaka (IN-KA), India (IN). ...

  • Sr Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Req ID: 340286NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Sr Data Engineer (Life and Annuity) to join our team in Bangalore, Karnātaka (IN-KA), India (IN). Job Duties: At...

  • Sr. Data Engineer

    3 days ago

    Bengaluru, Karnataka, India Onebridge Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Onebridge, a Marlabs Company, is a global AI and Data Analytics Consulting Firm that empowers organizations worldwide to drive better outcomes through data and technology. Since 2005, we have partnered with some of the largest healthcare, life sciences, financial services, and government entities across the globe. We have an exciting opportunity for a highly...

  • Sr. Data Engineer

    3 days ago

    Bengaluru, Karnataka, India Onebridge Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Onebridge, a Marlabs Company, is a global AI and Data Analytics Consulting Firm that empowers organizations worldwide to drive better outcomes through data and technology. Since 2005, we have partnered with some of the largest healthcare, life sciences, financial services, and government entities across the globe. We have an exciting opportunity for a highly...

  • Sr Data Engineer

    2 weeks ago

    Pune, India Populace World Solutions Full time

    Job Title: Sr. Data Engineer Experience: 8+ Years Location: Pune (Kharadi) Job Description - 8+ years of experience as a big data engineer. - Must be proficient with Python & PySpark - In-depth knowledge of Hadoop, Apache Spark, Databricks, Delta Tables, AWS data analytics services - Must have extensive experience with Delta Tables, JSON, Parquet file format...

  • Sr Data Engineer

    2 weeks ago

    Pune, India Populace World Solutions Full time

    Job Title: Sr. Data Engineer Experience: 8+ Years Location: Pune (Kharadi) Job Description 8+ years of experience as a big data engineer. Must be proficient with Python & PySpark In-depth knowledge of Hadoop, Apache Spark, Databricks, Delta Tables, AWS data analytics services Must have extensive experience with Delta Tables, JSON, Parquet file format Good to...

  • Sr Data Engineer

    2 weeks ago

    Pune, India Populace World Solutions Full time

    Job Title: Sr. Data Engineer Experience: 8+ Years Location: Pune (Kharadi) Job Description 8+ years of experience as a big data engineer. Must be proficient with Python & PySpark In-depth knowledge of Hadoop, Apache Spark, Databricks, Delta Tables, AWS data analytics services Must have extensive experience with Delta Tables, JSON, Parquet file format Good to...

  • Sr Data Engineer

    2 weeks ago

    Pune, India Populace World Solutions Full time

    Job Title: Sr. Data Engineer Experience: 8+ Years Location: Pune (Kharadi) Job Description 8+ years of experience as a big data engineer. Must be proficient with Python & PySpark In-depth knowledge of Hadoop, Apache Spark, Databricks, Delta Tables, AWS data analytics services Must have extensive experience with Delta Tables, JSON, Parquet file format Good to...

  • Sr Data Engineer

    1 week ago

    pune, India Populace World Solutions Full time

    Job Title: Sr. Data Engineer Experience: 8+ Years Location: Pune (Kharadi) Job Description 8+ years of experience as a big data engineer. Must be proficient with Python & PySpark In-depth knowledge of Hadoop, Apache Spark, Databricks, Delta Tables, AWS data analytics services Must have extensive experience with Delta Tables, JSON, Parquet file format Good to...