Sr Data Engineer

6 days ago


Pune, Maharashtra, India PHOTON Full time
Job Description

- Develop, configure, and optimize Apache DolphinScheduler workflows for data processing and automation.
- Design and implement ETL pipelines, job scheduling, and workflow orchestration solutions.
- Troubleshoot and resolve performance, scalability, and reliability issues in DolphinScheduler.
- Integrate DolphinScheduler with big data tools such as Hadoop, Spark, Flink, Hive, and Kafka.
- Work closely with data engineers, DevOps, and software teams to enhance workflow automation.
- Develop custom plugins and extensions for DolphinScheduler as needed.
- Monitor and optimize job execution, resource allocation, and workflow efficiency.
- Maintain best practices for CI/CD, version control, and infrastructure automation.

Required Skills Qualifications:

- Strong experience with Apache DolphinScheduler in a production environment.
- Proficiency in Java, Python, or Scala for workflow scripting and automation.
- Experience with big data technologies like Hadoop, Spark, Hive, Flink, and Kafka.
- Understanding of workflow orchestration, DAG execution, and scheduling strategies.
- Strong problem-solving skills and ability to work in a fast-paced environment.

Role:Data Engineer

Industry Type:IT Services & Consulting

Department:Data Science & Analytics

Employment Type:Full Time, Permanent

Role Category:Data Science & Machine Learning

Education

UG:Any Graduate

PG:Any Postgraduate
  • Sr. Data Engineer

    5 days ago


    Pune, Maharashtra, India ADP Full time

    ADP is hiring Sr. Data Engineer (Sr. Member Technical)Required Skills- Bachelor's / Engineering degree in Computer Science or Information Technology.- Postgraduate degree or diploma in Computer Science / Data Science is an added advantage.- AWS, SQL, Databricks, and Apache Spark certifications are a plus.- Strong foundation in data analytics and engineering,...

  • Sr. Data Engineer

    3 days ago


    Pune, Maharashtra, India ADP Full time

    ADP is hiring Sr. Data Engineer (Sr. Member Technical) Required Skills Bachelor's / Engineering degree in Computer Science or Information Technology. Postgraduate degree or diploma in Computer Science / Data Science is an added advantage. AWS, SQL, Databricks, and Apache Spark certifications are a plus. Strong foundation in data analytics and...

  • Sr. Data Engineer

    2 hours ago


    Pune, Maharashtra, India Barclays Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Join us as a Sr. Data Engineer role at Barclays, where you'll spearhead the evolution of our digital landscape, driving innovation and excellence. You'll harness cutting-edge technology to revolutionise our digital offerings, ensuring unapparelled customer experiences .You may be assessed on the key critical skills relevant for success in role, such as...


  • Pune, Maharashtra, India Earth Solutions Pvt. Ltd. Full time

    Company DescriptionEstablished in 2009, Earth Solutions Pvt. Ltd. is a fast-growing offshore software development company based in Pune, India. We offer world-class services including Technology Consulting, Software Design, Development, Middleware Implementation, and Support. Our team of industry experts is committed to providing meaningful business...

  • Data Engineer

    1 hour ago


    Pune, Maharashtra, India ViralMint Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Viral Mint (Digital Marketing Agency) is looking for Sr. Data Engineer. Role Description : This is a full-time on-site role for a Senior Data Engineer at ViralMint. The Senior Data Engineer will be responsible for analyzing data, creating data models, communicating insights, and utilizing statistical techniques to drive business decisions. Experience : 5-7...

  • Sales Executive

    3 hours ago


    Pune, Maharashtra, India SR Primes Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    Company DescriptionSR Primes, founded by Mrs. Mrunal Choudhari and Mr. Pranav Choudhari in 2020, is a career and organizational matchmaker based in Pune, Ahilyanagar, and Chatrapati Sambhajinagar. With a personalized and data-driven approach, SR Primes crafts precise professional placements, ensuring both career growth and organizational success. Trusted by...


  • Pune, Maharashtra, India BELLIN Holding Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    Coupa makes margins multiply through its community-generated AI and industry-leading total spend management platform for businesses large and small. Coupa AI is informed by trillions of dollars of direct and indirect spend data across a global network of 10M+ buyers and suppliers. We empower you with the ability to predict, prescribe, and automate smarter,...

  • Sr. Data Engineer

    5 days ago


    Pune, Maharashtra, India Concord Full time

    Job Title: Snowflake & DBT Data EngineerExperience: 5–10 yearsEmployment Type: Full-timeJob Summary:We are seeking a highly skilled Data Engineer with strong hands-on experience in Snowflake and dbt (Data Build Tool) to join our data engineering team. The ideal candidate will be responsible for designing and developing scalable data pipelines, performing...

  • Sr. Data Engineer

    2 weeks ago


    Pune, Maharashtra, India Concord Full time

    Job Title: Snowflake & DBT Data Engineer Experience: 5–10 years Employment Type: Full-time Job Summary: We are seeking a highly skilled Data Engineer with strong hands-on experience in Snowflake and dbt (Data Build Tool) to join our data engineering team. The ideal candidate will be responsible for designing and developing scalable data pipelines,...


  • Pune, Maharashtra, India Mars Data Insights Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    Title: Data Operations Engineer & RUN SupportSkills:Data Operations Engineering, data manipulation, Python, Talend, GCP, Bigquery, DataIku, ITSM/ticketing tools, Helix, Jira, task management, data pipelines,  RUN Service, data infrastructure, data quality Job Location:Pune Job Type:Fulltime/Hybrid Work Experience:5+ years We are seeking a highly...