
Sr Data Engineer
6 days ago
- Develop, configure, and optimize Apache DolphinScheduler workflows for data processing and automation.
- Design and implement ETL pipelines, job scheduling, and workflow orchestration solutions.
- Troubleshoot and resolve performance, scalability, and reliability issues in DolphinScheduler.
- Integrate DolphinScheduler with big data tools such as Hadoop, Spark, Flink, Hive, and Kafka.
- Work closely with data engineers, DevOps, and software teams to enhance workflow automation.
- Develop custom plugins and extensions for DolphinScheduler as needed.
- Monitor and optimize job execution, resource allocation, and workflow efficiency.
- Maintain best practices for CI/CD, version control, and infrastructure automation.
Required Skills Qualifications:
- Strong experience with Apache DolphinScheduler in a production environment.
- Proficiency in Java, Python, or Scala for workflow scripting and automation.
- Experience with big data technologies like Hadoop, Spark, Hive, Flink, and Kafka.
- Understanding of workflow orchestration, DAG execution, and scheduling strategies.
- Strong problem-solving skills and ability to work in a fast-paced environment.
Role:Data Engineer
Industry Type:IT Services & Consulting
Department:Data Science & Analytics
Employment Type:Full Time, Permanent
Role Category:Data Science & Machine Learning
Education
UG:Any Graduate
PG:Any Postgraduate
-
Sr. Data Engineer
5 days ago
Pune, Maharashtra, India ADP Full timeADP is hiring Sr. Data Engineer (Sr. Member Technical)Required Skills- Bachelor's / Engineering degree in Computer Science or Information Technology.- Postgraduate degree or diploma in Computer Science / Data Science is an added advantage.- AWS, SQL, Databricks, and Apache Spark certifications are a plus.- Strong foundation in data analytics and engineering,...
-
Sr. Data Engineer
3 days ago
Pune, Maharashtra, India ADP Full timeADP is hiring Sr. Data Engineer (Sr. Member Technical) Required Skills Bachelor's / Engineering degree in Computer Science or Information Technology. Postgraduate degree or diploma in Computer Science / Data Science is an added advantage. AWS, SQL, Databricks, and Apache Spark certifications are a plus. Strong foundation in data analytics and...
-
Sr. Data Engineer
2 hours ago
Pune, Maharashtra, India Barclays Full time ₹ 15,00,000 - ₹ 20,00,000 per yearJoin us as a Sr. Data Engineer role at Barclays, where you'll spearhead the evolution of our digital landscape, driving innovation and excellence. You'll harness cutting-edge technology to revolutionise our digital offerings, ensuring unapparelled customer experiences .You may be assessed on the key critical skills relevant for success in role, such as...
-
Sr. Generative AI Engineer
4 weeks ago
Pune, Maharashtra, India Earth Solutions Pvt. Ltd. Full timeCompany DescriptionEstablished in 2009, Earth Solutions Pvt. Ltd. is a fast-growing offshore software development company based in Pune, India. We offer world-class services including Technology Consulting, Software Design, Development, Middleware Implementation, and Support. Our team of industry experts is committed to providing meaningful business...
-
Data Engineer
1 hour ago
Pune, Maharashtra, India ViralMint Full time ₹ 15,00,000 - ₹ 20,00,000 per yearViral Mint (Digital Marketing Agency) is looking for Sr. Data Engineer. Role Description : This is a full-time on-site role for a Senior Data Engineer at ViralMint. The Senior Data Engineer will be responsible for analyzing data, creating data models, communicating insights, and utilizing statistical techniques to drive business decisions. Experience : 5-7...
-
Sales Executive
3 hours ago
Pune, Maharashtra, India SR Primes Full time ₹ 1,04,000 - ₹ 1,30,878 per yearCompany DescriptionSR Primes, founded by Mrs. Mrunal Choudhari and Mr. Pranav Choudhari in 2020, is a career and organizational matchmaker based in Pune, Ahilyanagar, and Chatrapati Sambhajinagar. With a personalized and data-driven approach, SR Primes crafts precise professional placements, ensuring both career growth and organizational success. Trusted by...
-
Sr. Lead Software Engineer
3 hours ago
Pune, Maharashtra, India BELLIN Holding Full time ₹ 1,04,000 - ₹ 1,30,878 per yearCoupa makes margins multiply through its community-generated AI and industry-leading total spend management platform for businesses large and small. Coupa AI is informed by trillions of dollars of direct and indirect spend data across a global network of 10M+ buyers and suppliers. We empower you with the ability to predict, prescribe, and automate smarter,...
-
Sr. Data Engineer
5 days ago
Pune, Maharashtra, India Concord Full timeJob Title: Snowflake & DBT Data EngineerExperience: 5–10 yearsEmployment Type: Full-timeJob Summary:We are seeking a highly skilled Data Engineer with strong hands-on experience in Snowflake and dbt (Data Build Tool) to join our data engineering team. The ideal candidate will be responsible for designing and developing scalable data pipelines, performing...
-
Sr. Data Engineer
2 weeks ago
Pune, Maharashtra, India Concord Full timeJob Title: Snowflake & DBT Data Engineer Experience: 5–10 years Employment Type: Full-time Job Summary: We are seeking a highly skilled Data Engineer with strong hands-on experience in Snowflake and dbt (Data Build Tool) to join our data engineering team. The ideal candidate will be responsible for designing and developing scalable data pipelines,...
-
Data Operations Engineer
3 hours ago
Pune, Maharashtra, India Mars Data Insights Full time ₹ 1,04,000 - ₹ 1,30,878 per yearTitle: Data Operations Engineer & RUN SupportSkills:Data Operations Engineering, data manipulation, Python, Talend, GCP, Bigquery, DataIku, ITSM/ticketing tools, Helix, Jira, task management, data pipelines, RUN Service, data infrastructure, data quality Job Location:Pune Job Type:Fulltime/Hybrid Work Experience:5+ years We are seeking a highly...