DevOps with Airflow and Apache
4 months ago
At least 6+ years in web services development and solid understanding of web technologies in JAVA
- Good understanding of Apache Airflow Workflow Management Platform - Must have experience in managing, monitoring and troubleshooting Airflow in production environments.
- Strong knowledge of Python
- Strong expertise with Docker/Kubernetes
- Strong Expertise of writing JUnits & How to configure it through maven
- Working knowledge of building Micro Services, RESTful web Services using any framework (Spring Boot, JaxRS, Jersey)
- Good understanding of NoSQL databases and have worked upon any one of them (HBase, Cassandra, Big query, Mongo)
- Good understanding of Message Queues and have worked upon any one of them (Azure Service Bus, Kafka, RabbitMQ, Pub Sub)
- Good understanding of Maven, Git
- Good understanding of Jenkins/ Azure DevOps for CI/CD architecture
- Good understanding of Programming Algorithms and Data Structures
- Experience with BDD & Cucumber
- **Good to Have**:_
- Monitoring experience - Stack driver or Prometheus or Azure equivalent
- Operational readiness - SLI/SLO, DevOps experience
- Service mesh - ex: Istio
- Knowledge on Graph technology
- Have worked upon any of the big data technologies
- Have worked upon tools like white source, Veracode...
- Knowledge of Angular
- Good understanding of Streaming technologies and processing engines (Dataflow, Flink, Spark)
- Knowledge of Azure DevOps
**Salary**: Up to ₹2,095,535.58 per year
**Benefits**:
- Health insurance
Schedule:
- Day shift
Supplemental pay types:
- Performance bonus
Work Location: In person
**Speak with the employer**
+91 7350971253
-
Apache Spark Expert
4 months ago
Pune, India Info Origin Full timePosition Title: - Apache Spark Expert**Location**: - Pune, MH, OnsitePosition Type: - Full-TimeInterview Process: - Webcam/SkypeReq Id: - 3314Salary/Rate: - MarketPosition Duration: - Permanent**Key Responsibilities**: - Provide architectural consultancy to clients and develop implementation roadmaps for Apache Spark and Kafka solutions. - Translate...
-
Senior DevOps Engineer
1 week ago
Pune, India Attentions AI Full timeGreetings From Attentions.aiJob Description for Senior DevOps Engineer.Position Title:DevOps EngineerLocation:Pune, IndiaDepartment:Software DevelopmentEmployment Type:Full-timeCompany Overview:Attentions is a cutting-edge generative AI company dedicated to developing innovative products across all modalities, including text, vision, audio, and more. Our...
-
Senior DevOps engineer
5 days ago
pune, India EXL Full timePosition - Senior DevOps EngineerLocation - PuneExperience - 5+ YearsRoles & Responsibilities:Responsible for building and managing our cloud infrastructure (AWS) with code first mindset.Design and architect ETL/ELT pipelines running on AWS EMR and SnowflakePerformance tune data pipelines using technologies such as Apache Spark, Hive and TrinoWrite...
-
Senior Devops Engineer
1 week ago
Pune H.O, India EXL Full timePosition - Senior DevOps EngineerLocation - PuneExperience - 5+ Years Roles & Responsibilities:Responsible for building and managing our cloud infrastructure (AWS) with code first mindset.Design and architect ETL/ELT pipelines running on AWS EMR and SnowflakePerformance tune data pipelines using technologies such as Apache Spark, Hive and TrinoWrite and...
-
Senior DevOps engineer
7 days ago
Pune, India EXL Full timePosition - Senior DevOps EngineerLocation - PuneExperience - 5+ YearsRoles & Responsibilities:Responsible for building and managing our cloud infrastructure (AWS) with code first mindset.Design and architect ETL/ELT pipelines running on AWS EMR and SnowflakePerformance tune data pipelines using technologies such as Apache Spark, Hive and TrinoWrite...
-
Senior Data Engineer
2 months ago
Pune, India MeedenLabs Full timeJob Description- Write and optimize complex database queries and views to ensure efficient data retrieval and processing.- Develop and maintain Java APIs for data integration and processing tasks.- Utilize Apache Beam for building data processing pipelines.Big Data and Stream Processing:- Gain exposure to Apache Flink for stream processing and real-time data...
-
DevOps
2 weeks ago
Pune, Maharashtra, India Capgemini Full time**Migration exp from Apache Kafka to Confluent Kafka**: - **Devops and Kubernets**: - **Design, deploy, and maintain Kafka clusters across multiple environments (development, testing, production).**: - **Configure Kafka brokers, topics, partitions, and ACLs (Access Control Lists) as per security requirements.**: - **Monitor Kafka infrastructure...
-
Senior DevOps engineer
6 days ago
Pune, India EXL Full timePosition - Senior DevOps EngineerLocation - PuneExperience - 5+ YearsRoles & Responsibilities:Responsible for building and managing our cloud infrastructure(AWS)with code first mindset.Design and architectETL/ELT pipelinesrunning onAWS EMRandSnowflakePerformance tune data pipelines using technologies such asApache Spark, HiveandTrinoWrite and maintain...
-
DevOps
1 month ago
Pune, Maharashtra, India Capgemini Full timeMigration exp from Apache Kafka to Confluent Kafka - 5+years - Devops, Kubernetes - Design, deploy, and maintain Kafka clusters across multiple environments (development, testing, production). - Configure Kafka brokers, topics, partitions, and ACLs (Access Control Lists) as per security requirements. - Monitor Kafka infrastructure performance and ensure high...
-
Senior DevOps Engineer
6 days ago
pune, India Attentions AI Full timeGreetings From Attentions.aiJob Description for Senior DevOps Engineer.Position Title: DevOps EngineerLocation: Pune, IndiaDepartment: Software DevelopmentEmployment Type: Full-timeCompany Overview: Attentions is a cutting-edge generative AI company dedicated to developing innovative products across all modalities, including text, vision, audio, and more....
-
Senior DevOps Engineer
1 week ago
Pune, India Attentions AI Full timeGreetings From Attentions.aiJob Description for Senior DevOps Engineer.Position Title: DevOps EngineerLocation: Pune, IndiaDepartment: Software DevelopmentEmployment Type: Full-timeCompany Overview: Attentions is a cutting-edge generative AI company dedicated to developing innovative products across all modalities, including text, vision, audio, and more....
-
Senior DevOps Engineer
1 week ago
pune, India Attentions AI Full timeGreetings From Attentions.ai Job Description for Senior DevOps Engineer. Position Title: DevOps Engineer Location: Pune, India Department: Software Development Employment Type: Full-time Company Overview: Attentions is a cutting-edge generative AI company dedicated to developing innovative products across all modalities, including text, vision,...
-
Senior DevOps Engineer
1 week ago
Pune, India Attentions AI Full timeGreetings From Attentions.aiJob Description for Senior DevOps Engineer.Position Title: DevOps EngineerLocation: Pune, IndiaDepartment: Software DevelopmentEmployment Type: Full-timeCompany Overview: Attentions is a cutting-edge generative AI company dedicated to developing innovative products across all modalities, including text, vision, audio, and more....
-
Apache Nifi e Ngineer/devops
3 months ago
Pune, India Natobotics Technologies Private Limited Full timeLoc : Pune/banglore/hyderabad exp:4+ years, The NiFi Engineer will be responsible for the implementation, support, documentation, and maintenance of all aspects of the project's Apache NiFi infrastructure. RESPONSIBILITIES: Designing and building data flows in Apache NiFi (including data movement, tagging, routing, and some...
-
Apache Nifi e Ngineer/devops
3 months ago
Pune, India Natobotics Technologies Private Limited Full timeLoc : Pune/banglore exp:4+ years, The NiFi Engineer will be responsible for the implementation, support, documentation, and maintenance of all aspects of the project's Apache NiFi infrastructure. RESPONSIBILITIES: Designing and building data flows in Apache NiFi (including data movement, tagging, routing, and some transformation/conversion). Recurring...
-
Data Engineer
4 months ago
Pune, India HyrEzy Talent Solutions Full timeJob Description and Responsibilities :Solicit business, functional, non-functional and technical requirements through interviewing and requirements gathering process.Analyze and document above requirements and data definitions, perform data analysis, assist in change management, training and testing efforts.Works with stakeholders to gather requirements on...
-
Senior Data Engineer
2 days ago
pune, India Capco Full timeData EngineerExperience ; 6+Location : Pune/Hyderabad (Hybrid)Notice Period : Immediate to 30 DaysMust Haves:Hands-on experience with Data Engineering (Spark, Scala, Hadoop and scheduling services like Apache Airflow).Hands on experience or understanding on DevOps related to Jenkins CI/CD.Hands on experience in building microservices (Java/SpringBoot...
-
Senior Data Engineer
3 months ago
Pune, India Capco Full timeData EngineerExperience ; 6+Location : Pune/Hyderabad (Hybrid)Notice Period : Immediate to 30 DaysMust Haves:Hands-on experience with Data Engineering (Spark, Scala, Hadoop and scheduling services like Apache Airflow).Hands on experience or understanding on DevOps related to Jenkins CI/CD.Hands on experience in building microservices (Java/SpringBoot...
-
Senior DevOps engineer
1 week ago
Pune, India EXL Full timePosition - Senior DevOps Engineer Location - Pune Experience - 5+ Years Roles & Responsibilities: Responsible for building and managing our cloud infrastructure (AWS) with code first mindset. Design and architect ETL/ELT pipelines running on AWS EMR and Snowflake Performance tune data pipelines using technologies such as Apache Spark, Hive and...
-
Senior DevOps engineer
5 days ago
pune, India EXL Full timePosition - Senior DevOps EngineerLocation - PuneExperience - 5+ Years Roles & Responsibilities:Responsible for building and managing our cloud infrastructure (AWS) with code first mindset.Design and architect ETL/ELT pipelines running on AWS EMR and SnowflakePerformance tune data pipelines using technologies such as Apache Spark, Hive and TrinoWrite and...