DevOps with Airflow and Apache
7 months ago
At least 6+ years in web services development and solid understanding of web technologies in JAVA
- Good understanding of Apache Airflow Workflow Management Platform - Must have experience in managing, monitoring and troubleshooting Airflow in production environments.
- Strong knowledge of Python
- Strong expertise with Docker/Kubernetes
- Strong Expertise of writing JUnits & How to configure it through maven
- Working knowledge of building Micro Services, RESTful web Services using any framework (Spring Boot, JaxRS, Jersey)
- Good understanding of NoSQL databases and have worked upon any one of them (HBase, Cassandra, Big query, Mongo)
- Good understanding of Message Queues and have worked upon any one of them (Azure Service Bus, Kafka, RabbitMQ, Pub Sub)
- Good understanding of Maven, Git
- Good understanding of Jenkins/ Azure DevOps for CI/CD architecture
- Good understanding of Programming Algorithms and Data Structures
- Experience with BDD & Cucumber
- **Good to Have**:_
- Monitoring experience - Stack driver or Prometheus or Azure equivalent
- Operational readiness - SLI/SLO, DevOps experience
- Service mesh - ex: Istio
- Knowledge on Graph technology
- Have worked upon any of the big data technologies
- Have worked upon tools like white source, Veracode...
- Knowledge of Angular
- Good understanding of Streaming technologies and processing engines (Dataflow, Flink, Spark)
- Knowledge of Azure DevOps
**Salary**: Up to ₹2,095,535.58 per year
**Benefits**:
- Health insurance
Schedule:
- Day shift
Supplemental pay types:
- Performance bonus
Work Location: In person
**Speak with the employer**
+91 7350971253
-
Apache Spark Expert
6 months ago
Pune, India Info Origin Full timePosition Title: - Apache Spark Expert**Location**: - Pune, MH, OnsitePosition Type: - Full-TimeInterview Process: - Webcam/SkypeReq Id: - 3314Salary/Rate: - MarketPosition Duration: - Permanent**Key Responsibilities**: - Provide architectural consultancy to clients and develop implementation roadmaps for Apache Spark and Kafka solutions. - Translate...
-
AWS Big data pyspark SQL Spark Airflow
2 months ago
Pune, India ScaleneWorks Full timeJob Title: AWS Big Data Engineer About the Role: We are looking for a highly skilled AWS Big Data Engineer with extensive experience in PySpark, SQL, Spark, and Airflow. The ideal candidate will have a strong background in coding and a deep understanding of big data technologies. You will be responsible for designing, developing, and maintaining big data...
-
Airflow Developer
1 week ago
Pune, India Atos Full timeThe ideal candidate will be responsible for developing high-quality applications. They will also be responsible for maintain & enhance the script. Role Description : Requirements: • Technical Skills: o Proficiency in Airflow and Python scripting, with experience in developing DAG for automation. o Proficiency in PowerShell scripting with experience in...
-
Airflow Developer
1 week ago
Pune, India Atos Full timeThe ideal candidate will be responsible for developing high-quality applications. They will also be responsible for maintain & enhance the script. Role Description : Requirements: • Technical Skills: o Proficiency in Airflow and Python scripting, with experience in developing DAG for automation. o Proficiency in PowerShell scripting with...
-
Airflow Developer
1 week ago
Pune, India Atos Full timeThe ideal candidate will be responsible for developing high-quality applications. They will also be responsible for maintain & enhance the script. Role Description : Requirements:• Technical Skills:o Proficiency in Airflow and Python scripting, with experience in developing DAG for automation.o Proficiency in PowerShell scripting with experience in...
-
DevOps
3 months ago
Pune, Maharashtra, India Capgemini Full time**Migration exp from Apache Kafka to Confluent Kafka**: - **Devops and Kubernets**: - **Design, deploy, and maintain Kafka clusters across multiple environments (development, testing, production).**: - **Configure Kafka brokers, topics, partitions, and ACLs (Access Control Lists) as per security requirements.**: - **Monitor Kafka infrastructure...
-
DevOps
2 months ago
Pune, Maharashtra, India Capgemini Full time**Migration exp from Apache Kafka to Confluent Kafka**: - **Devops, Kubernetes.**: - **Design, deploy, and maintain Kafka clusters across multiple environments (development, testing, production).**: - **Configure Kafka brokers, topics, partitions, and ACLs (Access Control Lists) as per security requirements.**: - **Monitor Kafka infrastructure...
-
Data Engineer
7 months ago
Pune, India HyrEzy Talent Solutions Full timeJob Description and Responsibilities :Solicit business, functional, non-functional and technical requirements through interviewing and requirements gathering process.Analyze and document above requirements and data definitions, perform data analysis, assist in change management, training and testing efforts.Works with stakeholders to gather requirements on...
-
DevOps
4 months ago
Pune, Maharashtra, India Capgemini Full timeMigration exp from Apache Kafka to Confluent Kafka - 5+years - Devops, Kubernetes - Design, deploy, and maintain Kafka clusters across multiple environments (development, testing, production). - Configure Kafka brokers, topics, partitions, and ACLs (Access Control Lists) as per security requirements. - Monitor Kafka infrastructure performance and ensure high...
-
Data Scientist with Expertise in Apache Spark
3 weeks ago
Pune, Maharashtra, India Talent Sketchers Full timeTalent Sketchers is seeking a highly skilled Data Scientist to join our team.Estimated Salary: ₹1500000 - ₹2000000 per annum (depending on experience)The ideal candidate will have 5+ years of experience in designing, developing, and maintaining large-scale data processing systems using Apache Spark.The successful candidate will be responsible...
-
Senior Dev-DATA-CCO Belgium Lead
1 month ago
Pune, Maharashtra, India F337 Deutsche India Private Limited, Pune Branch Full timeJob DescriptionIn this Senior Developer role at F337 Deutsche India Private Limited, Pune Branch, you will be part of a dynamic team driving change initiatives across the organization.Key Responsibilities:Design and implement solutions that align with architecture principles to drive the Bank towards its desired target state.Work closely with data modelers...
-
(Only 24h Left) Airflow Developer
1 week ago
Pune, India Atos Full timeThe ideal candidate will be responsible for developing high-quality applications. They will also be responsible for maintain & enhance the script.Role Description :Requirements:• Technical Skills:o Proficiency in Airflow and Python scripting, with experience in developing DAG for automation.o Proficiency in PowerShell scripting with experience in managing...
-
Software Engineer
1 month ago
Pune, India SPG CONSULTING AND SOLUTIONS SERVICES PVT LTD Full timeSoftware Engineer - NiFi - Data ServicesSkill : NiFiBand : C1Location : PAN IndiaKey Responsibilities : - Proficiency in Apache NiFi, including developing, deploying, and managing NiFi data flows.(Primary)- Strong knowledge of data integration and ETL processes.(Primary)- Databases : Proficient in working with MySQL, Oracle, HBase, and MongoDB.(primary)-...
-
Azure Devops
4 weeks ago
Hyderabad / Secunderabad, Telangana, Pune, India Zeonova Software Technologies LLP Full timePosition - Senior DevOps EngineerLocation - Pune/Hyderabad/GurgaonExperience - 6+ Years Must have:6+ years experience in developing and implementing ETL pipelines from various data sources using Databricks on cloudSome experience in insurance domain/ data is mustProgramming Languages – SQL, PythonTechnologies - IaaS (AWS or Azure or GCP), Databricks...
-
DevOps Administrator
6 months ago
Pune, Maharashtra, India MNR Solutions Pvt Ltd Full time**Job Title: Senior DevOps Administrator** **Location**: Pune, India (Domestic and international travel may be required) **Key Responsibilities**: - Manage SDLC tools and Application Life Cycle management platforms such as Jira, Polarion, Spira, Confluence, Android Studio, Visual Studio, Visual Studio for Mac, Visual Code, and Eclipse. - Configure and...
-
Cloud Engineer
2 days ago
Pune, India Tata Consultancy Services Full timeCloud Data Engineer (AWS, Snowflake, Python)Experience : 5–10 YearsLocation : Mumbai/PuneJob Summary :We are seeking a highly skilled Cloud Data Engineer with expertise in AWS Cloud Computing, Snowflake, and Data Lake technologies. The ideal candidate will design, develop, and maintain scalable data solutions and pipelines, leveraging AWS services and...
-
Java Developer with Cloud and DevOps Expertise
4 weeks ago
Pune, Maharashtra, India Virtusa Full timeVirtusa is seeking a skilled Java developer to join our team. As a Java Developer with Cloud and DevOps Expertise, you will be responsible for designing, developing, and deploying cloud-native microservices using Spring Security, Apache Kafka, and Oracle.About the RoleThis experienced role requires a strong understanding of Core Java, JDK 17, and Loan IQ....
-
Investments-Senior Engineer
7 months ago
Pune, India F337 Deutsche India Private Limited, Pune Branch Full timeDescription Our Investments – agile teams at Deutsche Bank - Private Bank (TDI) develop and maintain applications for securities business of Private Customers. Changes are generally announced on short notice due to regulatory requirements or time to market challenges. Quality and stability has priority together with time to market. By working in an...
-
Edgematics | Lead Data Engineer | pune
4 weeks ago
pune, India Edgematics Full timeJob Description: We’re on the lookout for a passionate engineer to build cutting-edge data platforms using Apache Spark (PySparks, Airflow), Snowflake , modern cloud technologies and Databricks . Your expertise will help drive real-time supply chain planning and embrace Generative AI . Skills Needed : 5+ years in data engineering Proficient in ...
-
DevOps Infra Support
6 months ago
Pune, Maharashtra, India Virtusa Full timeRole : Devops Infra Support Exp : 6 - 8 years **Job Description**: Responsibilities: DevOPs infra support, real hands-on resource with min 5-6 years experience Required Skills: 6+ years of Strong Dev Ops with Infrastructure background and experience Must have experience in Jenkins, Openshift, Kubernetes, CI/CD Pipeline Must have experience in Tomact...