Big Data Engineer
2 days ago
Job Title: Senior MongoDB DBA
">">
We are seeking a highly skilled and experienced Senior MongoDB DBA to manage production MongoDB environments, architect scalable data pipelines, and design robust Change Data Capture (CDC) solutions.
">">
Key Responsibilities:
">- Architect, implement, and manage MongoDB clusters in production environments.
">- Design and implement robust backup, recovery, and disaster recovery strategies for MongoDB.
">- Perform database performance tuning, monitoring, and capacity planning to ensure high availability and optimal performance.
">">
Data Integration & CDC:
">- Design, build, and maintain CDC pipelines using Apache Kafka and Debezium.
">- Deploy and manage Debezium connectors, with strong hands-on experience specifically with the Oracle connector.
">">
Troubleshooting & Support:
">- Debug and resolve complex issues related to Debezium connectors, Kafka, and database performance in production environments.
">">
Documentation & Collaboration:
">- Create and maintain detailed technical documentation for database architecture, CDC processes, and troubleshooting steps.
">- Collaborate with engineering, data, and operations teams to deliver and support data integration solutions.
">">
Required Skills:
">MongoDB Expertise:
">- 4+ years of experience as a MongoDB DBA in production environments.
">- Deep expertise in MongoDB architecture, including replication, sharding, and high availability.
">">
Data Integration & Debezium :
">- Strong hands-on experience with Debezium, especially the Oracle connector (LogMiner).
">- Deep understanding of Oracle internals relevant to CDC, including redo logs, SCNs, archive log mode, and supplemental logging.
">">
Kafka & Ecosystem :
">- Proficiency with Apache Kafka and the broader Kafka ecosystem, including Kafka Connect and topics.
">">
Troubleshooting & Analysis :
">- Strong ability to analyze logs, metrics, and connector configurations to identify and resolve root causes of issues in a timely manner.
">">
Communication & Documentation :
">- Excellent documentation and communication skills for delivering technical assessments and sharing knowledge.
">">
Preferred Skills :
">- Experience with other CDC tools such as GoldenGate or Striim.
">- Proficiency in scripting languages like Python or Bash for automation.
">">
- Experience with cloud environments (AWS, Azure, GCP) and relevant managed services.
">">
- Knowledge of monitoring tools such as Prometheus, Grafana, or Datadog.
">">
- Experience with other NoSQL databases besides MongoDB.
">">
- Relevant certifications, such as MongoDB Certified DBA.
-
Big Data Engineer
4 days ago
Pune, Maharashtra, India Nice Software Solutions Pvt. Ltd. Full timeBig Data Engineer (PySpark) Location: Pune/Nagpur (WFO) Experience: 8 - 12 Years Employment Type: Full-time Job Overview We are looking for an experienced Big Data Engineer with strong expertise in PySpark and Big Data ecosystems. The ideal candidate will be responsible for designing, developing, and optimizing scalable data pipelines while ensuring high...
-
Big Data Engineer
1 day ago
Pune, Maharashtra, India Nice Software Solutions Pvt. Ltd. Full time ₹ 15,00,000 - ₹ 20,00,000 per yearBig Data Engineer (PySpark)Location:Pune/Nagpur (WFO)Experience:8 - 12 YearsEmployment Type:Full-timeJob OverviewWe are looking for an experiencedBig Data Engineerwith strong expertise in PySpark and Big Data ecosystems. The ideal candidate will be responsible for designing, developing, and optimizing scalable data pipelines while ensuring high performance...
-
Big Data Engineer
17 hours ago
Pune, Maharashtra, India Merito Full timeJob Description :We are looking for a Big Data Engineer who will work on building, and managing Big Data Pipelines for us to deal with the huge structured data sets that we use as an input to accurately generate analytics at scale for our valued Customers. The primary focus will be on choosing optimal solutions to use for these purposes, then maintaining,...
-
Big Data Engineer
2 weeks ago
Pune, Maharashtra, India LION AND ELEPHANTS CONSULTANCY PRIVATE LIMITED Full timeJob Description : We are looking for skilled Big Data Engineers using Java Spark with 5-10 years of experience in Big Data / legacy platforms, who can join immediately. Desired candidates should have design, development and optimization of real-time & batch data pipelines experience in a Big Data environment at an enterprise scale application. You will work...
-
Big Data Engineer
6 days ago
Pune, Maharashtra, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000Big Data Engineer">We are seeking a highly skilled Big Data Engineer to drive the design and implementation of scalable data pipelines using Apache Spark, Databricks, or equivalent big data frameworks. This is an excellent opportunity for experienced professionals to join our organization and leverage their expertise to drive business outcomes through...
-
Big Data Engineer
2 days ago
Pune, Maharashtra, India WorkiFicient Full timeTo be successful in this role, you should possess : - Collaborate closely with Product Management and Engineering leadership to devise and build the right solution.- Participate in Design discussions and brainstorming sessions to select, integrate, and maintain Big Data toolsand frameworks required to solve Big Data problems at scale.- Design and implement...
-
Big Data Engineer
2 days ago
Pune, Maharashtra, India beBeeDataEngineer Full time ₹ 1,80,00,000 - ₹ 2,50,00,000Job Title:Big Data EngineerAbout the RoleWe're seeking an experienced data engineer to lead the development of large-scale data processing pipelines using Apache Spark and related technologies.The ideal candidate will have a strong background in data warehousing, ETL concepts, and SQL/NoSQL operations.Familiarity with UNIX shell scripting for scheduling and...
-
Big Data Engineer
4 weeks ago
Pune, Maharashtra, India WorkiFicient Full timeRoles and Responsibility :- Collaborate closely with Product Management and Engineering leadership to devise and build the right solution.- Participate in Design discussions and brainstorming sessions to select, integrate, and maintain Big Data tools and frameworks required to solve Big Data problems at scale.- Design and implement systems to cleanse,...
-
Senior Big Data Engineer
1 day ago
Pune, Maharashtra, India Devlats Pvt Ltd Full time US$ 1,50,000 - US$ 2,00,000 per yearAbout The RoleWe are seeking a highly skilled and experienced Big Data Engineer to join our team. The ideal candidate will have strong expertise in designing, building, and optimizing data pipelines and architectures, as well as a solid understanding of big data tools and Responsibilities :Design, develop, and maintain scalable and high-performance data...
-
Senior Big Data Engineer
4 weeks ago
Pune, Maharashtra, India Devlats Pvt Ltd Full timeAbout the Role : We are seeking a highly skilled and experienced Big Data Engineer to join our team. The ideal candidate will have strong expertise in designing, building, and optimizing data pipelines and architectures, as well as a solid understanding of big data tools and Responsibilities : - Design, develop, and maintain scalable and high-performance...
