Data Integration Specialist

2 days ago

Mumbai, Maharashtra, India beBeeDataIntegration Full time ₹ 18,37,500 - ₹ 25,15,000

Real-Time Data Integration Expert

We are seeking an experienced professional to lead our real-time data integration efforts.

This role requires designing and implementing high-performance pipelines that enable instant data availability for analytics, operational reporting, and downstream systems, ensuring data integrity and scalability in a fast-paced environment.

The ideal candidate will have hands-on experience in designing, implementing, and managing real-time data pipelines using Debezium, Kafka, and related technologies.

Key Responsibilities:
  • Design and Develop Real-Time Ingestion Pipelines: Utilize CDC from relational and NoSQL databases to create efficient data pipelines.
  • Implement Data Streaming Solutions: Leverage Apache Kafka, Kafka Connect, and Debezium to design and deploy scalable data streaming solutions.
  • Configure and Monitor Debezium Connectors: Ensure accurate data capture by configuring and monitoring Debezium connectors.
  • Develop Real-Time Data Transformation Logic: Utilize Spark Streaming, Flink, or Kafka Streams to develop efficient data transformation logic.
  • E nsure Data Quality and Governance: Collaborate with cross-functional teams to ensure data quality, consistency, and governance across real-time pipelines.
  • Troubleshoot Pipeline Issues: Troubleshoot and resolve pipeline, Kafka cluster, and connector issues to ensure high uptime.
Required Skills and Qualifications:
  • Real-Time Data Integration: Strong experience with CDC mechanisms.
  • Streaming Technologies: Proficiency in Apache Kafka, Kafka Connect, and Kafka Streams.
  • CDC Tools: Hands-on expertise with Debezium.
  • Programming Languages: Experience with Python or Java (Spring Boot, REST APIs), Shell scripting.
  • Big Data Technologies: Familiarity with Apache Spark Streaming and Apache Flink.
  • Cloud Platforms: Experience with GCP (BigQuery, Data Lakes) or equivalent platforms.
  • Databases: Relational and NoSQL databases for CDC integration.
  • SQL: Advanced querying and validation skills.
  • DevOps: Knowledge of Docker, Kubernetes, and CI/CD deployment.
  • Monitoring Tools: Familiarity with Prometheus and Grafana for real-time data health.
Benefits:
  • Collaborative Work Environment: Join a team of experts who share your passion for real-time data integration.
  • Professional Development: Opportunities for growth and development in a rapidly evolving field.
  • Competitive Compensation: Competitive salary and benefits package.

  • Data Integration Specialist

    1 day ago

    Mumbai, Maharashtra, India beBeeDataIntegration Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Data Integration SpecialistKey Responsibilities:Design and develop mappings/transformations using Informatica Powercenter.Utilize Oracle SQL/PLSQL and Unix to deliver high-quality solutions.Collaborate effectively in a team environment.A successful data integration specialist should possess strong technical skills, excellent communication skills,...

  • Data Integration Specialist

    2 days ago

    Mumbai, Maharashtra, India beBeeDataIntegration Full time ₹ 1,80,00,000 - ₹ 2,50,00,000

    Job Overview:We are seeking a highly skilled Data Integration Specialist to design, implement, and maintain Business Intelligence and Data warehousing solutions using Oracle Data Integrator (ODI). This is an exciting opportunity for an individual with strong technical skills and excellent communication abilities.Main Responsibilities:Design and develop...

  • Data Integration Specialist

    2 days ago

    Mumbai, Maharashtra, India beBeeDataIntegration Full time ₹ 9,00,000 - ₹ 12,00,000

    Imagine a role that combines technical expertise with business acumen, driving data integration processes to unlock organizational insights. As a skilled Data Integration Specialist, you will design, develop, and maintain ETL workflows using IBM Cognos Data Integration tools.Key ResponsibilitiesDesign and Develop: Create efficient ETL processes to extract,...

  • Data Integration Specialist

    1 week ago

    Mumbai, Maharashtra, India beBeeDataIntegration Full time ₹ 8,00,000 - ₹ 12,00,000

    Job DescriptionWe are seeking a Data Integration Specialist to join our team. The ideal candidate will have experience in designing, implementing, and maintaining data integration solutions using Oracle Data Integrator (ODI).Key ResponsibilitiesDesign and implement ODI load plans and processes.Develop and maintain ETL scripts using PL/SQL.Work with SQL,...

  • Data Integration Specialist

    2 weeks ago

    Mumbai, Maharashtra, India MProfit Full time

    Job Summary: We are looking for a Data Integration Specialist to support our growing data integration team. In this role, you will gain a deep understanding of the various data integrations MProfit has built for financial institutions and contribute to the creation of new integrations using our in-house templating language. This position offers an excellent...

  • Data Integration Specialist

    3 days ago

    Mumbai, Maharashtra, India MProfit Full time US$ 80,000 - US$ 1,20,000 per year

    Job Summary:We are looking for a Data Integration Specialist to support our growing data integration team. In this role, you will gain a deep understanding of the various data integrations MProfit has built for financial institutions and contribute to the creation of new integrations using our in-house templating language. This position offers an excellent...

  • Data Integration Expert

    2 days ago

    Mumbai, Maharashtra, India beBeedataintegration Full time ₹ 9,00,000 - ₹ 12,00,000

    Data Integration SpecialistWe are seeking a highly skilled Data Integration Specialist to join our team. This role will involve managing and overseeing data integration from various sources, including market data providers, portfolio management systems, and custodians.

  • Senior Data Integration Specialist

    2 days ago

    Mumbai, Maharashtra, India beBeeDataIntegration Full time ₹ 10,00,000 - ₹ 15,00,000

    Job Position: Senior Data Integration SpecialistAbout the Role:We are seeking a highly skilled professional to join our team as a Senior Data Integration Specialist.Key Responsibilities:Lead the installation, configuration, and management of IBM DataStage and its related components.Develop and implement ETL processes, data warehousing concepts, and data...

  • Data Integration Specialist

    1 week ago

    Mumbai, Maharashtra, India beBeeInformatica Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Role: Informatica PowerCenter SpecialistLocation: Remote, APAC, IST, UKShift : Flexible 24/7 Support ModelNotice Period: ImmediateJob DescriptionWe are seeking an experienced Informatica PowerCenter Specialist to join our data integration and operations team. The candidate will be responsible for ETL development, support, data cleansing, quality control, and...

  • Data Integration Expert

    28 minutes ago

    Mumbai, Maharashtra, India beBeeDataIntegration Full time ₹ 8,00,000 - ₹ 15,00,000

    ETL Data Integration SpecialistAs a key member of our data team, the ETL (Extract, Transform, Load) Data Integration Specialist will play a crucial role in ensuring the quality and integrity of our data processing systems.Responsibilities:Understand requirements from high-level design documents to drive business decisionsDevelop comprehensive knowledge of...