Kafka Lead

1 day ago

Remote, India Coders Brain Technology Full time ₹ 1,50,00,000 - ₹ 3,00,00,000 per year
Expertise in ETL optimization, designing, coding, and tuning big data processes using Apache Spark or similar technologies.
Experience building robust and scalable data integration (ETL) pipelines using SQL, Python, Spark or PySpark. Advanced knowledge in one of the programming language is must.
Maintain and enhance Confluent Kafka architecture, Confluent Kafka design principles, CI/CD Deployment procedures
Experience with building streaming applications with Confluent Kafka (Confluent Kafka preferred but open-source Kafka acceptable)
Development experience using Kafka producers, consumers, and streams (Confluent Kafka preferred but open-source Kafka acceptable)
Experience with building data pipelines and applications to stream and process datasets at low latencies.
Experience with real-time and scalable systems development using Apache Kafka or Confluent Kafka or Kafka Streams.
Show efficiency in handling data - tracking data lineage, ensuring data quality, and improving discover-ability of data.
Good understanding of AWS technologies (S3, AWS Glue, CDK, ECS, EMR, Redshift, Athena)
Sound knowledge of distributed systems and data architecture (lambda)- design and implement batch and stream data processing pipelines, knows how to optimize the distribution, partitioning, and MPP of high-level data structures.
Knowledge of Engineering and Operational Excellence using standard methodologies.
Experience with process improvement, workflow, bench marking and / or evaluation of business processes. Familiarity with CI/CD process.
Work in a fast paced agile environment.
Experience providing technical leadership and mentoring other junior engineers for best practices on data engineering.
Experience in building REST-APIs for data transfers.
Background in Java and Spring framework is a plus
Proficiency in one of JIRA, Atlassian, and Git is must.   Requirements Experience with real-time and scalable systems development using Apache Kafka or Confluent Kafka or Kafka Streams. Experience providing technical leadership and mentoring other junior engineers for best practices on data engineering. Experience in building REST-APIs for data transfers. Background in Java and Spring framework is a plus Proficiency in one of JIRA, Atlassian, and Git is must.

  • Quality Engineering Lead – Java

    6 days ago

    Remote, India Hirable Solutions Full time ₹ 10,00,000 - ₹ 15,00,000 per year

    Key ResponsibilitiesLead quality engineering across API-first, cloud-based integration projects.Collaborate with developers, architects, and DevOps engineers to design and execute robust automated test suites.Rapidly familiarise yourself with existing codebases, frameworks, and patterns, and apply them to new initiatives.Use AI-driven test generation tools...

  • Java Application Architect

    5 days ago

    Remote, India Hremedies Full time

    **Job Summary**: **Experience**: 15 to 19yrs **Technical Skills**: Gradle, Kafka Admin,SLF4J,Java,Spring Boot, Linux, Maven, Spring Framework, JDBC, XML, GIT, JSON, Kotlin, YAML, Design Patterns,JPA,JUnit5,Kafka Connect, Confluent Kafka, Kafka, Lombok **Nice to have skills**: Oracle GenAI, Application Architecture Development 7. **Shift**: Day **Roles &...

  • Lead Data Engineer(8+ Years of Exp)

    1 day ago

    Remote, India 3Pillar Global Full time ₹ 20,00,000 - ₹ 40,00,000 per year

    Embark on an exciting journey into the realm of software product development with 3Pillar We extend an invitation for you to join our team and gear up for a thrilling adventure. At 3Pillar, our focus is on leveraging cutting-edge technologies that revolutionize industries by enabling data driven decision making. As a Lead, Data Engineering, you will hold a...

  • Lead Data Engineer

    2 weeks ago

    Remote, India totHR Solutions Full time ₹ 5,01,000 - ₹ 18,44,400 per year

    Experience • 7+ years of hands-on experience in data engineering roles • 3+ years in a technical leadership position, managing data engineering teams • Proven track record of building and maintaining production BI/analytics platforms at scale • Experience with Databricks and Delta Lake in production environments • Strong background in data...

  • Lead-Data Analytics Architect(ETL)

    5 days ago

    Remote, India 712dc28f-62bf-4f2f-9400-674aca2267ef Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    ETL ArchitectLocation: Pune, India (Hybrid/Remote)Job Type: Full-TimeExperience: 10+ yearsJob Summary:We are seeking an experienced ETL Lead / ETL Architect to design, develop, and optimize scalable data pipelines. This role involves working with ETL tools (e.g. Matillion, Informatica, Talend, SSIS, ADF, AWS Glue etc), cloud data platforms (Snowflake, Azure,...

  • Senior Technical Lead

    1 day ago

    Remote, India BRAINSTER MATH LEARNING TECHNOLOGIES PRIVATE LIMITED Full time ₹ 24,00,000 - ₹ 36,00,000 per year

    Job Description:Team Leadership & Mentorship:We are seeking an experienced Senior Technical Lead to guide our multi-disciplinary engineering team, which sits at the intersection of backend, front-end, and artificial intelligence. This is a hands-on leadership role for someone who is passionate about building robust, scalable systems and mentoring a diverse...

  • Lead Data Engineer

    3 days ago

    Remote, India Coderlly Software Pvt Ltd Full time ₹ 7,00,000 - ₹ 28,42,521 per year

    Job Title : Lead Data Consultant / Senior Data EngineerExperience Level : 10+ Years (with deep Azure experience)Employment Type : Full-time / ContractRole Overview :As a Lead Data Consultant / Senior Data Engineer, you will design, develop, and lead the delivery of enterprise-scale, cloud-native data platforms for our clients, with a particular focus on...

  • Integration Solution Architect_Cynergy_Sanketa

    1 day ago

    Remote, India Coders Brain Technology Full time ₹ 2,00,00,000 - ₹ 4,00,00,000 per year

    What skills and background will be important to be successful:  A minimum of 8+ years of industry experience, with a strong integration architecture background  4-6 years of experience in delivering integration solutions with such platforms as Software AG webMethods, Kafka, and API Gateway's  Deep knowledge of integration best practices  Good...

  • Data Architect

    1 week ago

    Remote, India Alphawizz Technologies Pvt. Ltd. Full time

    **Job Title**: Data Architect (Cloud | Big Data | Analytics) **Location**: Remote **Experience**: Minimum 10+ years in data architecture, engineering, or related roles **Tech Stack Includes**: AWS Redshift | GCP BigQuery | Azure Synapse | Apache Spark | Airflow | dbt | Hadoop | Snowflake | PostgreSQL | MySQL | MongoDB | Kafka | Flink | Tableau | Power BI |...

  • Java Engineer_Infosys

    1 day ago

    Remote, India Coders Brain Technology Full time ₹ 5,00,000 - ₹ 25,00,000 per year

    Relevant Experience : 3+ Years Location: Remote Notice Period: Immediate to 30 Days Client: Infosys Job Position: Java Engineer Required Skills: Java, Spring boot, Restful API JOB DESCRIPTION : Experience on  Java, Spring boot, Restful API Must be hands-on who has built the solutions using Java before and now providing solutions using Java/Spring boot....