Data Engineer

2 days ago

Hyderabad Secunderabad Telangana Chennai, India beBeeData Full time US$ 1,20,000 - US$ 2,00,000

As a Data Architect, you will design and develop robust data pipelines for real-time and batch data ingestion and processing. This role is crucial for leveraging technologies like Confluent Kafka, ksqlDB, Kafka Connect, and Apache Flink to build scalable and reliable data solutions.

Key Responsibilities
  • Design and Develop Data Pipelines: Create sophisticated data pipelines for real-time and batch data ingestion and processing using Confluent Kafka, ksqlDB, Kafka Connect, and Apache Flink.
  • Kafka Connector Expertise: Build and configure Kafka Connectors to ingest data from various sources (databases, APIs, message queues, etc.) into Kafka.
  • Stream Processing: Develop Flink applications for complex event processing, stream enrichment, and real-time analytics.
  • ksqlDB Optimization: Develop and optimize ksqlDB queries for real-time data transformations, aggregations, and filtering.
  • Data Quality & Monitoring: Implement robust data quality checks and monitoring to ensure data accuracy and reliability throughout the pipeline.
  • Performance Tuning: Monitor and troubleshoot data pipeline performance, identify bottlenecks, and implement effective optimizations.
  • Automation: Automate data pipeline deployment, monitoring, and maintenance tasks to enhance efficiency.
  • Continuous Learning: Stay up-to-date with the latest advancements in data streaming technologies and best practices.
Qualifications
  • Bachelor's degree or higher from a reputed university.
  • Extensive total experience with a significant focus on ETL/ELT, big data, and Kafka.
  • Proficiency in developing Flink applications for stream processing and real-time analytics.
  • Strong understanding of data streaming concepts and architectures.
  • Extensive experience with Confluent Kafka, including Kafka Brokers, Producers, Consumers, and Schema Registry.
  • Hands-on experience with ksqlDB for real-time data transformations and stream processing.
  • Experience with Kafka Connect and building custom connectors.
  • Extensive experience in implementing large-scale data ingestion and curation solutions.
  • Good hands-on experience in the big data technology stack with any cloud platform.
  • Excellent problem-solving, analytical, and communication skills.
  • Ability to work independently and as part of a team.

  • Data Engineer

    1 week ago

    Chennai, Tamil Nadu, India Quantrail Data Full time US$ 60,000 - US$ 1,00,000 per year

    Location: Chennai, India (On-site)Duration: 3 monthsStipend: UnpaidEligibility:2025 graduates onlyConversion: Opportunity for a full-time role based on performance Note: Please apply only if you are serious about joining us. This is a learning-focused internship, and we expect interns to be committed to upskilling themselves and contributing to real-world...

  • Data Engineer

    1 week ago

    Chennai, Tamil Nadu, India NTT DATA Full time US$ 80,000 - US$ 1,20,000 per year

    Req ID: 336026NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer - Azure to join our team in Chennai, Tamil Nādu (IN-TN), India (IN). "Job Duties: Key Responsibilities:...

  • Senior Data Engineer

    1 week ago

    Hyderabad, Telangana, India Enable Data Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Experience Required: 8+YearsMode of work: RemoteSkills Required: Azure DataBricks, Eventhub, Kafka, Architecture,Azure Data Factory, Pyspark, Python, SQL, SparkNotice Period : Immediate Joiners/ Permanent/Contract role (Can join within September 15th 2025)Design, develop, and maintain scalable and robust data solutions in the cloud using Apache Spark and...

  • Data Engineer

    1 week ago

    Chennai, Tamil Nadu, India CX Data Labs Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    HiRole - Azure Data engineerLocation - Chennai, Gurugram (5days Onsite)Full timeImmediate joiner Only (15days Notice period only)Technical Skills:o Proficiency in SQL for complex queries, database design, and optimization.o Strong experience with PySpark for data transformation and processing.o Hands-on experience with Databricks for building and managing...

  • Azure Data Engineer ll

    1 week ago

    Hyderabad, Telangana, India Enable Data Full time US$ 90,000 - US$ 1,20,000 per year

    Enable Data Incorporated is currently seeking a skilled and experienced Azure Data Engineer to join our dynamic team. As a leading provider of advanced application, data, and cloud engineering services, Enable Data has developed deep expertise across various industries. We work closely with our customers to leverage modern solutions and technologies to drive...

  • Data Engineer

    1 week ago

    Hyderabad, Telangana, India ICE Data Services Full time US$ 1,25,000 - US$ 1,75,000 per year

    Job PurposeAt Intercontinental Exchange (ICE), we engineer technology, exchanges and clearing houses that connect companies around the world to global capital and derivative markets. With a leading-edge approach to developing technology platforms, we have built market infrastructure in all major trading centers, offering customers the ability to manage risk...

  • Data Engineering Expert

    2 weeks ago

    Hyderabad / Secunderabad, Telangana, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 20,00,000

    Job Title: Senior Data EngineerAs a Senior Data Engineer, you will design, build, and support data ingestion, transformation, and delivery pipelines across structured and unstructured sources within the enterprise data engineering environment.Manage and monitor day-to-day operations of the data engineering environment to ensure high availability,...

  • Career Opportunity

    2 weeks ago

    Chennai, Tamil Nadu, India beBeeData Engineer Full time ₹ 1,04,000 - ₹ 1,30,878

    Job Summary">This role is responsible for participating as an individual contributor in project teams, troubleshooting operational issues, and providing technical solutions to operational problems.The ideal candidate will have experience with Python, SQL, and Bash Scripting, as well as knowledge of data pipeline fundamentals and general understanding of...

  • Senior Data Engineer

    1 week ago

    Hyderabad, Telangana, India Enable Data Incorporated Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Design, develop, and maintain scalable and robust data solutions in the cloud using Apache Spark and Databricks. Gather and analyse data requirements from business stakeholders and identify opportunities for data-driven insights. Build and optimize data pipelines for data ingestion, processing, and integration using Spark and Databricks. Ensure data...

  • Data & Ai Strategist

    3 days ago

    Hyderabad, Telangana, India NTT DATA Full time

    **Req ID**: 341164 We are currently seeking a Data & AI Strategist to join our team in Hyderabad, Telangana (IN-TG), India (IN). **Location**: | **Experience**: 15+ years (5+ in AI/ML architecture) **Role Overview** **Key Responsibilities** - Architect and deliver **GenAI, LLM, and agentic AI solutions**: - Excellent understanding of Agentic Frameworks,...