Data Engineer

2 days ago

Bangalore, India BNP Paribas Full time

Responsibilities

Direct Responsibilities

  • Design and develop real-time and batch data pipelines using tools like Apache NiFi, Apache Kafka, and Apache Airflow.
  • Implement and maintain ETL/ELT processes, ensuring data quality and integrity across various data sources.
  • Integrate and manage data flows across diverse systems using NiFi and Kafka topics.
  • Monitor and optimize the performance of data pipelines and troubleshoot issues proactively.
  • Work with the ELK stack (Elasticsearch, Logstash, Kibana) for logging, monitoring, and real-time analytics.
  • Write efficient and optimized SQL queries for data extraction, transformation, and reporting.
  • Collaborate with data analysts and business stakeholders to develop meaningful Power BI dashboards and reports.
  • Maintain documentation for data workflows, processes, and architecture.

Required Skills:

  • Strong experience with Apache NiFi for data flow management.
  • Expertise in Kafka (streaming data, Kafka Connect, schema management).
  • Proficiency in Apache Airflow for orchestrating workflows.
  • Solid understanding of SQL (writing complex queries, tuning, indexing).
  • Experience working with the ELK stack Elasticsearch for search and analytics, Logstash for ingestion, Kibana for visualization.
  • Experience with Power BI data modeling, DAX, dashboard development.
  • Knowledge of data warehousing concepts, data modeling, and data lake architecture.

  • Data Engineer

    24 hours ago

    bangalore, India Bahwan CyberTek Full time

    Job Title: Data Engineer – Google Cloud Platform (GCP) Job Summary We are seeking a skilled and motivated Data Engineer with hands-on experience in building scalable data pipelines and cloud-native data solutions on Google Cloud Platform. The ideal candidate will be proficient in GCP services like Pub/Sub, Dataflow, Cloud Storage, and BigQuery, with a...

  • Data Engineer

    2 days ago

    Bangalore, India Synechron Full time

    Good-day, We have immediate opportunity for Data Engineer. Job Role: Data Engineer Job Location: Synechron ( Bengaluru) Experience- 7 to 12 years Notice : Only immediate joiner . About Company: At Synechron, we believe in the power of digital to transform businesses for the better. Our global consulting firm combines creativity...

  • Data Engineer

    23 hours ago

    bangalore, India Synechron Full time

    Good-day,We have immediate opportunity for Data Engineer.Job Role: Data EngineerJob Location: Synechron ( Bengaluru)Experience- 7 to 12 yearsNotice : Only immediate joiner .About Company:At Synechron, we believe in the power of digital to transform businesses for the better. Our global consulting firm combines creativity and innovative technology to deliver...

  • Data Engineer

    2 days ago

    Bangalore, India Alp Consulting Ltd. Full time

    Role: Data Engineer Location : Bangalore Experience: 3 to 8Years SKILLS & CERTIFICATIONS Strong interest and acumen for solving large-scale data engineering problems. Hands-on technical and functional experience in building large scale data engineering capabilities in diverse big-data environments Strong hands-on expertise in data...

  • Data Engineer

    21 hours ago

    bangalore, India Alp Consulting Ltd. Full time

    Role: Data EngineerLocation : BangaloreExperience: 3 to 8YearsSKILLS & CERTIFICATIONSStrong interest and acumen for solving large-scale data engineering problems.Hands-on technical and functional experience in building large scale data engineering capabilities in diverse big-data environmentsStrong hands-on expertise in data engineering:Enterprise grade ETL...

  • Data Engineer

    24 hours ago

    bangalore, India Insight Global Full time

    100% Remote Data Engineer Required Skills & Experience5+ years of experience as a Data EngineerExpertise in Python, Pyspark and SQLHands-on Python/PySpark coding experienceStrong Big Data experience, GCP preferredTelemetry experienceStreaming experience with analytics and data processingBusiness analytics experience and working directly with business...

  • Data Engineer

    2 days ago

    Bangalore, India Recro Full time

    Role - Data Engineer Location - Bangalore Experience - 2-4 Yrs Key Responsibilities Design, build, and optimize scalable data pipelines for batch and real-time data processing. Develop and maintain ETL (Extract, Transform, Load) processes to integrate data from multiple sources. Manage and optimize data storage solutions (data warehouses,...

  • Data Engineer

    22 hours ago

    bangalore, India Recro Full time

    Role - Data EngineerLocation - BangaloreExperience - 2-4 YrsKey ResponsibilitiesDesign, build, and optimize scalable data pipelines for batch and real-time data processing.Develop and maintain ETL (Extract, Transform, Load) processes to integrate data from multiple sources.Manage and optimize data storage solutions (data warehouses, data lakes, relational...

  • Data Engineer

    23 hours ago

    bangalore, India VAANTECH Full time

    We’re Hiring: Data EngineerPosition: Data EngineerExperience Required: 3+ YearsNotice Period: Immediate Joiner (or within 15 days)Location: Chennai (Remote)Shift: Includes Night Shifts (US Shift)Preferred Candidates: From Chennai, Andhra Pradesh, Kerala & BangaloreSkills We’re Looking For:SQL, Python, ETLApache AirflowData Pipeline Optimization &...

  • Data Engineer

    22 hours ago

    bangalore, India R Systems Full time

    Job Title: Data EngineerContract Period: 12 MonthsLocation: Offshore candidates accepted (Singapore Based Company)Work Timing : 6.30 AM to 3.30 PM or 7.00 AM to 4.00 PM (IST - India timing)ExperienceMinimum 4+ years as a Data Engineer or similar role.(Please don't apply if less than 4 years exp in Data Engineer)Proven experience in Python, Spark, and PySpark...