Data Engineer

2 days ago

Bengaluru, Karnataka, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 20,00,000
Data Engineer - Big Data Technologies">

We are seeking a highly skilled Big Data Engineer to develop, maintain and optimize data pipelines using Big Data technologies. The ideal candidate will have a strong background in PySpark, Hive and Spark optimization.

Main Responsibilities:

  • Develop, maintain and optimize data pipelines using Big Data technologies (PySpark, Hive, Spark)
  • Implement performance tuning techniques for Spark jobs to ensure optimal performance
  • Work closely with data scientists, analysts and other stakeholders to understand data requirements and deliver scalable data solutions
  • Perform data validation, transformation and aggregation to prepare datasets for analytics
  • Participate in design reviews and code reviews to maintain high-quality coding standards
  • Monitor and troubleshoot data workflows in production environments
  • Maintain documentation related to data engineering processes, architecture and data flow

Requirements:

  • Strong experience with Big Data technologies – Spark, PySpark, Hive
  • Expertise in Spark job optimization and performance tuning
  • Proficient in Python and Java for building scalable data applications
  • Solid understanding of distributed computing and data processing frameworks
  • At least 4 years of relevant experience
  • Experience with Google Cloud Platform (GCP) and its data services (e.g., BigQuery, Dataflow, Dataproc)
  • Experience working in Agile/Scrum environments
  • Bachelor's or Master's degree in Computer Science, Information Technology or a related field

About Us:

We are a digital engineering company focused on delivering expert services and products to help enterprises achieve their transformation goals.

  • Urgent Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India NTT Data Full time

    Job DescriptionNTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer - ETL to join our team in Bangalore, Karntaka (IN-KA), India (IN).Job Duties:. Migrate ETL workflows from...

  • Data Engineer

    4 weeks ago

    Bengaluru, Karnataka, India NTT DATA North America Full time

    Job DescriptionReq ID: 330827NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer to join our team in Bengaluru, Karntaka (IN-KA), India (IN).Sr Developer - Data...

  • Data Engineer

    1 week ago

    Bengaluru, Karnataka, India NTT DATA North America Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Req ID: NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer (Talend &Pyspark) to join our team in Bangalore, Karnātaka (IN-KA), India (IN)."Job Duties: Key...

  • Etl / Data Engineer With Snowflake Experience

    4 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Req ID 318488NTT DATA strives to hire exceptional innovative and passionate individuals who want to grow with us If you want to be part of an inclusive adaptable and forward-thinking organization apply now We are currently seeking a ETL Data Engineer with Snowflake Experience to join our team in Bangalore Karnxc4x81taka IN-KA India IN Job...

  • Digital Engineering Sr. Engineer

    3 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Req ID 268395NTT DATA Services strives to hire exceptional innovative and passionate individuals who want to grow with us If you want to be part of an inclusive adaptable and forward-thinking organization apply now We are currently seeking a Digital Engineering Sr Engineer to join our team in Bangalore Karnxc4x81taka IN-KA India IN Role...

  • High Salary) Data Engineer

    4 days ago

    Bengaluru, Karnataka, India NTT Data Full time

    Job DescriptionNTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer (HRIS) to join our team in Bangalore, Karntaka (IN-KA), India (IN).Job Duties: Key ResponsibilitiesData...

  • Senior Associate Data Engineer

    2 days ago

    Bengaluru, Karnataka, India NTT DATA, Inc. Full time

    Job DescriptionMake an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion its a place where you can grow, belong and thrive.Your day at NTT DATAThe...

  • 3 Days Left Data Engineer

    6 days ago

    Bengaluru, Karnataka, India NTT Data Full time

    Job DescriptionNTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer (HRIS,Tableau and BI) to join our team in Bangalore, Karntaka (IN-KA), India (IN).Job Duties: Key...

  • GCP Data Engineer

    2 days ago

    Bengaluru, Karnataka, India CustomerLabs ❤️ 1P Data OPs Full time

    Position Overview:"Yesterday is history, tomorrow is a mystery, but today is a gift. That's why we call itthe present." - Master OogwayJoin CustomerLabs' dynamic data team as a Data Engineer and play a pivotal role intransforming raw marketing data into actionable insights that power our digitalmarketing platform. As a key member of our data infrastructure...

  • GCP Data Engineer

    17 hours ago

    Bengaluru, Karnataka, India CustomerLabs ❤️ 1P Data OPs Full time

    Position Overview: "Yesterday is history, tomorrow is a mystery, but today is a gift. That's why we call it the present." - Master Oogway Join CustomerLabs' dynamic data team as a Data Engineer and play a pivotal role in transforming raw marketing data into actionable insights that power our digital marketing platform. As a key member of our data...