Data Engineer

9 hours ago

Bengaluru, Karnataka, India beBeeDataEngineer Full time ₹ 1,04,000 - ₹ 1,30,878

Job Title: Data Engineer (Spark & PySpark)

About the Role

We are seeking a highly skilled and experienced Data Engineer to join our team. As a key member of our data engineering group, you will be responsible for designing, developing, and maintaining large-scale data processing systems using Apache Spark and Python.

Your primary focus will be on developing and optimizing Spark applications, ensuring high performance, scalability, and reliability. You will also work closely with our data scientists and analysts to understand their requirements and provide solutions that meet their needs.

Responsibilities
  • Design and develop efficient data processing pipelines using Apache Spark and Python
  • Develop and maintain scalable and reliable Spark applications
  • Collaborate with data scientists and analysts to understand their requirements and provide solutions
  • Optimize Spark query performance and troubleshoot issues
  • Work with distributed file systems such as HDFS, S3, Cassandra, and DynamoDB
  • Experience with cloud services like AWS and Microsoft Azure is a plus
Requirements
  • Deep understanding of Apache Spark and its ecosystem
  • Excellent programming skills in Python
  • Experience with SQL databases such as Microsoft, Oracle, Postgres, and MySQL
  • Familiarity with Hive and other data warehousing technologies
  • Good understanding of distributed systems concepts such as CAP theorem, partitioning, replication, consistency, and consensus
  • Ability to work in a fast-paced environment and prioritize tasks effectively
Preferred Skills
  • Hive
  • Spark
  • SQL

  • Urgent Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India NTT Data Full time

    Job DescriptionNTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer - ETL to join our team in Bangalore, Karntaka (IN-KA), India (IN).Job Duties:. Migrate ETL workflows from...

  • Data Engineer

    4 weeks ago

    Bengaluru, Karnataka, India NTT DATA North America Full time

    Job DescriptionReq ID: 330827NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer to join our team in Bengaluru, Karntaka (IN-KA), India (IN).Sr Developer - Data...

  • Data Engineer

    6 days ago

    Bengaluru, Karnataka, India NTT DATA North America Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Req ID: NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer (Talend &Pyspark) to join our team in Bangalore, Karnātaka (IN-KA), India (IN)."Job Duties: Key...

  • Etl / Data Engineer With Snowflake Experience

    3 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Req ID 318488NTT DATA strives to hire exceptional innovative and passionate individuals who want to grow with us If you want to be part of an inclusive adaptable and forward-thinking organization apply now We are currently seeking a ETL Data Engineer with Snowflake Experience to join our team in Bangalore Karnxc4x81taka IN-KA India IN Job...

  • Digital Engineering Sr. Engineer

    3 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Req ID 268395NTT DATA Services strives to hire exceptional innovative and passionate individuals who want to grow with us If you want to be part of an inclusive adaptable and forward-thinking organization apply now We are currently seeking a Digital Engineering Sr Engineer to join our team in Bangalore Karnxc4x81taka IN-KA India IN Role...

  • Senior Associate Data Engineer

    8 hours ago

    Bengaluru, Karnataka, India NTT DATA, Inc. Full time

    Job DescriptionMake an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion its a place where you can grow, belong and thrive.Your day at NTT DATAThe...

  • High Salary) Data Engineer

    2 days ago

    Bengaluru, Karnataka, India NTT Data Full time

    Job DescriptionNTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer (HRIS) to join our team in Bangalore, Karntaka (IN-KA), India (IN).Job Duties: Key ResponsibilitiesData...

  • GCP Data Engineer

    4 hours ago

    Bengaluru, Karnataka, India CustomerLabs ❤️ 1P Data OPs Full time

    Position Overview:"Yesterday is history, tomorrow is a mystery, but today is a gift. That's why we call itthe present." - Master OogwayJoin CustomerLabs' dynamic data team as a Data Engineer and play a pivotal role intransforming raw marketing data into actionable insights that power our digitalmarketing platform. As a key member of our data infrastructure...

  • 3 Days Left Data Engineer

    4 days ago

    Bengaluru, Karnataka, India NTT Data Full time

    Job DescriptionNTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer (HRIS,Tableau and BI) to join our team in Bangalore, Karntaka (IN-KA), India (IN).Job Duties: Key...

  • Data Engineer with Snowflake, AWS Glue, Kafka, API

    1 day ago

    Bengaluru, Karnataka, India NTT Data Full time

    Job DescriptionNTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer with Snowflake, AWS Glue, Kafka, API to join our team in Bangalore, Karntaka (IN-KA), India (IN).- 6+...