Senior Big Data Engineer for Scalable Data Pipelines

2 weeks ago


Bengaluru, Karnataka, India WEN Full time
Big Data Developer Opportunity at WEN

We are seeking a highly skilled Big Data Developer to join our dynamic team at WEN. The ideal candidate will have hands-on experience in developing and optimizing data processing pipelines and possess strong expertise in big data technologies.

Job Description Overview

In this role, you will be responsible for designing, implementing, and maintaining scalable data processing applications using Scala, Spark, and related big data technologies. You will also work with cross-functional teams to define, design, and deliver new features, as well as provide technical guidance on data architecture and infrastructure requirements.

Key Responsibilities
  • Develop, test, and deploy scalable data processing applications using Scala, Spark, and related big data technologies.
  • Design and implement data pipelines to process structured and unstructured data.
  • Write optimized and efficient code in Scala and Python/PySpark for data transformation and analysis.
  • Work with SQL and NoSQL databases to manage and query large datasets.
  • Integrate applications within the Hadoop ecosystem (HDFS, Hive, HBase, etc.).
Required Skills and Qualifications
  • Proficiency in Scala coding with a solid understanding of functional programming concepts.
  • Extensive experience with Apache Spark for data processing and analytics.
  • Hands-on experience in Python/PySpark for data engineering tasks.
  • Proficiency in querying and working with SQL/NoSQL databases (e.g., MongoDB, Cassandra).
  • Familiarity with the Hadoop ecosystem and big data technologies.
  • Prior experience in Java development is preferred.
  • Strong problem-solving skills and the ability to optimize complex data workflows.
  • Bachelor's degree in Computer Science, Engineering, or a related field.
  • 3+ years of experience in big data development and distributed systems.
  • Excellent communication and collaboration skills.
Salary and Benefits

The estimated annual salary for this position is $140,000 - $160,000 depending on experience and qualifications. Additionally, WEN offers a comprehensive benefits package, including health insurance, retirement plans, and paid time off.



  • Bengaluru, Karnataka, India NTT DATA Full time

    About the RoleWe are seeking a highly skilled Data Engineer to join our team in Bangalore, India. This role involves designing, building, and maintaining scalable data pipelines using Databricks on AWS.The ideal candidate will have experience with Databricks, including Apache Spark development, and proficiency in Python or Scala for Spark job development....

  • Senior Data Engineer

    2 weeks ago


    Bengaluru, Karnataka, India Coders Brain Technology Private Limited Full time

    Job Description:Coders Brain Technology Private Limited is seeking a highly skilled Senior Data Engineer to join our team. As a Senior Data Engineer, you will be responsible for designing and developing big data pipelines using AWS Databricks.About the Role:We are looking for a seasoned professional with hands-on experience in AWS Databricks, Spark, and...


  • Bengaluru, Karnataka, India NTT DATA Full time

    NTT DATA is a global technology services company with a presence in over 50 countries.We have a wide range of job opportunities available for talented professionals like you.About the Job:Job DescriptionWe are seeking a Senior Cloud Data Architect to join our team in Bangalore, India. The successful candidate will be responsible for designing and...


  • Bengaluru, Karnataka, India NTT DATA Services Full time

    About the RoleWe are seeking a highly skilled Cloud Data Engineer to join our team in Bangalore, India. As a key member of our data engineering team, you will design, build, and maintain scalable data pipelines using Databricks on AWS.Job Responsibilities:Design and develop efficient data pipelines using Apache Spark and Databricks.Ingest data from multiple...


  • Bengaluru, Karnataka, India AppSierra Solutions Pvt Ltd Full time

    We are seeking a seasoned data engineer to lead the development and deployment of big data pipelines using AWS DataBricks.With 5-7 years of experience in software development on AWS, you will have strong hands-on knowledge of AWS DataBricks, DevOps, Kubernetes, and cloud services such as S3, Redshift, EC2, and Lambda. Additionally, you will have extensive...

  • Data Engineer

    1 month ago


    Bengaluru, Karnataka, India Nexthire Full time

    Job DescriptionWe are seeking a skilled Data Engineer to join our team and contribute to the design and development of scalable data pipelines.Main Responsibilities:Data Pipeline Design: Design, develop, and maintain scalable and robust data pipelines to support various data processing and analytics needs.Collaboration: Collaborate with data scientists,...


  • Bengaluru, Karnataka, India Tiger Analytics Full time

    Job OverviewTiger Analytics is a global AI and analytics consulting firm that empowers organizations to harness the power of data and technology.We are seeking an experienced Big Data Engineer to join our team in Chennai, Hyderabad, or Bangalore. As a key member of our data engineering team, you will design, build, and maintain scalable data solutions on...


  • Bengaluru, Karnataka, India AKIRA Insights Full time

    About AKIRA InsightsAkira Insights is a boutique pure-play data and analytics consulting firm providing services to multinational corporations, large enterprises, and Fortune 500s from various sectors. The company's mission is to help businesses unlock valuable insights from their data.Job Title: Senior Data Architect (Big Data Engineer)We are seeking an...


  • Bengaluru, Karnataka, India IT Source Global Full time

    Job Title: Senior Big Data EngineerJob Description:We are seeking a highly skilled Senior Big Data Engineer to join our team at IT Source Global. As a Senior Big Data Engineer, you will be responsible for designing and implementing scalable, fault-tolerant data pipelines using Hadoop and Spark.Key Responsibilities:Design and implement data pipelines using...

  • Cloud Engineer

    2 weeks ago


    Bengaluru, Karnataka, India NTT DATA Full time

    Job OverviewNTT DATA, a global leader in business and technology services, is seeking a highly skilled Cloud Engineer - Data Specialist to join our team in Bangalore, India.About the RoleWe are looking for an experienced Cloud Engineer with expertise in designing, building, and maintaining scalable data pipelines using Databricks on AWS. The ideal candidate...


  • Bengaluru, Karnataka, India Creencia Technologies Pvt Ltd Full time

    Job Title: Senior Big Data SpecialistAbout the Role: We are seeking an experienced Senior Big Data Specialist to join our team at Creencia Technologies Pvt Ltd. The ideal candidate will have a strong background in designing and developing scalable data pipelines using Scala programming, Java, GCP, and Spark.Key Responsibilities: Design, develop, and maintain...

  • Data Engineer

    2 weeks ago


    Bengaluru, Karnataka, India Nexthire Full time

    Role SummaryWe are seeking an experienced Data Engineer to design, develop, and maintain scalable and robust data pipelines that support various data processing and analytics needs.This role involves collaborating with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions that meet their needs.About the...

  • Big Data Engineer

    3 weeks ago


    Bengaluru, Karnataka, India krtrimaIQ Cognitive Solutions Full time

    krtrimaIQ Cognitive Solutions is well prepared to transform organizations into Intelligent Enterprises.The RoleWe are seeking an experienced Scala Developer with a strong background in Kafka and Big Data technologies.You will work closely with our data engineering and AI teams to build and maintain high-performance data pipelines and applications.Key...


  • Bengaluru, Karnataka, India NTT DATA Services Full time

    Data Engineering Senior Specialist RoleDiverse and dynamic Data Engineering activities on Azure Data platform. The role involves building and delivering Data pipelines connecting various enterprise data sources, both RDBMS and NoSQL. Develop data mappings to existing data sources and design big data processing notebooks using Azure Databricks. Scripting and...

  • Data Engineer

    3 weeks ago


    Bengaluru, Karnataka, India Genpact Full time

    At Genpact, we empower businesses to create lasting value for their clients by leveraging our deep business and industry knowledge, digital operations services, and expertise in data, technology, and AI.We are seeking a highly skilled Data Engineer - Scalable Data Pipelines Specialist to join our team.ResponsibilitiesAs a Data Engineer, you will work closely...


  • Bengaluru, Karnataka, India NTT DATA Full time

    About the Role:As a Cloud Data Engineer, you will be responsible for designing and implementing large-scale data processing systems using GCP's BigQuery, Dataflow, and Dataproc technologies. Your expertise in ETL/ELT pipelines, data warehousing, and lakehouse solutions will enable us to efficiently process structured and unstructured data.Key...

  • Data Architect

    2 weeks ago


    Bengaluru, Karnataka, India Kognivera It Solutions Private Limited Full time

    Seeking an experienced Data Architect with a proven track record in designing and implementing scalable big data solutions on distributed platforms. As a key member of our team, you will be responsible for architecting data products using AWS services, data warehousing tools, and designing data platforms.About UsKognivera It Solutions Private Limited is a...


  • Bengaluru, Karnataka, India Hexaware Technologies Full time

    We are seeking a skilled Data Engineer to join our team at Hexaware Technologies. This role will focus on designing and developing scalable data pipelines using Databricks and Apache Spark. The ideal candidate should have 5+ years of experience in data engineering and be proficient in integrating various data sources, including databases, APIs, and cloud...


  • Bengaluru, Karnataka, India Acrocede Technologies Private Limited Full time

    Acrocede Technologies Private Limited is seeking a highly skilled and experienced Data Engineer to join its dynamic team.The ideal candidate will have extensive experience working with Hadoop platforms, expertise in Spark, Python, SQL, and knowledge of cloud-based solutions using AWS services such as S3, Glue, and Lambda.This role requires the ability to...

  • Big Data Expert

    1 week ago


    Bengaluru, Karnataka, India KrtrimaIQ Cognitive Solution Full time

    We are seeking an experienced Big Data Expert to join KrtrimaIQ Cognitive Solution. This role requires hands-on expertise in big data technologies and the ability to design and implement robust data processing solutions.The ideal candidate should have over 5 years of experience with Kafka, PySpark, Python/Scala, Spark, SQL, and the Hadoop ecosystem. Key...