Senior Big Data Engineer

1 week ago

Pune Maharashtra Bangalore Karnataka, India beBeeDataEngineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

Unlock your potential in a challenging and rewarding role as a Data Architect. At HSBC, we're seeking an experienced professional to join our team and take their skills to the next level.

About This Opportunity

  • This is a senior software engineer position where you will be working on designing and developing complex software systems using Scala or Java.
  • You will be responsible for leading development teams and ensuring that requirements are correctly interpreted and implemented.

Key Responsibilities:

  1. Software Design: You will be designing software systems using Scala or Java development and design principles.
  2. Development: You will be responsible for developing software systems using Apache Hadoop, Scala, Apache Spark, Spark streaming, YARN, Kafka, Hive, Python, ETL frameworks, Map Reduce, SQL, and RESTful services.
  3. Liaison with BAs: You will be liaising with Business Analysts to ensure that requirements are correctly interpreted and implemented.
  4. Participation in Planning and Status Meetings: You will be participating in regular planning and status meetings.
  5. Input to the Development Process: You will be providing input to the development process through involvement in Sprint reviews and retrospectives.
  6. Peer Code Reviews: You will be participating in peer code reviews.

Requirements:

  • Scala or Java Development: You must have experience with Scala or Java development and design.
  • Apache Technologies: You must have experience with most of the following technologies: Apache Hadoop, Scala, Apache Spark, Spark streaming, YARN, Kafka, Hive, Python, ETL frameworks, Map Reduce, SQL, and RESTful services.
  • Unix/Linux Platform: You must have sound knowledge of working on Unix/Linux platforms.
  • Data Pipelines: You must have hands-on experience building data pipelines using Hadoop components - Hive, Spark, and Spark SQL.
  • Version Control Tools: You must have experience with industry standard version control tools like Git and GitHub.
  • Automated Deployment Tools: You must have experience with automated deployment tools like Ansible and Jenkins.

  • Senior Data Engineer for Big Data Platforms

    6 days ago

    Chennai, Pune, Bengaluru / Bangalore, India beBeeDataEngineering Full time ₹ 12,00,000 - ₹ 30,00,000

    Job Title: Senior Data Engineer for Big Data PlatformsWe are looking for an experienced Senior Data Engineer to join our team and help us build, maintain and optimize our big data platforms. As a key member of our engineering team, you will be responsible for designing, developing, testing, and deploying large-scale data processing systems using distributed...

  • Big Data Engineer

    5 days ago

    Pune, Maharashtra, India Merito Full time

    Job Description :We are looking for a Big Data Engineer who will work on building, and managing Big Data Pipelines for us to deal with the huge structured data sets that we use as an input to accurately generate analytics at scale for our valued Customers. The primary focus will be on choosing optimal solutions to use for these purposes, then maintaining,...

  • Senior Big Data Engineer

    2 weeks ago

    Noida, Bengaluru / Bangalore, India beBeeData Full time US$ 90,000 - US$ 1,20,000

    Big Data EngineerWe are seeking an experienced Big Data Engineer to join our team. The successful candidate will have strong technical skills and experience working with big data technologies such as Hadoop, Spark, and Kafka.The ideal candidate will have a strong understanding of cloud-based big data platforms and be able to design, implement, and manage...

  • Senior Big Data Engineer

    6 hours ago

    Pune, Maharashtra, India beBeeData Full time

    Job DescriptionWe are seeking a highly skilled Big Data Developer to join our team. This individual will be responsible for designing, developing, and maintaining large-scale big data pipelines, real-time systems, and data warehouses.Required Skills and QualificationsCoding Experience: 2-5 years of experience in Java programming with a solid understanding of...

  • Big Data Engineer

    6 days ago

    Pune, Maharashtra, India WorkiFicient Full time

    To be successful in this role, you should possess : - Collaborate closely with Product Management and Engineering leadership to devise and build the right solution.- Participate in Design discussions and brainstorming sessions to select, integrate, and maintain Big Data toolsand frameworks required to solve Big Data problems at scale.- Design and implement...

  • Senior Big Data Engineer

    7 days ago

    Bengaluru / Bangalore, Pune, Chennai, India beBeeDataEngineer Full time ₹ 1,04,000 - ₹ 1,30,878

    Unlock the Power of Data Engineering and ProcessingThe ideal candidate will have expertise in big data frameworks, distributed computing, and cloud platforms, with a deep understanding of Databricks architecture. This role focuses on designing, building, and optimizing large-scale data pipelines and processing solutions on the Databricks Unified Analytics...

  • Senior Big Data Engineer

    5 days ago

    Pune, Maharashtra, India Devlats Pvt Ltd Full time US$ 1,50,000 - US$ 2,00,000 per year

    About The RoleWe are seeking a highly skilled and experienced Big Data Engineer to join our team. The ideal candidate will have strong expertise in designing, building, and optimizing data pipelines and architectures, as well as a solid understanding of big data tools and Responsibilities :Design, develop, and maintain scalable and high-performance data...

  • Big Data Engineer

    2 days ago

    Pune, Maharashtra, India Nice Software Solutions Pvt. Ltd. Full time

    Big Data Engineer (PySpark)Location: Pune/Nagpur (WFO)Experience: 8 - 12 YearsEmployment Type: Full-timeJob OverviewWe are looking for an experienced Big Data Engineer with strong expertise in PySpark and Big Data ecosystems. The ideal candidate will be responsible for designing, developing, and optimizing scalable data pipelines while ensuring high...

  • Senior Big Data Engineer

    1 week ago

    Pune, Maharashtra, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 30,00,000

    Our company is seeking a highly skilled Data Architect to design, develop and implement scalable data solutions using cutting-edge technologies.Key Responsibilities:Data Ingestion and Processing: Develop and maintain high-quality code, adhering to industry standards and best practices, for efficient data ingestion from disparate sources onto our Big Data...

  • Big Data Engineer

    8 hours ago

    Chennai, Bengaluru / Bangalore, India beBeeBigDataEngineer Full time ₹ 15,00,000 - ₹ 28,00,000

    Job OverviewWe are seeking a highly skilled Big Data Engineer to join our team. As a Big Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data processing systems.Key Responsibilities:Design and implement big data solutions using Hadoop and Spark technologies.Work with cross-functional teams to understand business...