Senior Big Data Engineer

5 days ago

Pune Noida Indore, India beBeeDataWarehouse Full time ₹ 10,00,000 - ₹ 25,00,000

We are seeking a skilled Data Warehouse Architect / Consultant to join our team.

This role involves designing and delivering data warehouse solutions that meet the needs of our clients.

The successful candidate will have expertise in big data technologies, including Hadoop and Spark, and be able to communicate effectively with customers.

  • Technical leadership in the big data space (Hadoop Stack like Spark, M/R, HDFS, Hive, etc.)
  • Ability to communicate with customers on both functional and technical aspects
  • Expert-level proficiency in Python/Pyspark
  • Hands-on experience with Shell/Bash Scripting (creating, modifying scripting files)
  • Control-M, AutoSys, Any job scheduler experience
  • Experience in visualizing and evangelizing next-generation infrastructure in Big Data space (Batch, Near Real-time, Real-time technologies)
  • Ability to guide teams for functional and technical issues
  • Strong technical development experience in effectively writing code, code reviews, and best practices code refactoring
  • Passionate for continuous learning, experimenting, applying and contributing towards cutting-edge open-source technologies and software paradigms
  • Good communication, problem-solving & interpersonal skills. Self-starter & resourceful personality with ability to manage pressure situations
  • Capable of providing design and architecture for typical business problems
  • Exposure and awareness of complete PDLC/SDLC
  • Out of box thinker and not just limited to the work done in the projects

Must Have:

  • AWS(EMR, Glue, S3, RDS, Redshift, Glue) Experience
  • Cloud Certification
  • Evaluate and recommend the Big Data technology stack best suited for customer needs
  • Design/Architect/Implement various solutions arising out of high concurrency systems
  • Responsible for timely and quality deliveries
  • Anticipate on technological evolutions
  • Ensure the technical directions and choices
  • Develop efficient ETL pipelines through spark or Hive
  • Drive significant technology initiatives end to end and across multiple layers of architecture
  • Provides strong technical leadership in adopting and contributing to open-source technologies related to Big Data across multiple engagements
  • Designing/architecting complex, highly available, distributed, failsafe compute systems dealing with considerable amount (GB/TB) of data
  • Identify and work on incorporating Non-functional requirements into the solution (Performance, scalability, monitoring etc.)

Education Requirements:

  • B.Tech/B.E. in Any Specialization
  • M.Tech in Any Specialization, MCA in Computers, M.Com in Commerce

Key Skills: Technical leadership, AWS, Cloud Certification, Big Data Technologies, Python, PySpark, Shell/Bash Scripting, Control-M, AutoSys, Job Scheduler, Visualisation, Open-Source Technologies, Continuous Learning, Problem-Solving, Interpersonal Skills, Design, Architecture, ETL Pipelines, High Concurrency Systems, Timely Deliveries, Technological Evolution, Technical Directions, Quality Deliveries, Distributed Compute Systems, Non-Functional Requirements

About the Role: As a Data Warehouse Architect / Consultant, you will be responsible for designing and delivering data warehouse solutions that meet the needs of our clients. You will need to have expertise in big data technologies, including Hadoop and Spark, and be able to communicate effectively with customers.

What We Offer: We offer a competitive salary and benefits package, as well as opportunities for professional growth and development. If you are passionate about working with big data and want to make a real impact, we encourage you to apply for this exciting opportunity.

],

  • Senior Big Data Cloud QA

    3 days ago

    Indore, Noida, Pune, India Impetus Technologies Full time

    Job Description This looks like an exciting opportunity for a Senior Big Data Cloud QA Engineer! The role involves designing test plans, performing functional and performance testing, identifying defects, and collaborating closely with development teams. Some key qualifications required include: - 5+ years of software testing experience, with 2+ years in...

  • Big Data Engineer

    2 weeks ago

    Pune, Maharashtra, India Merito Full time

    Job Description :We are looking for a Big Data Engineer who will work on building, and managing Big Data Pipelines for us to deal with the huge structured data sets that we use as an input to accurately generate analytics at scale for our valued Customers. The primary focus will be on choosing optimal solutions to use for these purposes, then maintaining,...

  • Big Data Engineer

    2 weeks ago

    Pune, Maharashtra, India WorkiFicient Full time

    To be successful in this role, you should possess : - Collaborate closely with Product Management and Engineering leadership to devise and build the right solution.- Participate in Design discussions and brainstorming sessions to select, integrate, and maintain Big Data toolsand frameworks required to solve Big Data problems at scale.- Design and implement...

  • Senior Big Data Engineer

    1 week ago

    Pune, Maharashtra, India beBeeData Full time

    Job DescriptionWe are seeking a highly skilled Big Data Developer to join our team. This individual will be responsible for designing, developing, and maintaining large-scale big data pipelines, real-time systems, and data warehouses.Required Skills and QualificationsCoding Experience: 2-5 years of experience in Java programming with a solid understanding of...

  • Big Data Cloud Leader

    5 days ago

    Pune, Noida, Indore, India beBeeCloud Full time ₹ 15,00,000 - ₹ 25,00,000

    Senior Cloud Engineer Opportunity">This is an exciting opportunity for a Senior Cloud Engineer to join our organization. The role involves designing test plans, performing functional and performance testing, identifying defects, and collaborating closely with development teams.The ideal candidate will have 5+ years of software testing experience, with 2+...

  • Senior Big Data Engineer

    3 days ago

    Pune, India Devlats Pvt Ltd Full time

    Sr. Big Data EngineerLocation : PuneExperience : 8+ years overall; 6+ years relevantMode : HybridRole Overview :We are seeking a talented Sr. Big Data Engineer to design, develop, and support a highly scalable, distributed SaaS-based Security Risk Prioritization product. You will lead the design and evolution of our data platform and pipelines, providing...

  • Senior Big Data Engineer

    2 days ago

    Pune, Maharashtra, India Citi Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    Job Description:The Applications Development Senior big Data Engineer is responsible for accomplishing results through the management of a team or department in an effort to establish and implement new or revised application systems and programs in coordination with the Technology team. The overall objective of this role is to drive applications systems...

  • Big Data Engineer

    4 days ago

    Pune, India Nice Software Solutions Pvt. Ltd. Full time

    Big Data Engineer (PySpark)Location: Pune/Nagpur (WFO)Experience: 8 - 12 YearsEmployment Type: Full-timeJob OverviewWe are looking for an experienced Big Data Engineer with strong expertise in PySpark and Big Data ecosystems. The ideal candidate will be responsible for designing, developing, and optimizing scalable data pipelines while ensuring high...

  • Senior Big Data Architect

    3 days ago

    Pune, India Mycitypune Full time

    Job Description - Qualification: Hold a University degree, preferably in Computer Science/IT/Engineering or in a related field - Experience: 3-5 years of hands on experience across Big Data project implementations. - Skills: Familiar with designing high volume and fast big data solutions. Ability to articulate and hold solution discussion with key...

  • Senior Big Data Engineer

    2 weeks ago

    Pune, Maharashtra, India Devlats Pvt Ltd Full time US$ 1,50,000 - US$ 2,00,000 per year

    About The RoleWe are seeking a highly skilled and experienced Big Data Engineer to join our team. The ideal candidate will have strong expertise in designing, building, and optimizing data pipelines and architectures, as well as a solid understanding of big data tools and Responsibilities :Design, develop, and maintain scalable and high-performance data...