Senior Big Data Engineer

2 months ago


bangalore, India Recrud Full time

Senior Big Data Engineer Position.

Experience Required: 6 -10 Years.

Employment Type: Full-Time.

About Our Client:.

Our client is a distinguished product engineering consulting firm based in Bangalore, dedicated to providing innovative offshore development solutions.

With over half a century of combined expertise in product engineering and consulting services across global markets, they have a proven track record of facilitating growth for US startups and multinational corporations.

The Opportunity:

We are thrilled to announce the formation of a new offshore product development team on behalf of our partner.

This team is at the forefront of developing cutting-edge Big Data and Cloud-Based Business Operation Support technologies tailored for the utilities and retail energy sectors, as well as Community Choice Aggregators (CCA).

The successful candidate will join a team of elite data engineers based in the US, contributing to the expansion of the data engineering division and working across various products and infrastructure layers.

Role Overview:

The role calls for a skilled Big Data Engineer responsible for constructing and overseeing Big Data Pipelines, managing extensive structured datasets to produce accurate analytics at scale.

Key responsibilities include selecting optimal solutions for data management, implementing, and monitoring these solutions, and ensuring seamless integration within the company's architecture.

Candidates should demonstrate a strong passion for precision engineering, efficiency, and the ability to work both collaboratively and independently with minimal supervision.

Key Responsibilities:

- Collaborate with Product Management and Engineering teams to develop and implement the optimal solutions.

- Engage in design discussions and brainstorming sessions to choose, integrate, and maintain Big Data tools and frameworks to address large-scale data challenges.

- Design and deploy systems for cleaning, processing, and analyzing vast data sets using distributed processing tools such as Akka and Spark.

- Evaluate and enhance existing data pipelines in collaboration with Technical Leaders and Architects to resolve bottlenecks.

- Demonstrate initiative and a proactive approach to learning new technologies, contributing significantly as a Senior Individual contributor across multiple products and A minimum of 7 years' experience in developing scalable Big Data pipelines.

- Comprehensive knowledge of the Big Data ecosystem, including frameworks like Spark, Akka, Storm, Hadoop, and associated file types.

- Proficiency with ETL and Data pipeline tools such as Apache NiFi, Airflow, etc.

- Strong coding skills in Java or Scala, and familiarity with design patterns.

- Experience with Git and build tools such as Gradle/Maven/SBT.

- Solid grasp of object-oriented design, data structures, algorithms, and optimization techniques.

- Ability to write elegant, readable, maintainable, and extensible code.

Additional Skills:

- Excellent communication skills with the ability to articulate issues and solutions effectively.

- A strong sense of urgency, precision, and timeliness.

- Ability to work independently, manage multiple projects/tasks, and resolve issues efficiently.

- Passion for continuous learning, analysis, and troubleshooting.

Interested candidates are encouraged to apply, demonstrating how their skills and experience align with the role's requirements.

This is a unique opportunity to be part of a dynamic team, driving technological innovation in a thriving sector

(ref:hirist.tech)
  • Big Data Engineer

    2 weeks ago


    bangalore, India Virtusa Full time

    Big Data Engineer - CREQ188642 Description Looking for a Senior Software Engineer with strong analytical skills to help build and enhance our Big data application. This individual's day-to-day work will involve using Java, Scala, SQL, Big Data, Linux, git, and maven/gradle to design and build software solutions that are fast, scalable, and...

  • Senior Data Engineer

    2 months ago


    bangalore, India Squareroot Consulting Pvt Ltd Full time

    We are seeking a highly skilled and experienced Senior Data Engineer to join our team.Location : Bangalore (Work from Office all 5 days)Experience : 6+ YearsRole : Senior Data EngineerThe ideal candidate will have a strong background in big data technologies and extensive hands-on experience with Cloudera, Spark, Hive, HDFS, Flink, Data Lake, and...

  • Senior Data Engineer

    4 weeks ago


    Bangalore, India Squareroot Consulting Pvt Ltd Full time

    We are seeking a highly skilled and experienced Senior Data Engineer to join our team.Location : Bangalore (Work from Office all 5 days)Experience : 6+ YearsRole : Senior Data EngineerThe ideal candidate will have a strong background in big data technologies and extensive hands-on experience with Cloudera, Spark, Hive, HDFS, Flink, Data Lake, and...

  • Senior Data Engineer

    2 months ago


    Bangalore, India Muoro Full time

    Job Description : About the role :We are looking for a Senior Data Engineer to join our growing engineering team. As a member of the team:- You will work on enterprise data platforms, architect and implement data lakes both on-prem and in the cloud.- You will be responsible for evolving technical architecture, design and implementation of data solutions...

  • Big Data Engineer

    2 weeks ago


    bangalore, India Infogain Full time

    Big Data Engineer (Senior) with skills Big Data, Data Warehouse, Azure Datalake for location Any Infogain Base Location (Noida, Gurugram, Bangalore, Mumbai, Pune) Posted on: May 20, Share on Linkedin Share on Twitter Share on Facebook ROLES & RESPONSIBILITIES · Strong experience of overall 9 to 12 years of experience as a data...

  • Big Data Engineer

    1 week ago


    bangalore, India Infogain Full time

    Big Data Engineer (Senior) with skills Big Data, Data Warehouse, Azure Datalake for location Any Infogain Base Location (Noida, Gurugram, Bangalore, Mumbai, Pune) Posted on: May 22, Share on Linkedin Share on Twitter Share on Facebook ROLES & RESPONSIBILITIES · Strong experience of overall 9 to 12 years of experience as a data...

  • Big Data Engineer

    1 week ago


    bangalore, India Infogain Full time

    Big Data Engineer (Senior) with skills Big Data, Data Warehouse, Azure Datalake for location Any Infogain Base Location (Noida, Gurugram, Bangalore, Mumbai, Pune) Posted on: May 24, Share on Linkedin Share on Twitter Share on Facebook ROLES & RESPONSIBILITIES · Strong experience of overall 9 to 12 years of experience as a data...

  • Big Data Engineer

    4 days ago


    bangalore, India Infogain Full time

    Big Data Engineer (Senior) with skills Big Data, Data Warehouse, Azure Datalake for location Any Infogain Base Location (Noida, Gurugram, Bangalore, Mumbai, Pune) Posted on: May 26, Share on Linkedin Share on Twitter Share on Facebook ROLES & RESPONSIBILITIES · Strong experience of overall 9 to 12 years of experience as a data...


  • Bangalore/Pune, India Recrud Full time

    Senior Big Data Engineer Position. Experience Required: 6 -10 Years. Employment Type: Full-Time. About Our Client:. Our client is a distinguished product engineering consulting firm based in Bangalore, dedicated to providing innovative offshore development solutions. With over half a century of combined expertise in product engineering and consulting...


  • bangalore, India Onward Technologies Full time

    Onward Technologies is looking for Senior Azure Big Data Engineer The Role You will be responsible for : Developing scripts to process structured and unstructured data. Recommending, developing and implementing ways to improve data reliability, efficiency and quality. Supporting translation of data business needs into technical system requirements....


  • bangalore, India Snaphunt Full time

    The Offer Work within a company with a solid track record of success Work alongside & learn from best in class talent Excellent career development opportunities The Job You will be responsible for : Developing scripts to process structured and unstructured data. Recommending, developing and implementing ways to improve data reliability, efficiency and...

  • Senior Data Engineer

    4 weeks ago


    Bangalore/Any Location, India SWAI TECHNOLOGIES PRIVATE LIMITED Full time

    Job Description : We are seeking a highly skilled Senior Data Engineer with 5 - 12 years of experience in building scalable data solutions. The ideal candidate should be proficient in Python programming and SQL, with extensive experience in utilizing various AWS services for data processing and storage. Experience with big data processing environments,...


  • bangalore, India Publicis Sapient Full time

    The Senior Associate People Senior Associate L2 in Data Engineering, you will translate client requirements into technical design, and implement components for a data engineering solutions. Utilize a deep understanding of data integration and big data design principles in creating custom solutions or implementing package solutions. You will independently...

  • Big Data Engineer

    1 month ago


    bangalore, India Adobe Full time

    Our Company Changing the world through digital experiences is what Adobe’s all about. We give everyone—from emerging artists to global brands—everything they need to design and deliver exceptional digital experiences! We’re passionate about empowering people to create beautiful and powerful images, videos, and apps, and transform how companies...


  • Bangalore, India Notus Full time

    Job Title : GCP (Google Cloud Platform) SpecialistNumber of Positions : 6 (1 Senior Role, 5 Lead Roles)Shift : 12 : 00 PM to 9 : 00 PM OR 1 : 00 PM to 10 : 00 PMLocation : TechM India locationsNotice Period : Early/Immediate/30 days (Positions need to be filled by May)Budget : Senior Role : 4 to 5/6 years of experience - Depending upon hike % and candidate...


  • bangalore, India Publicis Sapient Full time

    The Senior Associate People Senior Associate L2 in Data Engineering, you will translate client requirements into technical design, and implement components for a data engineering solutions. Utilize a deep understanding of data integration and big data design principles in creating custom solutions or implementing package solutions. You will independently...

  • Senior Data Engineer

    20 hours ago


    bangalore, India Giant Eagle GCC Full time

    Senior Software Engineer - Data AnalyticsGrow. Learn. Thrive. Giant Eagle is where your career can soar high. At Giant Eagle, you are so much more than an employee. You are part of the Family.About the CompanySince our founding in 1931, Giant Eagle, Inc. has evolved into one of the top 40 largest private corporations in the U.S. and one of the country’s...

  • Big Data Engineer

    2 months ago


    bangalore, India Hexaware Technologies Full time

    Description Data Engineer: Primary : ADF, SQL Seconday : Databricks, Pyspark / Scala, CICD, Data Security, encryption Responsibilities: •Work closely with scrum master, technical leads and provide daily progress updates on the tasks assigned. •Provide support in defining the scope and sizing of the work. •Working closely with...

  • Big Data Engineer

    5 days ago


    bangalore, India Global Pharma Tek Full time

    Auto req ID BR Title Big Data Engineer Your Role and Responsibilities Understand a data warehousing solution and able to work independently in such an environment Responsible in Project development and delivery experience of a few good size projects Posting Country India State / Province Haryāna City / Township / Village Gurgaon ...

  • Big Data Engineer

    5 days ago


    bangalore, India Thomson Reuters Full time

    Big Data EngineerThe ideal candidate should be able to demonstrate strong technical aptitude and interest in learning new technologies.In this role you will work closely with our Big Data technical lead to deliver a set of Big Data services to Thomson Reuters product teams.About the RoleIn this opportunity as, Big Data Engineer, you will:  Work closely...