Big Data Engineer

2 months ago

BangaloreNoida, India RapidBraiins Full time

Job Title : Big Data Engineer


Location : Noida & Bengaluru


Notice period : 0-20 Days


Experience : 7+ years


Job Description :


We are seeking an experienced and skilled Senior Data Engineer to lead the development of strategies for effective data analysis and reporting through the configuration and implementation of cutting-edge analytics solutions. The solutions you build will have a substantial impact and will be deployed to a large customer base. As a Senior Data Engineer, you will play a pivotal role in understanding business needs, providing recommendations, and ultimately constructing and implementing optimal solutions using big data :

  • Develop comprehensive strategies for data analysis and reporting.
  • Configure and implement analytics solutions with a focus on high-impact results.
  • Understand business requirements and translate them into effective data engineering solutions.
  • Utilize big data technologies, including Hadoop, Apache Spark, and SQL, to handle large volumes of data.
  • Possess solid knowledge of Azure cloud services, Airflow, and Databricks (preferable).
  • Demonstrate proficiency in Python and shell scripting for data engineering tasks.
  • Establish and maintain CI/CD pipelines for efficient development and deployment.
  • Collaborate with cross-functional teams and stakeholders to ensure alignment with business goals.
  • Utilize Agile methodology, including working with Jira, to drive project success.
  • Provide leadership to small technical teams, ensuring efficient and effective collaboration.

Requirements :

  • 7-10 years of proven experience in data engineering with a focus on handling large data volumes.
  • Expertise in Hadoop, Apache Spark, and SQL for data processing and analysis.
  • Proficiency in Python and shell scripting for data manipulation and automation.
  • Familiarity with cloud platforms, with preference given to experience in Azure.
  • Knowledge of Airflow, Databricks, and CI/CD pipelines is highly desirable.
  • Strong understanding of Agile methodology and experience with project management using Jira.
  • Demonstrated leadership skills, including the ability to lead small technical teams.
  • Excellent communication skills and the ability to work collaboratively with multiple stakeholders.
  • Proactive attitude and the ability to take initiative with minimal intervention from reporting managers.
  • If you are a seasoned Data Engineer with a proven track record of delivering impactful solutions and leading technical teams, we invite you to apply. Join us in shaping the future of data analytics and making a significant contribution to our growing customer base.

(ref:hirist.tech)

  • Big Data Engineer

    2 weeks ago

    bangalore, India Virtusa Full time

    Big Data Engineer - CREQ188642 Description Looking for a Senior Software Engineer with strong analytical skills to help build and enhance our Big data application. This individual's day-to-day work will involve using Java, Scala, SQL, Big Data, Linux, git, and maven/gradle to design and build software solutions that are fast, scalable, and...

  • Big Data Engineer

    1 month ago

    bangalore, India Adobe Full time

    Our Company Changing the world through digital experiences is what Adobe’s all about. We give everyone—from emerging artists to global brands—everything they need to design and deliver exceptional digital experiences! We’re passionate about empowering people to create beautiful and powerful images, videos, and apps, and transform how companies...

  • Big Data Engineer

    2 months ago

    bangalore, India Hexaware Technologies Full time

    Description Data Engineer: Primary : ADF, SQL Seconday : Databricks, Pyspark / Scala, CICD, Data Security, encryption Responsibilities: •Work closely with scrum master, technical leads and provide daily progress updates on the tasks assigned. •Provide support in defining the scope and sizing of the work. •Working closely with...

  • Big Data Engineer

    5 days ago

    bangalore, India Global Pharma Tek Full time

    Auto req ID BR Title Big Data Engineer Your Role and Responsibilities Understand a data warehousing solution and able to work independently in such an environment Responsible in Project development and delivery experience of a few good size projects Posting Country India State / Province Haryāna City / Township / Village Gurgaon ...

  • Big Data Engineer

    5 days ago

    bangalore, India Thomson Reuters Full time

    Big Data EngineerThe ideal candidate should be able to demonstrate strong technical aptitude and interest in learning new technologies.In this role you will work closely with our Big Data technical lead to deliver a set of Big Data services to Thomson Reuters product teams.About the RoleIn this opportunity as, Big Data Engineer, you will:  Work closely...

  • Big Data Engineer

    2 months ago

    bangalore, India TalentPulse Consultant Full time

    Role : Big Data Engineer Job Description : We are currently seeking a highly skilled Big Data Engineer to join our team on a remote basis. The ideal candidate will have at least 5 years of experience in Big Data technologies and a strong proficiency in Python, Spark, and Scala. This is an active position with a high priority, offering a competitive rate...

  • Big Data Engineer

    2 weeks ago

    bangalore, India Infogain Full time

    Big Data Engineer (Lead) with skills Big Data, Data Warehouse, Azure Datalake for location Any Infogain Base Location (Noida, Gurugram, Bangalore, Mumbai, Pune) Posted on: May 20, Share on Linkedin Share on Twitter Share on Facebook ROLES & RESPONSIBILITIES Responsibilities: · Strong experience of minimum 5+ years in Snowflake &...

  • Big Data Engineer

    6 days ago

    bangalore, India Infogain Full time

    Big Data Engineer (Lead) with skills Big Data, Data Warehouse, Azure Datalake for location Any Infogain Base Location (Noida, Gurugram, Bangalore, Mumbai, Pune) Posted on: May 24, Share on Linkedin Share on Twitter Share on Facebook ROLES & RESPONSIBILITIES Responsibilities: · Strong experience of minimum 5+ years in Snowflake &...

  • Big Data Engineer

    4 days ago

    bangalore, India Infogain Full time

    Big Data Engineer (Lead) with skills Big Data, Data Warehouse, Azure Datalake for location Any Infogain Base Location (Noida, Gurugram, Bangalore, Mumbai, Pune) Posted on: May 26, Share on Linkedin Share on Twitter Share on Facebook ROLES & RESPONSIBILITIES Responsibilities: · Strong experience of minimum 5+ years in Snowflake &...

  • Big Data Engineer

    1 week ago

    bangalore, India Infogain Full time

    Big Data Engineer (Lead) with skills Big Data, Data Warehouse, Azure Datalake for location Any Infogain Base Location (Noida, Gurugram, Bangalore, Mumbai, Pune) Posted on: May 22, Share on Linkedin Share on Twitter Share on Facebook ROLES & RESPONSIBILITIES Responsibilities: · Strong experience of minimum 5+ years in Snowflake &...

  • Big Data Engineer

    1 week ago

    bangalore, India Infogain Full time

    Big Data Engineer (Lead) with skills Big Data, Data Warehouse, Azure Datalake for location Any Infogain Base Location (Noida, Gurugram, Bangalore, Mumbai, Pune) Posted on: May 23, Share on Linkedin Share on Twitter Share on Facebook ROLES & RESPONSIBILITIES Responsibilities: · Strong experience of minimum 5+ years in Snowflake &...

  • Big Data Engineer

    2 days ago

    bangalore, India Infogain Full time

    Big Data Engineer (Lead) with skills Big Data, Data Warehouse, Azure Datalake for location Any Infogain Base Location (Noida, Gurugram, Bangalore, Mumbai, Pune) Posted on: May 29, Share on Linkedin Share on Twitter Share on Facebook ROLES & RESPONSIBILITIES Responsibilities: · Strong experience of minimum 5+ years in Snowflake &...

  • Big Data Engineer

    3 days ago

    bangalore, India Infogain Full time

    Big Data Engineer (Lead) with skills Big Data, Data Warehouse, Azure Datalake for location Any Infogain Base Location (Noida, Gurugram, Bangalore, Mumbai, Pune) Posted on: May 28, Share on Linkedin Share on Twitter Share on Facebook ROLES & RESPONSIBILITIES Responsibilities: · Strong experience of minimum 5+ years in Snowflake &...

  • Big Data Engineer

    9 hours ago

    bangalore, India Infogain Full time

    Big Data Engineer (Lead) with skills Big Data, Data Warehouse, Azure Datalake for location Any Infogain Base Location (Noida, Gurugram, Bangalore, Mumbai, Pune) Posted on: May 30, Share on Linkedin Share on Twitter Share on Facebook ROLES & RESPONSIBILITIES Responsibilities: · Strong experience of minimum 5+ years in Snowflake &...

  • Big Data Engineer

    4 weeks ago

    Bangalore, India TalentPulse Consultant Full time

    Role : Big Data Engineer Job Description : We are currently seeking a highly skilled Big Data Engineer to join our team on a remote basis. The ideal candidate will have at least 5 years of experience in Big Data technologies and a strong proficiency in Python, Spark, and Scala. This is an active position with a high priority, offering a competitive rate...

  • Aws big data engineer

    2 months ago

    bangalore, India Global Pharma Tek Full time

    ob Description Technical skills . Having ETL development experience with overall to years in AWS , Big data engineering related application Minimum end to end ETL project implementation Proficient in PySpark, Python. Proficient in Big Data technologies - Hadoop, Spark, Hive, Databricks. Expert in AWS to develop, deploy and maintain ETL applications...

  • Senior Data Engineer

    2 months ago

    Bangalore, India Muoro Full time

    Job Description : About the role :We are looking for a Senior Data Engineer to join our growing engineering team. As a member of the team:- You will work on enterprise data platforms, architect and implement data lakes both on-prem and in the cloud.- You will be responsible for evolving technical architecture, design and implementation of data solutions...

  • Big Data Engineer

    2 weeks ago

    bangalore, India Infogain Full time

    Big Data Engineer (Senior) with skills Big Data, Data Warehouse, Azure Datalake for location Any Infogain Base Location (Noida, Gurugram, Bangalore, Mumbai, Pune) Posted on: May 20, Share on Linkedin Share on Twitter Share on Facebook ROLES & RESPONSIBILITIES · Strong experience of overall 9 to 12 years of experience as a data...

  • Big Data Engineer

    1 week ago

    bangalore, India Infogain Full time

    Big Data Engineer (Senior) with skills Big Data, Data Warehouse, Azure Datalake for location Any Infogain Base Location (Noida, Gurugram, Bangalore, Mumbai, Pune) Posted on: May 24, Share on Linkedin Share on Twitter Share on Facebook ROLES & RESPONSIBILITIES · Strong experience of overall 9 to 12 years of experience as a data...

  • Big Data Engineer

    1 week ago

    bangalore, India Infogain Full time

    Big Data Engineer (Senior) with skills Big Data, Data Warehouse, Azure Datalake for location Any Infogain Base Location (Noida, Gurugram, Bangalore, Mumbai, Pune) Posted on: May 22, Share on Linkedin Share on Twitter Share on Facebook ROLES & RESPONSIBILITIES · Strong experience of overall 9 to 12 years of experience as a data...