Senior Big Data Engineer

1 month ago


Bengaluru, Karnataka, India The Metromax Group Full time
Job Summary

We are seeking an experienced Senior Big Data Engineer - Lakehouse Architect to join The Metromax Group. This role will involve designing and implementing scalable data architectures using AWS services, focusing on big data processing and data lakes.

About the Role

The ideal candidate will have 5+ years of experience in data architecture with a strong focus on AWS services, specifically EMR, Glue, S3, and Lambda. They should be proficient in big data processing tools such as Apache Spark, Hadoop, Hive, and Presto. Additionally, they should have expertise in building and managing ETL pipelines using AWS Glue/EMR, AWS Step Functions, and SQL and Scala for data processing and scripting.

Key Responsibilities
  • Design and deploy scalable data lakes and lakehouse architectures using AWS services.
  • Develop and manage ETL processes using AWS Glue/EMR for data integration, transformation, and loading.
  • Optimize and manage AWS EMR clusters for big data processing, including Apache Hadoop, Spark, and other distributed computing tools.
  • Leverage S3 for data storage with a focus on performance, security, and data lifecycle management.
  • Collaborate with data engineers and scientists to support analytics, machine learning models, and reporting tools using the AWS data ecosystem.
Requirements
  • Bachelor's or master's degree in computer science, Information Technology, Data Science, or related field.
  • 5+ years of experience in data architecture with a strong focus on AWS services (EMR, Glue, S3, Lambda, etc.).
  • Hands-on experience in designing and deploying data lakes and lakehouse architectures.
  • Proficiency in big data processing tools such as Apache Spark, Hadoop, Hive, and Presto.
  • Expertise in building and managing ETL pipelines using AWS Glue/EMR, AWS Step Functions, and SQL and Scala for data processing and scripting.
Salary

$120,000 - $160,000 per year, depending on experience.



  • Bengaluru, Karnataka, India IT Source Global Full time

    Job Title: Senior Big Data EngineerJob Description:We are seeking a highly skilled Senior Big Data Engineer to join our team at IT Source Global. As a Senior Big Data Engineer, you will be responsible for designing and implementing scalable, fault-tolerant data pipelines using Hadoop and Spark.Key Responsibilities:Design and implement data pipelines using...

  • Senior Data Engineer

    2 weeks ago


    Bengaluru, Karnataka, India LinkedIn Full time

    About the RoleThis role offers a hybrid work option, meaning you can both work from home and commute to an office, depending on what's best for you and your team. As a Senior Data Engineer - Big Data, you will leverage big data to empower business decisions and deliver data-driven insights, metrics, and tools in order to drive member engagement, business...


  • Bengaluru, Karnataka, India LTIMindtree Full time

    Job Title: Senior Big Data EngineerAbout the Role:We are seeking a skilled Senior Big Data Engineer to join our team at LTIMindtree. As a key member of our engineering team, you will be responsible for designing, implementing, and maintaining large-scale data processing systems.Key Responsibilities:Design and develop scalable big data architectures using...


  • Bengaluru, Karnataka, India Mobileum Full time

    We are seeking a highly skilled Senior Big Data Engineer to lead our data analytics initiatives. This role will be responsible for designing, developing, and deploying high-performance data analytics applications.As a key member of our team, you will collaborate with peer engineers and architects to maintain and enhance our data analytics solutions.The ideal...


  • Bengaluru, Karnataka, India Coders Brain Technology Private Limited Full time

    Job Description:Coders Brain Technology Private Limited is seeking a highly skilled Senior Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing, developing, and deploying large-scale big data pipelines using AWS Data Bricks.About the Role:We are looking for an experienced Senior Data Engineer...


  • Bengaluru, Karnataka, India Tata Consultancy Services Full time

    About the RoleWe are seeking an experienced Senior Big Data Cluster Engineer to join our team at Tata Consultancy Services. This is a critical role that requires strong technical skills, expertise in big data technologies, and experience in leading teams.Key ResponsibilitiesDesign, implement, and manage large-scale Hadoop clusters across multiple...

  • Big Data Engineer

    2 weeks ago


    Bengaluru, Karnataka, India HR Consulting Full time

    About the RoleWe are seeking a skilled Senior Data Engineer to join our team at HR Consulting in Bengaluru. This is an exciting opportunity to work on deep data engineering projects and help define our technical strategy and team culture.This role involves designing and building data platforms and services while managing our data infrastructure in cloud...


  • Bengaluru, Karnataka, India Synechron Full time

    We are seeking a skilled professional to join our team as a Senior Big Data Quality Assurance Engineer. This is an exciting opportunity for someone with experience in big data and ETL testing to ensure the integrity, reliability, and performance of our data solutions.Key Responsibilities:

  • Senior Data Architect

    4 weeks ago


    Bengaluru, Karnataka, India AKIRA Insights Full time

    About AKIRA InsightsAkira Insights is a boutique pure-play data and analytics consulting firm providing services to multinational corporations, large enterprises, and Fortune 500s from various sectors. The company's mission is to help businesses unlock valuable insights from their data.Job Title: Senior Data Architect (Big Data Engineer)We are seeking an...

  • Senior Data Engineer

    1 month ago


    Bengaluru, Karnataka, India Coders Brain Technology Private Limited Full time

    Job Description:Coders Brain Technology Private Limited is seeking a highly skilled Senior Data Engineer to join our team. As a Senior Data Engineer, you will be responsible for designing and developing big data pipelines using AWS Databricks.About the Role:We are looking for a seasoned professional with hands-on experience in AWS Databricks, Spark, and...


  • Bengaluru, Karnataka, India Visionyle Solutions Full time

    Visionyle Solutions is looking for an exceptional Senior Big Data Professional to join our team. As a key member of our data engineering team, you will be responsible for designing and developing scalable Big Data applications or solutions on distributed platforms.The estimated salary for this role is ₹1,800,000 - ₹3,000,000 per annum, depending on...


  • Bengaluru, Karnataka, India Capco Technologies Pvt Ltd Full time

    Job Summary: As a Senior Big Data Developer at Capco Technologies Pvt Ltd, you will play a key role in designing and developing scalable data pipelines to support our business growth.About You: To succeed in this role, you should have a strong background in big data tools such as Hadoop, Spark, and Kafka. Additionally, you should be proficient in SQL and...


  • Bengaluru, Karnataka, India Creencia Technologies Pvt Ltd Full time

    Job Title: Senior Big Data SpecialistAbout the Role: We are seeking an experienced Senior Big Data Specialist to join our team at Creencia Technologies Pvt Ltd. The ideal candidate will have a strong background in designing and developing scalable data pipelines using Scala programming, Java, GCP, and Spark.Key Responsibilities: Design, develop, and maintain...


  • Bengaluru, Karnataka, India TalentXO Full time

    Senior Big Data ArchitectTalentXO is a leading-edge company that seeks a highly skilled and experienced Senior Big Data Architect to join their team. The ideal candidate will have a strong background in designing and implementing scalable big data transformations and pipelines using cloud-based platforms like Azure.The successful candidate will possess...


  • Bengaluru, Karnataka, India Tata Consultancy Services Full time

    Company OverviewTata Consultancy Services is a leading IT services company that helps clients transform and grow their businesses.Job DescriptionWe are seeking an experienced Senior Big Data Engineer to join our team. As a Senior Big Data Engineer, you will be responsible for designing, developing, and deploying big data solutions using technologies such as...


  • Bengaluru, Karnataka, India Tata Consultancy Services Full time

    Job SummaryWe are seeking a highly skilled Senior Azure Data Engineer with experience in big data technologies to join our team at Tata Consultancy Services.


  • Bengaluru, Karnataka, India Sail Analytics Full time

    **Job Summary:** Big Data Engineering SpecialistWe are looking for a highly skilled Big Data Engineering Specialist to join our team at Sail Analytics. As a big data engineer, you will be responsible for designing, developing, testing, and maintaining scalable data warehouses and data pipelines using a range of technologies including SQL, Python, and...


  • Bengaluru, Karnataka, India Nielsen Full time

    Job DescriptionWe are seeking an experienced Senior Big Data Specialist to join our team at Nielsen. As a Senior Big Data Specialist, you will play a key role in analyzing, developing, testing, and supporting big data applications.Key ResponsibilitiesDesign, code, and test iteratively to support complex big data applications deployed on cloud infrastructure...

  • Big Data Engineer

    2 weeks ago


    Bengaluru, Karnataka, India NetAnalytiks Technologies Full time

    Job Title: Big Data EngineerWe are seeking an experienced Big Data Engineer to join our team at NetAnalytiks Technologies. As a key member of our data engineering team, you will play a crucial role in designing and implementing large-scale data processing systems.Key Responsibilities:Design and develop scalable data pipelines using Apache Spark and...


  • Bengaluru, Karnataka, India Wipro Full time

    Job SummaryWe are seeking an Expert Big Data Engineer to join our team at Wipro. As a key member of our engineering team, you will be responsible for designing, developing, and maintaining large-scale data processing systems using Apache Spark.About the RoleThis is a senior-level position that requires excellent knowledge of Spark, Scala, and PySpark. You...