Senior Big Data Engineer

2 weeks ago


Gurgaon, Haryana, India Uncap Research Labs Full time

Data Engineering Role at Uncap Research Labs



We are seeking a highly skilled Data Engineer to join our team at Uncap Research Labs. This role will involve designing and implementing scalable data services, developing and deploying production data pipelines, and optimizing big data systems for performance and efficiency.



Key Responsibilities


  • Apache Spark and Kafka Expertise: Develop and deploy production data pipelines using Apache Spark and Kafka for large-scale data processing and real-time data streaming.
  • Data Volume Management: Manage and process large volumes of data (e.g., 1.8 TB daily) efficiently using distributed data systems and big data processing technologies.
  • Feature Engineering and Pipeline Integration: Build pipelines for feature engineering, integrating and transforming data from diverse sources, and ensuring smooth data flow.
  • System Optimization and Performance Engineering: Optimize big data systems for performance and efficiency using performance engineering techniques and optimization methods.


Requirements




  • Strong understanding of data structures and algorithms relevant to backend development and big data processing.
  • Proficiency in languages commonly used for backend development and data processing, such as Java, Scala, Python, or similar.
  • Familiarity with version control systems (e.g., Git) and deployment processes for managing code and infrastructure changes.
  • Experience in managing and processing large volumes of data efficiently.


Why Join Us?



At Uncap Research Labs, we offer a dynamic and innovative work environment that encourages collaboration, creativity, and growth. As a Data Engineer, you will have the opportunity to work on challenging projects, develop your skills, and contribute to the success of our organization.



What We Offer




  • A competitive salary and benefits package.
  • Opportunities for professional growth and development.
  • A dynamic and innovative work environment.
  • A collaborative and supportive team.


How to Apply



If you are a motivated and experienced Data Engineer looking for a new challenge, please submit your resume and cover letter to careers@uncapresearchlabs.com.



We look forward to hearing from you



  • Gurgaon, Haryana, India Epam Full time

    About UsEPAM is a global leader in digital platform engineering and development services. We strive to make a positive impact on our customers, employees, and communities. Our culture is dynamic and inclusive, offering opportunities for collaboration, innovation, and growth.Job OpportunityWe are seeking a seasoned Senior Big Data Software Engineer to join...


  • Gurgaon, Haryana, India BayOne Solutions Full time

    Job Title: Senior Cloud Data Engineer for Big Data SolutionsAbout BayOne SolutionsBayOne Solutions is a 12-year-old software consulting organization based in Pleasanton, California, USA. We specialize in providing talent and solutions, with a passion for diversity in tech.Job OverviewWe are seeking an experienced Senior Cloud Data Engineer to join our team....

  • Big Data Engineer

    4 weeks ago


    Gurgaon, Haryana, India PRONTO CONSULTING SERVICES Full time

    Job Title: Big Data DeveloperJob Summary:We are seeking a highly skilled Big Data Developer to join our team at Pronto Consulting Services. As a Big Data Developer, you will be responsible for designing and developing data engineering solutions on big data ecosystems, developing custom applications, and modifying existing applications to meet distinct and...


  • Gurgaon, Haryana, India SMARTWORK IT SERVICES Full time

    Job Title: Senior Big Data Solutions ArchitectJob Summary:We are seeking a skilled Senior Big Data Solutions Architect to join our team at SMARTWORK IT SERVICES. As a Senior Big Data Solutions Architect, you will be responsible for designing and implementing scalable big data solutions to meet the ever-growing needs of our clients.Key...


  • Gurgaon, Haryana, India Absolutdata Full time

    Job SummaryAbsolutdata is at the forefront of the Big Data revolution, leveraging advanced analytics to transform business decision-making. As a Senior Data Architect, you will design and implement scalable Big Data solutions, driving business results through data-driven insights.Key ResponsibilitiesLead the development of Big Data infrastructure, ensuring...

  • Big Data Architect

    4 weeks ago


    Gurgaon, Haryana, India Absolutdata Full time

    About the RoleAbsolutdata is revolutionizing the way companies make decisions with our cutting-edge Big Data solutions. As a Technical Lead/Senior Technical Lead - Big Data, you will be at the forefront of this revolution, building and implementing optimal Big Data Infrastructure solutions that drive business results.Key ResponsibilitiesDesign and develop...

  • Big Data Engineer

    3 weeks ago


    Gurgaon, Haryana, India dunnhumby Full time

    We're seeking a talented Big Data Engineerto extend and improve our Data Engineering Team. This is an opportunity to work with a market-leading business to explore new opportunities for us and influence global retailers.About the RoleAs a Big Data Engineer, you will be responsible for working with stakeholders in the development of data technology that meet...


  • Gurgaon, Haryana, India Orange Business Full time

    Job SummaryOrange Business is seeking a Senior Data Engineer to join our Big Data B2B program. As part of this program, we have set up a shared Big Data platform and a Data Lake for use cases exploration and industrialization.The successful candidate will have 4-6 years of experience in building Data Pipelines on Prem and Cloud with the following key...

  • Data Engineer

    2 weeks ago


    Gurgaon, Haryana, India Chiselon Technologies Pvt Ltd Full time

    We are seeking a talented Data Engineer with expertise in Big Data and Google Cloud Platform (GCP) to join our team at Chiselon Technologies Pvt Ltd.This role is ideal for individuals with hands-on experience in Big Query, Data Proc, Airflow, Cloud Composer, GCP Hydra Services, and Cloud Data Optimization.Key responsibilities:Design and develop scalable data...

  • Senior Data Engineer

    3 weeks ago


    Gurgaon, Haryana, India Orange Business Services Full time

    About the RoleAs part of the Big Data B2B program, Orange Business Services set up a shared Big Data platform and a Data Lake for use cases exploration and industrialization.We are looking for a Senior Data Engineer with 4 years of experience in building Data Pipelines with the following Key Responsibilities:Automate and industrialize build and development...

  • Big Data Engineer

    4 weeks ago


    Gurgaon, Haryana, India Spectral Consultants – Search & Recruitment firm Full time

    Job Title: Big Data DeveloperJob Summary:We are seeking an experienced Big Data Developer to join our team at Spectral Consultants. The ideal candidate will have a strong background in building scalable and efficient data pipelines using Hive, Spark, Hadoop, and MapReduce.Key Responsibilities:Design, implement, and optimize large-scale data processing...

  • Big Data Engineer

    2 weeks ago


    Gurgaon, Haryana, India ACS Consultants Full time

    **Job Title:** Big Data Engineer**Job Summary:We are seeking an experienced Big Data Engineer to join our team at ACS Consultants. As a key member of our data science team, you will be responsible for designing, developing, and managing large-scale data processing systems using Hadoop, Hive, and Spark.Main Responsibilities:• Design and implement scalable...

  • Big Data Engineer

    3 weeks ago


    Gurgaon, Haryana, India Spectral Consultants – Search & Recruitment firm Full time

    Job Title: Big Data DeveloperJob Summary:We are seeking an experienced Big Data Developer to join our team at Spectral Consultants. The ideal candidate will have a strong background in building scalable and efficient data pipelines using Hive, Spark, Hadoop, and MapReduce.Key Responsibilities:Design, implement, and optimize large-scale data processing...

  • Data Engineer

    2 weeks ago


    Gurgaon, Haryana, India Spectral Consultants – Search & Recruitment firm Full time

    Job Role : Data Engineer - Big Data ArchitectureWe are seeking a skilled Data Engineer to join our team at Spectral Consultants. As a Data Engineer, you will play a crucial role in designing, building, and maintaining large-scale data processing pipelines using Big Data technologies like Hive, Spark, Hadoop, and MapReduce.Key Responsibilities :Design and...

  • Big Data Engineer

    4 weeks ago


    Gurgaon, Haryana, India Impetus Full time

    Job Title: Big Data DeveloperAt Impetus, we are seeking a highly skilled Big Data Developer to join our team. The ideal candidate will have a strong background in designing and coding across multiple platforms and languages, with expertise in Big Data technologies.Key Responsibilities:Design, develop, test, and deploy efficient and maintainable systems using...

  • Senior Data Engineer

    3 weeks ago


    Gurgaon, Haryana, India BayOne Solutions Full time

    Job Title: Senior Data EngineerWe are seeking a highly skilled Senior Data Engineer to join our team at BayOne Solutions. As a Senior Data Engineer, you will be responsible for designing, implementing, and maintaining large-scale data engineering systems on cloud platforms like Azure, AWS, and GCP.Key Responsibilities:Design and implement data pipelines...

  • Senior Data Engineer

    3 weeks ago


    Gurgaon, Haryana, India Nielsen Full time

    Unlock Your Potential as a Senior Data Engineer at NielsenWe're seeking a highly skilled Senior Data Engineer to join our team at Nielsen. As a key member of our engineering team, you'll be responsible for designing, building, and maintaining large-scale data processing systems.Key Responsibilities:Design and implement scalable, reliable, and cost-effective...

  • Big Data Engineer

    4 weeks ago


    Gurgaon, Haryana, India dunnhumby Full time

    We're looking for a Big Data Engineer who is passionate about working with large datasets and developing innovative solutions.Key Responsibilities:Design, develop, and maintain large-scale data processing systems using Spark and Hadoop.Work with stakeholders to understand business requirements and develop data-driven solutions.Collaborate with...

  • Big Data Developer

    4 weeks ago


    Gurgaon, Haryana, India Smart Consulting - Creating Future Leaders Full time

    Job Title: Big Data DeveloperSmart Consulting - Creating Future Leaders is seeking a highly skilled Big Data Developer to join our team. As a Big Data Developer, you will be responsible for designing, building, and maintaining data ingestion and transformation processes using Java, Spark, and other Big Data technologies.Responsibilities:Develop robust and...

  • Big Data Engineer

    1 week ago


    Gurgaon, Haryana, India dunnhumby Full time

    Transformative Data Engineering OpportunityWe're seeking a seasoned Big Data Engineer to extend and improve dunnhumby's Data Engineering Team. As a key member of our Innovation Technology department, you'll work with a market-leading business to explore new opportunities for data-driven growth and influence global retailers.ResponsibilitiesDevelop data...