Big Data Engineer

7 days ago

Noida, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 10,00,000 - ₹ 25,00,000

Big Data Engineering

At the forefront of big data processing lies a complex web of systems, tools and workflows. To engineer such processes requires expertise in multiple areas, including data flow platforms, workflow management and large dataset integration.

Our ideal candidate will possess hands-on experience with Apache Spark, utilizing Scala for development, while also being proficient in the realm of data flow platforms like Apache NiFi.

Key Responsibilities:

  1. Design, build, and maintain robust data pipelines using Apache Spark and Scala.
  2. Develop, optimize, and manage data processing workflows leveraging Apache Oozie.
  3. Implement and monitor data flows through the utilization of Apache NiFi.
  4. Ensure scalability, reliability, and performance optimization of data pipelines.
  5. Collaborate with cross-functional teams to integrate and process vast datasets.
  6. Maintain high code quality and adhere to best practices throughout the development lifecycle.

Essential Skills:

  • Apache Spark with Scala programming

Secondary Skills:

  • Apache Oozie
  • Apache NiFi

  • Big Data

    1 week ago

    Noida, Uttar Pradesh, India Iris Software Inc. Full time

    Job DescriptionWhy Join UsAre you inspired to grow your career at one of Indias Top 25 Best Workplaces in IT industry Do you want to do the best work of your life at one of the fastest growing IT services companies Do you aspire to thrive in an award-winning work culture that values your talent and career aspirations Its happening right here at Iris...

  • Big Data Infrastructure Engineer

    2 weeks ago

    Noida, Uttar Pradesh, India beBeeDataPlatform Full time ₹ 15,00,000 - ₹ 20,00,000

    Job Title: Data Platform EngineerAbout the RoleThis position involves designing, developing and maintaining large-scale big data pipelines. The role requires strong technical skills, particularly in Scala and Java applications.The ideal candidate will have experience with containerization technology (Docker), cloud-native platforms, and big data technologies...

  • Big Data

    7 days ago

    Noida, Uttar Pradesh, India Iris Software Inc. Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Why Join Us?Are you inspired to grow your career at one ofIndia's Top 25 Best Workplaces in IT industry?Do you want to do the best work of your life at one of thefastest growing IT services companies? Do you aspire to thrive in an award-winning work culture thatvalues your talent and career aspirations? It'shappening right hereat Iris Software.About Iris...

  • Senior Big Data Architect

    1 day ago

    Noida, Uttar Pradesh, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Job SummaryWe are seeking a highly skilled Big Data Engineer to design, architect, and implement scalable data engineering solutions using AWS services. The ideal candidate will bring strong hands-on experience in designing and optimizing Big Data architectures.Key ResponsibilitiesDesign and develop Big Data architectures leveraging AWS services for...

  • Azure & Big Data - Lead

    1 week ago

    Noida, Uttar Pradesh, India IRIS software Full time

    Job DescriptionWhy Join UsAre you inspired to grow your career at one ofIndia's Top 25 Best Workplaces in IT industryDo you want to do the best work of your life at one of thefastest growing IT services companies Do you aspire to thrive in an award-winning work culture thatvalues your talent and career aspirations It'shappening right hereat Iris...

  • Azure & Big Data - Lead

    4 days ago

    Noida, Uttar Pradesh, India Iris Software Inc. Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Why Join Us?Are you inspired to grow your career at one ofIndia's Top 25 Best Workplaces in IT industry?Do you want to do the best work of your life at one of thefastest growing IT services companies? Do you aspire to thrive in an award-winning work culture thatvalues your talent and career aspirations? It'shappening right hereat Iris Software.About Iris...

  • Big Data Expert

    2 days ago

    Noida, Uttar Pradesh, India beBeeCloudDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Cloud Data Engineer Job OpportunityWe are seeking a skilled Cloud Data Engineer to work with our team on a challenging project involving big data processing and analytics using the Databricks platform.The ideal candidate will have strong expertise in Databricks, proficiency in Python programming, and experience with data manipulation libraries such as Pandas...

  • Senior Data Engineer

    7 days ago

    Noida, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 1,04,000 - ₹ 1,30,878

    Looking for a challenging role in data engineering? This position is perfect for you!About the JobWe are seeking an experienced Data Engineer to join our team and contribute to building scalable, reliable, and secure data pipelines using PySpark and Azure cloud platform.The ideal candidate will have strong programming skills in Python and Scala, with...

  • Lead Big Data Solution Engineer

    6 days ago

    Noida, Uttar Pradesh, India Impetus Full time ₹ 15,00,000 - ₹ 28,00,000 per year

    QualificationRequiredProven hands-on experience on designing, developing and supporting Database projects for analysis in a demanding environment.Proficient in database design techniques – relational and dimension designsExperience and a strong understanding of business analysis techniques used.High proficiency in the use of SQL or MDX queries.Ability to...

  • Data Scientist

    1 week ago

    Noida, Uttar Pradesh, India BIG Language Solutions Full time

    Job Description – Data Scientist- Design, build, and maintain robust and scalable applications using Python and advanced AI frameworks.- Develop complex, multi-step workflows and autonomous systems using LLM Orchestrators like LangChain, LlamaIndex, or Semantic Kernel.- Integrate AI models and agentic systems with our existing data pipelines, APIs, and...