Big Data Expert

5 days ago

Aligarh, Uttar Pradesh, India beBeeData Full time ₹ 2,00,00,000 - ₹ 2,50,00,000
Job Title

Data Engineering Specialist – Scala

Role Overview:

We are seeking a skilled Data Engineering Specialist (Scala) with expertise in Scala, Spark, Python, NiFi, and Apache Kafka to join our team.

Key Responsibilities:

  • Develop large-scale data pipelines and distributed data processing systems.
  • Work extensively with Scala, Spark (PySpark), and Python for data processing and transformation.
  • Design streaming solutions using Apache Kafka and orchestration tools like NiFi / Airflow.
  • Write efficient queries and perform data analysis using Jupyter Notebooks and SQL.
  • Collaborate with cross-functional teams to design scalable cloud-based data architectures.
  • Ensure delivery of high-quality code through code reviews, performance tuning, and best practices.
  • Build monitoring and alerting systems leveraging Splunk or equivalent tools.
  • Participate in CI/CD workflows using Git, Jenkins, and other DevOps tools.
  • Contribute to product development with a focus on scalability, maintainability, and performance.

Mandatory Skills:

  • Scala – Minimum 3+ years of hands-on experience.
  • Strong expertise in Spark (PySpark) and Python.
  • Hands-on experience with Apache Kafka.
  • Knowledge of NiFi / Airflow for orchestration.
  • Strong experience in Distributed Data Systems (5+ years).
  • Proficiency in SQL and query optimization.
  • Good understanding of Cloud Architecture.

Preferred Skills:

  • Exposure to messaging technologies like Apache Kafka or equivalent.
  • Experience in designing intuitive, responsive UIs for data analytics visualization.
  • Familiarity with Splunk or other monitoring/alerting solutions.
  • Hands-on experience with CI/CD tools (Git, Jenkins).
  • Strong grasp of software engineering concepts, data modeling, and optimization techniques.

  • Big Data Expert

    1 week ago

    Aligarh, Uttar Pradesh, India beBeedataAutomation Full time US$ 9,62,177 - US$ 12,49,539

    Job Title: Big Data Tester As a seasoned data automation expert, you will have the opportunity to work with large datasets, comprehend stored procedures, and independently craft data-driven automation logic. Develop and execute test cases with a focus on Fixed Income trading workflows. Key Responsibilities:

  • Big Data Expert

    1 week ago

    Aligarh, Uttar Pradesh, India beBeeDataAdministrator Full time ₹ 1,56,00,000 - ₹ 2,02,50,000

    Big Data Administrator JobWe are looking for a skilled professional to manage and maintain our big data platform. The ideal candidate will have experience with Hadoop, Hive, and other big data tools.Administer and monitor Big Data Platform components including Hadoop Hive HBase BigSQL etc.Support Technical and Application team requests for data copies across...

  • Big Data Engineer

    2 weeks ago

    Aligarh, Uttar Pradesh, India Tata Consultancy Services Full time

    Greetings from TCSTCS is hiring for Big Data Location: - Chennai/Mumbai/PuneDesired Experience Range: 6 to 12 yearsMust-Have • PySpark • HiveGood-to-Have• Spark • HBase • DQ tool • Agile Scrum experience • Exposure in data ingestion from disparate sources onto Big Data platformThanksAnshika

  • Big Data Expert Wanted

    2 weeks ago

    Aligarh, Uttar Pradesh, India beBeeDataProfessional Full time ₹ 10,00,000 - ₹ 15,00,000

    Seeking Experienced Data ProfessionalsWe are on the hunt for skilled professionals to join our team in Bengaluru.About the Role:Our ideal candidate will have a solid understanding of Big Data Eco System Tools, Scala, Spark, Hive, and Hadoop.The successful candidate will be responsible for developing, tweaking queries, and working on performance...

  • Senior Big Data Engineer

    1 week ago

    Aligarh, Uttar Pradesh, India beBeeData Full time ₹ 1,80,00,000 - ₹ 2,40,00,000

    About the RoleWe are seeking a skilled Senior Big Data Engineer to lead the development and maintenance of our Enterprise TruRisk Platform. This platform helps customers measure, communicate, and eliminate cyber risks.The ideal candidate will have expertise in designing, developing, and supporting highly scalable, distributed SaaS-based security risk...

  • Big Data Developer

    7 days ago

    Aligarh, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Title:Data Engineer - Big Data SolutionsWe are seeking a highly skilled Data Engineer to lead our team in developing and implementing Big Data solutions. This role requires expertise in designing, installing, configuring, and supporting Big Data clusters.

  • Big Data Specialist

    5 days ago

    Aligarh, Uttar Pradesh, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    Big Data SpecialistAs a Big Data Specialist, you will play a key role in shaping our organization's data strategy. This involves designing and implementing robust infrastructure solutions to support business growth.Job SummaryOur team is seeking an experienced professional to lead the implementation of cloud-based infrastructure using Python and PySpark. You...

  • Big Data Systems Architect

    1 week ago

    Aligarh, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 20,00,000

    Job Title: Big Data Systems ArchitectWe are seeking a highly skilled professional to design, develop, and maintain large-scale data systems that support business intelligence tools and foster data-driven decision making across the organization.

  • Lead Big Data Architect

    5 days ago

    Aligarh, Uttar Pradesh, India beBeeData Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Senior Data EngineerWe are seeking a seasoned data engineer to drive the design and implementation of next-generation data platforms. This key role will oversee the development, deployment, and maintenance of scalable data architectures to support business-critical initiatives.Key Responsibilities:- Design and implement highly available and scalable data...

  • Big Data Architect

    2 weeks ago

    Aligarh, Uttar Pradesh, India beBeeDataArchitecture Full time ₹ 15,00,000 - ₹ 25,00,000

    Job OverviewData architects at leading organizations design and implement large-scale distributed data systems.Responsibilities:Designing complex distributed architectures for high-performance applications.Collaborating with cross-functional teams to drive innovation and efficiency.Developing and maintaining scalable solutions that meet business...