Big Data Innovator

7 days ago

Tiruchi, Tamil Nadu, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000
Job Title: Big Data Engineer

Role Overview:

We seek a highly skilled data big engineer with strong expertise in Scala, Spark, Python, NiFi, and Apache Kafka to fill this position.

  • Design, develop, and optimize large-scale data pipelines and distributed data processing systems.
  • Work extensively with Scala, Spark (PySpark), and Python for data processing and transformation.
  • Develop and integrate streaming solutions using Apache Kafka and orchestration tools like NiFi / Airflow.
  • Write efficient queries and perform data analysis using Jupyter Notebooks and SQL.
  • Collaborate with cross-functional teams to design scalable cloud-based data architectures.

Key Responsibilities:

The successful candidate will be responsible for:

  • Ensuring delivery of high-quality code through code reviews, performance tuning, and best practices.
  • Building monitoring and alerting systems leveraging Splunk or equivalent tools.
  • Participating in CI/CD workflows using Git, Jenkins, and other DevOps tools.
  • Contributing to product development with a focus on scalability, maintainability, and performance.

Mandatory Skills:

The ideal candidate should possess the following skills:

  • Scala – Minimum 3+ years of hands-on experience.
  • Strong expertise in Spark (PySpark) and Python.
  • Hands-on experience with Apache Kafka.
  • Knowledge of NiFi / Airflow for orchestration.
  • Strong experience in Distributed Data Systems (5+ years).
  • Proficiency in SQL and query optimization.
  • Good understanding of Cloud Architecture.

Preferred Skills:

The following skills are preferred but not required:

  • Exposure to messaging technologies like Apache Kafka or equivalent.
  • Experience in designing intuitive, responsive UIs for data analytics visualization.
  • Familiarity with Splunk or other monitoring/alerting solutions.
  • Hands-on experience with CI/CD tools (Git, Jenkins).
  • Strong grasp of software engineering concepts, data modeling, and optimization techniques.

  • Big Data Innovation Specialist

    1 week ago

    Tiruchi, Tamil Nadu, India beBeeData Full time ₹ 10,00,000 - ₹ 15,00,000

    Job Title: Big Data DeveloperDescriptionWe are seeking a highly skilled big data developer to drive innovation and growth. The ideal candidate will possess hands-on experience in Spark, Scala, and Pyspark, as well as a solid understanding of databases and proficiency in writing complex queries.Key Responsibilities:Developing and implementing data-driven...

  • Big Data Specialist

    7 days ago

    Tiruchi, Tamil Nadu, India beBeeBigData Full time ₹ 28,96,000 - ₹ 36,24,000

    About our company:We are a global technology consulting and digital solutions provider that empowers enterprises to reimagine business models and accelerate innovation through digital technologies.We cater to over 700 clients with our extensive domain and technology expertise to drive superior competitive differentiation, customer experiences, and business...

  • Big Data Specialist

    1 week ago

    Tiruchi, Tamil Nadu, India beBeeDataEngineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job OpportunityThe Data & Analytics team collaborates with various stakeholders to resolve intricate business challenges that impact the company's progress.We utilize cutting-edge technologies from the Cloud & Big Data ecosystem to enhance business outcomes and create prototypes, proof-of-concept projects, and application development.We seek an experienced...

  • Advanced Big Data Architect

    2 weeks ago

    Tiruchi, Tamil Nadu, India beBeeDataEngineering Full time ₹ 12,30,000 - ₹ 20,15,000

    Big Data EngineerWe are seeking a skilled Big Data Engineer to design, build and maintain robust data pipelines for processing channel activity data from multiple sources. As a key member of our team, you will work on AWS cloud infrastructure leveraging Python for building automated data engineering solutions and data transformations.Key...

  • Big Data Systems Engineer

    5 days ago

    Tiruchi, Tamil Nadu, India beBeeData Full time ₹ 12,50,000 - ₹ 17,50,000

    Job Title: Big Data Systems EngineerJob Description:We are seeking an experienced Big Data Systems Engineer to join our organization. As a Big Data Systems Engineer, you will play a key role in designing, building, and maintaining large-scale data systems.Key Responsibilities:Design, build, and maintain scalable data pipelines using cloud services like...

  • Big Data Expert

    1 week ago

    Tiruchi, Tamil Nadu, India beBeeDataEngineer Full time ₹ 1,00,00,000 - ₹ 1,50,00,000

    Senior GCP Data Engineer Job DescriptionWe are seeking a seasoned senior data engineer to join our team in India. As a specialist with 10+ years of experience, you will work on challenging projects for industries like Energy, Oil & Gas, Healthcare, and Finance. About the RoleDesign scalable data pipelines for batch and real-time processing using GCP tools...

  • Expert in Big Data Solutions

    2 weeks ago

    Tiruchi, Tamil Nadu, India beBeeData Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Big Data Solutions ExpertWe are looking for a seasoned professional to design, build and maintain large-scale data pipelines.The ideal candidate should have experience with GCP, Bigquery, SQL and Python dataflow skills.Responsibilities:Design and implement data solutions using GCP services.Develop and implement data transformations using Python and...

  • Big Data Expert

    1 week ago

    Tiruchi, Tamil Nadu, India beBeeDataScientist Full time ₹ 18,00,000 - ₹ 25,00,000

    About UsWe offer high-quality, cost-effective solutions to businesses. We utilize best-of-breed technologies and rapidly deployable solutions to meet the IT requirements of companies.Job OverviewOur team is seeking an experienced Data Scientist to join us. The ideal candidate will have 5-12 years of experience in Big data spark, SQL, Hive, Scala and should...

  • Data Innovation Leader

    1 week ago

    Tiruchi, Tamil Nadu, India beBeeMachineLearning Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Lead Data ScientistWe are seeking an innovative and experienced Lead Data Scientist to join our team. This is a unique opportunity to collaborate with experts in cutting-edge technologies and contribute to the development of industry-leading solutions.The successful candidate will have a proven track record of designing, building, and deploying predictive...

  • Big Data Cloud Architecture Specialist

    2 weeks ago

    Tiruchi, Tamil Nadu, India beBeeCloud Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    About the RoleWe are seeking a skilled Big Data and Cloud Architect to join our team at Societe Generale Global Solution Centre in Bengaluru.