Transformative Data Engineering Solutions Specialist

14 hours ago

Bareilly, Uttar Pradesh, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,00,00,000
Job Title: Data Engineering Specialist

Location: Major cities in India, including Bangalore, Chennai, Gurgaon, Pune, and Mumbai.

Experience: 7–10 Years (Minimum 3+ years in Scala)

Notice Period: Immediate to 30 Days

Mode of Work: Hybrid

Role Overview

We are seeking a highly skilled Data Engineering Specialist with strong expertise in Scala, Spark, Python, NiFi, and Apache Kafka to join our data engineering team. The ideal candidate will have a proven track record in building, scaling, and optimizing big data pipelines, and hands-on experience in distributed data systems and cloud-based solutions.

Key Responsibilities

- Design, develop, and optimize large-scale data pipelines and distributed data processing systems.

- Work extensively with Scala, Spark (PySpark), and Python for data processing and transformation.

- Develop and integrate streaming solutions using Apache Kafka and orchestration tools like NiFi / Airflow.

- Write efficient queries and perform data analysis using Jupyter Notebooks and SQL.

- Collaborate with cross-functional teams to design scalable cloud-based data architectures.

- Ensure delivery of high-quality code through code reviews, performance tuning, and best practices.

- Build monitoring and alerting systems leveraging Splunk or equivalent tools.

- Participate in CI/CD workflows using Git, Jenkins, and other DevOps tools.

Mandatory Skills

- Scala – Minimum 3+ years of hands-on experience.

- Strong expertise in Spark (PySpark) and Python.

- Hands-on experience with Apache Kafka.

- Knowledge of NiFi / Airflow for orchestration.

- Strong experience in Distributed Data Systems (5+ years).

- Proficiency in SQL and query optimization.

- Good understanding of Cloud Architecture.

Preferred Skills

- Exposure to messaging technologies like Apache Kafka or equivalent.

- Experience in designing intuitive, responsive UIs for data analytics visualization.

- Familiarity with Splunk or other monitoring/alerting solutions.

- Hands-on experience with CI/CD tools (Git, Jenkins).

- Strong grasp of software engineering concepts, data modeling, and optimization techniques.

  • Data Transformation Specialist

    2 days ago

    Bareilly, Uttar Pradesh, India beBeeDataTransformation Full time ₹ 10,00,000 - ₹ 15,00,000

    We are seeking a skilled data transformation specialist to support the migration of claims data from legacy systems to Guidewire Claim Center.About the Role:Analyze and map legacy system tables to Guidewire Claim Center structures, ensuring accurate data mapping and minimal discrepancies.Develop and validate SQL queries for data extraction and...

  • IOT Data Solutions Specialist

    1 day ago

    Bareilly, Uttar Pradesh, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 25,00,000

    IoT Data Solutions ArchitectWe are seeking a skilled specialist with 5 to 7 years of experience in designing and implementing scalable IoT data solutions.Develop and maintain large-scale IoT data ingestion, processing, and storage architectures.Utilize Python programming to build, optimize, and automate data pipelines leveraging AWS IoT services.Work...

  • Cloud Data Engineering Specialist

    1 week ago

    Bareilly, Uttar Pradesh, India beBeeDataEngineering Full time ₹ 1,00,00,000 - ₹ 2,00,00,000

    Job Title: Cloud Data Engineering SpecialistWe are seeking a skilled Cloud Data Engineering Specialist to join our team. As a key member of our data engineering team, you will collaborate with cross-functional teams to design and implement scalable data pipelines that empower business decision-making through advanced analytics.Key...

  • Data Transformation Specialist

    1 week ago

    Bareilly, Uttar Pradesh, India beBeeDataScientist Full time ₹ 15,00,000 - ₹ 25,00,000

    Unlock Career GrowthCvent is a leading provider of meetings, events, and hospitality technology.Our company fosters intrapreneurship, encouraging our team to think and act like entrepreneurs.Key Responsibilities:Design data transformation processes using Snowflake.Implement complex queries and data transformations using SQL scripting.Collaborate with teams...

  • Big Data Specialist

    2 days ago

    Bareilly, Uttar Pradesh, India beBeeData Full time ₹ 1,20,00,000 - ₹ 1,50,00,000

    Big Data Specialist Job DescriptionThis is a full-time role for an experienced specialist in data processing with one of our prominent clients.The specialist will be responsible for designing, deploying, and managing large-scale data processes to integrate information from various sources. Daily tasks include using ETL tools, performing data modeling,...

  • Big Data Specialist

    4 days ago

    Bareilly, Uttar Pradesh, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Opportunity: Big Data SpecialistWe are seeking a highly skilled big data specialist to design, build, and maintain robust data pipelines for processing channel activity data from multiple sources.The ideal candidate will possess strong knowledge of cloud computing, programming languages like Python, and experience in handling data from various sources...

  • Data Driven AI Solutions Specialist

    4 days ago

    Bareilly, Uttar Pradesh, India beBeeMachineLearning Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Artificial Intelligence Data SpecialistRole Overview: We are seeking a skilled Artificial Intelligence (AI) Data Specialist to support the development of innovative AI solutions.The ideal candidate will have experience in designing and implementing data-driven models, analyzing complex datasets, and collaborating with cross-functional teams.Develop and...

  • Highly Skilled Data Engineering Specialist

    3 days ago

    Bareilly, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000

    Senior Data Engineer Job DescriptionWe are seeking a highly skilled data engineer to design, develop and maintain data pipelines that extract data from Oracle Symphony via APIs, process and store it in the Databricks Lakehouse platform.This role requires expertise in data integration, ETL/ELT, APIs, and Databricks. The ideal candidate will have experience...

  • Cloud Transformation Lead

    1 week ago

    Bareilly, Uttar Pradesh, India beBeeCloudTransformation Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Senior Cloud Transformation SpecialistWe are seeking an experienced Senior Cloud Transformation Specialist to drive strategic deals and lead cross-functional teams. The ideal candidate will have a deep understanding of cloud modernization, digital engineering, DevOps, and Agile practices.About the RoleThe Senior Cloud Transformation Specialist will be...

  • Data Engineering Expertise for Scalable Cloud Solutions

    4 days ago

    Bareilly, Uttar Pradesh, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title:Cloud Data Engineer SpecialistWe are seeking a seasoned Cloud Data Engineer to design and implement scalable data engineering solutions using Google Cloud Platform (GCP) services.Key Responsibilities:Design, build, and optimize data pipelines using BigQuery, Dataflow, DataProc, and Cloud Composer.Implement Big Data Analytics solutions leveraging...