Big Data Solutions Engineer

3 days ago


Surat, Gujarat, India beBeeData Full time ₹ 1,80,00,000 - ₹ 2,00,00,000

Job Title: Data Architect

A company in the data engineering sector is looking for a highly skilled professional with expertise in Scala, Spark, Python, NiFi, and Apache Kafka to join its team.

Key Responsibilities:
  • Design, develop, and optimize large-scale data pipelines and distributed data processing systems.
  • Work extensively with Scala, Spark (PySpark), and Python for data processing and transformation.
  • Develop and integrate streaming solutions using Apache Kafka and orchestration tools like NiFi / Airflow.
  • Write efficient queries and perform data analysis using Jupyter Notebooks and SQL.

We are looking for a candidate who has a proven track record in building, scaling, and optimizing big data pipelines, and hands-on experience in distributed data systems and cloud-based solutions.

Required Skills and Qualifications:
  • Scala – Minimum 3+ years of hands-on experience.
  • Strong expertise in Spark (PySpark) and Python.
  • Hands-on experience with Apache Kafka.
  • Knowledge of NiFi / Airflow for orchestration.
  • Strong experience in Distributed Data Systems (5+ years).
  • Proficiency in SQL and query optimization.
  • Good understanding of Cloud Architecture.
Benefits:
  • The ideal candidate will have a strong grasp of software engineering concepts, data modeling, and optimization techniques.
  • Experience in designing intuitive, responsive UIs for data analytics visualization.
  • Familiarity with Splunk or other monitoring/alerting solutions.
  • Hands-on experience with CI/CD tools (Git, Jenkins).

  • Big Data Engineer

    5 days ago


    Surat, Gujarat, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Big Data EngineerOverview:We are seeking an experienced Big Data Engineer to join our team. The ideal candidate will have a strong background in designing, building, and maintaining large-scale data processing systems.Key Responsibilities:Design and develop scalable big data architectures using technologies like AWS, Python, and PySpark.Build and...


  • Surat, Gujarat, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 25,00,000

    Key Job ResponsibilitiesDevelop, deploy, and maintain large-scale data systems using Apache Druid.Required Skills & Qualifications5+ years of experience in big data engineering with a strong focus on real-time analytics.Hands-on expertise in SQL, query optimization, and data modeling for Druid.Experience integrating Druid with Kafka, Hadoop, Spark, or...

  • Big Data Developer

    24 hours ago


    Surat, Gujarat, India beBeeDataScientist Full time ₹ 12,00,000 - ₹ 20,00,000

    Job Overview:We are seeking a talented professional to join our team as a Big Data Developer.Key Responsibilities:Design and develop efficient programs/systems for data analyticsTranslate client requirements into system requirementsEstimate work requirements to provide information on project estimationsCode, test, and document new or modified data...


  • Surat, Gujarat, India beBeeData Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    We seek a Senior Data Engineer to join our team.Design, develop, and maintain scalable and robust data pipelines that collect, process, and store large volumes of structured and unstructured data.Architect and implement data warehouses, data lakes, and other storage solutions that support analytics and reporting needs.Optimize data architectures and...


  • Surat, Gujarat, India beBeeDataEngineer Full time US$ 2,00,000 - US$ 2,50,000

    Job Description\Sigmoid empowers enterprises to make data-driven decisions by integrating advanced data engineering with AI consulting. Our global team specializes in cloud data modernization, predictive analytics, and DataOps, supported by multiple delivery centers and innovation hubs.\As a Technical Lead, you will be responsible for building a...


  • Surat, Gujarat, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Big Data Expert WantedWe're seeking a seasoned data professional to spearhead our big data endeavors. The ideal candidate will have 6-12 years of experience in managing and processing large datasets using PySpark, Hive, and other relevant tools.Mandatory Skills:PySpark: Proficiency in crafting complex Spark jobs and optimizing performanceHive: Experience...


  • Surat, Gujarat, India beBeeProject Full time ₹ 1,00,00,000 - ₹ 2,00,00,000

    Senior Project DirectorRole Overview:We seek an experienced senior-level professional to oversee large-scale projects within big data and analytics environments.The role involves delivering complex technical projects on time, within scope, while ensuring client satisfaction and seamless execution.Key Responsibilities:Oversee large-scale projects within big...


  • Surat, Gujarat, India beBeeData Full time ₹ 1,80,00,000 - ₹ 2,50,00,000

    Job Summary:We are seeking a highly skilled Enterprise Data Solutions Architect to lead the design, development, and management of data solutions on Google Cloud Platform (GCP).Key Responsibilities:Design end-to-end data architectures on GCP, aligning with business and technical requirements.Define data models, storage strategies, data ingestion, processing,...


  • Surat, Gujarat, India beBeeData Full time ₹ 18,00,000 - ₹ 24,00,000

    Job OverviewOur organization is a leader in the tech industry, dedicated to delivering innovative solutions that drive business transformation. We foster a collaborative and inclusive work environment that encourages professional growth and innovation.The ideal candidate will have experience with data pipeline design, development, and maintenance on Google...


  • Surat, Gujarat, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 20,00,000

    Role SummaryWe are seeking a skilled Data Engineer to join our team.Job Description:Achieve data processing goals by applying expertise in Trino (PrestoSQL) to optimize performance and scalability.Leverage knowledge of distributed computing frameworks and large-scale data systems to ensure seamless integration and high-quality output.Familiarize yourself...