Big Data Engineer

2 days ago


Surat, Gujarat, India beBeeDataEngineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000
Job Title: Big Data Solutions Architect

We are seeking a highly skilled professional to lead the design and implementation of scalable data engineering solutions. The ideal candidate will have strong hands-on experience in architecting and implementing complex data architectures leveraging AWS services.

Key Responsibilities:

  • Design, develop, and optimize big data architectures leveraging AWS services for large-scale, complex data processing.
  • Build and maintain data pipelines using Spark (Scala) for both structured and unstructured datasets.
  • Architect and operationalize data engineering and analytics platforms (AWS preferred).
  • Implement and manage AWS services including EMR, Glue, Kinesis, DynamoDB, Athena, CloudFormation, API Gateway, and S3.
  • Work on real-time streaming solutions using Kafka and AWS Kinesis.
  • Support ML model operationalization on AWS (deployment, scheduling, and monitoring).
  • Analyze source system data and data flows to ensure high-quality, reliable data delivery for business needs.
  • Write highly efficient SQL queries and support data warehouse initiatives using Apache NiFi, Airflow, and Kylo.

Mandatory Skills & Qualifications:

  • Solid hands-on experience in Big Data Technologies (AWS, Scala, Hadoop and Spark mandatory)
  • Proven expertise in Spark with Scala
  • Hands-on experience with: AWS services (EMR, Glue, Lambda, S3, CloudFormation, API Gateway, Athena, Lake Formation)

Benefits:

  • Opportunity to work on cutting-edge big data projects
  • Collaborative team environment
  • Professional growth and development opportunities

Others:

  • Strong understanding of cloud-based technologies and architectures
  • Ability to work effectively in a fast-paced environment
  • Excellent communication and collaboration skills

  • Big Data Engineer

    12 hours ago


    Surat, Gujarat, India beBeeData Full time ₹ 20,00,000 - ₹ 30,00,000

    As a Big Data Engineer, you will be responsible for developing scalable and efficient big data solutions using Hadoop, Spark, Hive, HDFS, and Kafka.This role requires strong expertise in big data technologies, excellent problem-solving skills, and effective communication with colleagues.The ideal candidate will have:8+ years of professional experience in big...

  • Big Data Engineer

    1 week ago


    Surat, Gujarat, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Big Data EngineerOverview:We are seeking an experienced Big Data Engineer to join our team. The ideal candidate will have a strong background in designing, building, and maintaining large-scale data processing systems.Key Responsibilities:Design and develop scalable big data architectures using technologies like AWS, Python, and PySpark.Build and...


  • Surat, Gujarat, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 30,00,000

    Job SummaryAbout the RoleYou'll be working as part of a global analytics team, collaborating with diverse technologists to deliver high-quality solutions. The ideal candidate will have strong analytical skills, a bachelor's or master's degree in information technology, and 5+ years of experience as a data engineer in big data.The successful candidate will be...


  • Surat, Gujarat, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 25,00,000

    Key Job ResponsibilitiesDevelop, deploy, and maintain large-scale data systems using Apache Druid.Required Skills & Qualifications5+ years of experience in big data engineering with a strong focus on real-time analytics.Hands-on expertise in SQL, query optimization, and data modeling for Druid.Experience integrating Druid with Kafka, Hadoop, Spark, or...


  • Surat, Gujarat, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000

    Big Data EngineerWe are seeking a highly skilled professional with expertise in data processing, architecture, and engineering to join our team.The ideal candidate will have a proven track record in building, scaling, and optimizing big data pipelines using technologies like Spark, Python, and Apache Kafka.Key Responsibilities:Data Ingestion and Processing:...


  • Surat, Gujarat, India beBeeData Full time ₹ 1,80,00,000 - ₹ 2,00,00,000

    Job Title: Data ArchitectA company in the data engineering sector is looking for a highly skilled professional with expertise in Scala, Spark, Python, NiFi, and Apache Kafka to join its team.Key Responsibilities:Design, develop, and optimize large-scale data pipelines and distributed data processing systems.Work extensively with Scala, Spark (PySpark), and...


  • Surat, Gujarat, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Role: Data Information ArchitectKey Responsibilities:Communicate effectively with customers to ensure mutual understanding and satisfaction.Utilize expertise in big data technologies like Azure Databricks, Python/Scala/Spark/PySpark, HIVE, HBase, Impala, and Parquet to drive business outcomes.Apply strong SQL and RDBMS skills to analyze and optimize...


  • Surat, Gujarat, India beBeeDataiku Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Big Data Platform Manager JobWe are seeking a highly skilled Big Data Platform Manager to join our team. This is a challenging role that requires expertise in managing big data platforms, including day-to-day operations, administration, and monitoring of components.Manage big data platforms with day-to-day operations including administration and monitoring...

  • Big Data Engineer

    4 days ago


    Surat, Gujarat, India beBeeData Full time ₹ 25,00,000 - ₹ 37,50,000

    Unlock Your Career PotentialWe are seeking an experienced professional to lead the development and maintenance of scalable data pipelines, building out new API integrations, and collaborating with analytics and business teams to improve data models that feed business intelligence tools.This role requires strong technical and communication skills, with 6+...

  • Big Data Architect

    4 days ago


    Surat, Gujarat, India beBeeData Full time ₹ 20,00,000 - ₹ 30,00,000

    Big Data ArchitectWe are seeking a highly skilled Big Data Architect to design, build, and maintain large-scale data pipelines.Key Responsibilities:Design and implement robust data architectures using cloud-based technologies such as AWS Glue, Lambda, and DBT.Develop and optimize data models in Snowflake for high scalability and performance.Write efficient...