Big Data Engineer

4 days ago


Surat, Gujarat, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

Job Title: Big Data Engineer

Overview:

We are seeking an experienced Big Data Engineer to join our team. The ideal candidate will have a strong background in designing, building, and maintaining large-scale data processing systems.

Key Responsibilities:

  • Design and develop scalable big data architectures using technologies like AWS, Python, and PySpark.
  • Build and deploy high-performance data pipelines using Spark Dataframes in Python.
  • Optimize and troubleshoot complex data processing jobs that handle large volumes of data.
  • Work with version control tools like Git to manage code changes and collaborate with team members.
  • Develop expertise in Amazon's Analytics services like Amazon EMR, Amazon Athena, and AWS Glue.
  • Collaborate with cross-functional teams to design and implement data warehousing solutions using dimensional modeling techniques.
  • Stay up-to-date with the latest advancements in big data technologies and contribute to knowledge sharing within the team.

Required Skills and Qualifications:

  • 5+ years of experience in big data technologies, including hands-on experience with Python, PySpark, and AWS.
  • Proven track record of designing and deploying scalable data processing systems.
  • Strong understanding of data warehousing concepts, including dimensional modeling and ETL processes.
  • Experience with columnar storage formats like Parquet, Avro, and ORC.
  • Good knowledge of compression techniques like Snappy and Gzip.
  • Familiarity with AWS databases like Aurora, RDS, Redshift, ElastiCache, and DynamoDB.

Benefits:

  • Competitive salary and benefits package.
  • Ongoing training and professional development opportunities.
  • Collaborative and dynamic work environment.


  • Surat, Gujarat, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 25,00,000

    Key Job ResponsibilitiesDevelop, deploy, and maintain large-scale data systems using Apache Druid.Required Skills & Qualifications5+ years of experience in big data engineering with a strong focus on real-time analytics.Hands-on expertise in SQL, query optimization, and data modeling for Druid.Experience integrating Druid with Kafka, Hadoop, Spark, or...


  • Surat, Gujarat, India beBeeData Full time ₹ 1,80,00,000 - ₹ 2,00,00,000

    Job Title: Data ArchitectA company in the data engineering sector is looking for a highly skilled professional with expertise in Scala, Spark, Python, NiFi, and Apache Kafka to join its team.Key Responsibilities:Design, develop, and optimize large-scale data pipelines and distributed data processing systems.Work extensively with Scala, Spark (PySpark), and...

  • Big Data Developer

    2 hours ago


    Surat, Gujarat, India beBeeDataScientist Full time ₹ 12,00,000 - ₹ 20,00,000

    Job Overview:We are seeking a talented professional to join our team as a Big Data Developer.Key Responsibilities:Design and develop efficient programs/systems for data analyticsTranslate client requirements into system requirementsEstimate work requirements to provide information on project estimationsCode, test, and document new or modified data...


  • Surat, Gujarat, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Big Data Expert WantedWe're seeking a seasoned data professional to spearhead our big data endeavors. The ideal candidate will have 6-12 years of experience in managing and processing large datasets using PySpark, Hive, and other relevant tools.Mandatory Skills:PySpark: Proficiency in crafting complex Spark jobs and optimizing performanceHive: Experience...


  • Surat, Gujarat, India beBeeData Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    We seek a Senior Data Engineer to join our team.Design, develop, and maintain scalable and robust data pipelines that collect, process, and store large volumes of structured and unstructured data.Architect and implement data warehouses, data lakes, and other storage solutions that support analytics and reporting needs.Optimize data architectures and...


  • Surat, Gujarat, India beBeeDataEngineer Full time US$ 2,00,000 - US$ 2,50,000

    Job Description\Sigmoid empowers enterprises to make data-driven decisions by integrating advanced data engineering with AI consulting. Our global team specializes in cloud data modernization, predictive analytics, and DataOps, supported by multiple delivery centers and innovation hubs.\As a Technical Lead, you will be responsible for building a...


  • Surat, Gujarat, India beBeeDataEngineering Full time ₹ 25,00,000 - ₹ 30,00,000

    Job DescriptionWe are seeking an experienced Data Engineering professional to design, develop and implement scalable ETL workflows using Informatica BDM/DEI.This role involves understanding client requirements, designing, developing and testing of ETL architecture, transformation jobs and workflow schedules for a high-profile overseas project based in...


  • Surat, Gujarat, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 20,00,000

    Role SummaryWe are seeking a skilled Data Engineer to join our team.Job Description:Achieve data processing goals by applying expertise in Trino (PrestoSQL) to optimize performance and scalability.Leverage knowledge of distributed computing frameworks and large-scale data systems to ensure seamless integration and high-quality output.Familiarize yourself...


  • Surat, Gujarat, India beBeeBigData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Design and Develop Scalable Data ArchitecturesAs a Big Data Engineer, you will play a crucial role in designing and developing scalable data architectures to extract insights from large datasets.Main Responsibilities:Develop big data pipelines using PySpark, Hive, and other relevant technologies.Work on exposing data ingestion capabilities from disparate...


  • Surat, Gujarat, India beBeeData Full time ₹ 18,00,000 - ₹ 24,00,000

    Job OverviewOur organization is a leader in the tech industry, dedicated to delivering innovative solutions that drive business transformation. We foster a collaborative and inclusive work environment that encourages professional growth and innovation.The ideal candidate will have experience with data pipeline design, development, and maintenance on Google...