Big Data Engineering Professional

6 days ago

Surat, Gujarat, India beBeeDataEngineering Full time ₹ 10,00,000 - ₹ 20,00,000

Azure data engineering involves designing and implementing large-scale data processing systems using Azure technologies.

Key Responsibilities:
  • Familiarity with SQL and Python, with a focus on SQL for querying and managing relational databases.
  • Experience in Apache Spark for data processing, utilizing its scalable and fault-tolerant architecture.
  • Understanding of Delta files and Lakehouse architecture for storing and processing large amounts of data.
  • Data warehouse knowledge or experience, including database design and optimization techniques.
  • Hands-on skills in Microsoft Fabric, including data ingestion, processing, and analytics capabilities.
  • Practical experience in setting up end-to-end analytics pipelines, managing Lakehouse architectures, and working with Apache Spark and Delta Lake tables.
  • Understanding of Microsoft Fabric's capabilities for complete analytics solutions, including data warehousing and business intelligence.
  • Familiarity with features like Direct Lake access for Power BI reports and dashboards.
  • Utilizing Apache Spark for large-scale data processing and advanced data analytics with Delta Lake tables.
  • Ingesting data using Dataflows Gen2 and creating pipelines with Data Factory capabilities for data transformation and loading.
Benefits:
  • Opportunity to work with cutting-edge technologies and innovative projects.
  • Collaborative team environment with experienced professionals.
  • Continuous learning and growth opportunities through training and development programs.
  • Flexible work arrangements and remote work options.

  • Big Data Engineer

    4 days ago

    Surat, Gujarat, India beBeeData Full time ₹ 20,00,000 - ₹ 30,00,000

    As a Big Data Engineer, you will be responsible for developing scalable and efficient big data solutions using Hadoop, Spark, Hive, HDFS, and Kafka.This role requires strong expertise in big data technologies, excellent problem-solving skills, and effective communication with colleagues.The ideal candidate will have:8+ years of professional experience in big...

  • Big Data Engineer

    5 days ago

    Surat, Gujarat, India beBeeDataEngineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job Title: Big Data Solutions ArchitectWe are seeking a highly skilled professional to lead the design and implementation of scalable data engineering solutions. The ideal candidate will have strong hands-on experience in architecting and implementing complex data architectures leveraging AWS services.Key Responsibilities:Design, develop, and optimize big...

  • Big Data Engineer

    2 weeks ago

    Surat, Gujarat, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Big Data EngineerOverview:We are seeking an experienced Big Data Engineer to join our team. The ideal candidate will have a strong background in designing, building, and maintaining large-scale data processing systems.Key Responsibilities:Design and develop scalable big data architectures using technologies like AWS, Python, and PySpark.Build and...

  • Data Engineering Professional

    2 days ago

    Surat, Gujarat, India beBeeDataEngineering Full time ₹ 90,00,000 - ₹ 1,20,00,000

    Job Title: Data Engineering ProfessionalWe are seeking an experienced data engineering professional to drive large-scale data processing systems.Key Responsibilities:Design and develop large-scale data processing systems using Python, Terraform, and GCP Cloud Run.Collaborate with cross-functional teams to integrate data pipelines and ensure seamless data...

  • Senior Big Data Developer

    4 days ago

    Surat, Gujarat, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000

    Big Data EngineerWe are seeking a highly skilled professional with expertise in data processing, architecture, and engineering to join our team.The ideal candidate will have a proven track record in building, scaling, and optimizing big data pipelines using technologies like Spark, Python, and Apache Kafka.Key Responsibilities:Data Ingestion and Processing:...

  • Big Data Engineering Specialist

    4 days ago

    Surat, Gujarat, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 30,00,000

    Job SummaryAbout the RoleYou'll be working as part of a global analytics team, collaborating with diverse technologists to deliver high-quality solutions. The ideal candidate will have strong analytical skills, a bachelor's or master's degree in information technology, and 5+ years of experience as a data engineer in big data.The successful candidate will be...

  • Big Data Solutions Engineer

    2 weeks ago

    Surat, Gujarat, India beBeeData Full time ₹ 1,80,00,000 - ₹ 2,00,00,000

    Job Title: Data ArchitectA company in the data engineering sector is looking for a highly skilled professional with expertise in Scala, Spark, Python, NiFi, and Apache Kafka to join its team.Key Responsibilities:Design, develop, and optimize large-scale data pipelines and distributed data processing systems.Work extensively with Scala, Spark (PySpark), and...

  • Big Data Engineer

    7 days ago

    Surat, Gujarat, India beBeeData Full time ₹ 25,00,000 - ₹ 37,50,000

    Unlock Your Career PotentialWe are seeking an experienced professional to lead the development and maintenance of scalable data pipelines, building out new API integrations, and collaborating with analytics and business teams to improve data models that feed business intelligence tools.This role requires strong technical and communication skills, with 6+...

  • Senior Big Data Engineer

    2 weeks ago

    Surat, Gujarat, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 25,00,000

    Key Job ResponsibilitiesDevelop, deploy, and maintain large-scale data systems using Apache Druid.Required Skills & Qualifications5+ years of experience in big data engineering with a strong focus on real-time analytics.Hands-on expertise in SQL, query optimization, and data modeling for Druid.Experience integrating Druid with Kafka, Hadoop, Spark, or...

  • Big Data Developer

    1 week ago

    Surat, Gujarat, India beBeeDataScientist Full time ₹ 12,00,000 - ₹ 20,00,000

    Job Overview:We are seeking a talented professional to join our team as a Big Data Developer.Key Responsibilities:Design and develop efficient programs/systems for data analyticsTranslate client requirements into system requirementsEstimate work requirements to provide information on project estimationsCode, test, and document new or modified data...