Big Data Engineer

22 hours ago


India beBeeDataEngineering Full time ₹ 12,00,000 - ₹ 19,00,000

Job Title: Big Data Engineer

Key Responsibilities:
  • Design, build, and maintain large-scale data processing systems.
  • Develop PySpark applications using Spark Dataframes in Python.
  • Optimize spark jobs to process huge volumes of data.
  • Utilize Amazon's Analytics services such as EMR, Athena, and AWS Glue.
  • Work with version control tools like Git and AWS Lambda.

Requirements:

  • Hands-on experience in Python, PySpark, and AWS databases.
  • Strong understanding of data warehousing concepts including dimensions, facts, and schemas.
  • Experience with columnar storage formats such as Parquet, Avro, and ORC.
  • Knowledge of compression techniques including Snappy and Gzip.
  • Good understanding of big data technologies and data engineering principles.

  • Big Data Engineer

    3 weeks ago


    India Amazon Music Full time

    Job DescriptionDESCRIPTIONProfit Intelligence team in Amazon Retail is seeking a seasoned and talented Senior Data Engineer to join the Historical Contribution Profit (HCP) team. HCP is a fast growing team with a mandate to build tools to automate profit-and-loss forecasting and planning for the Physical Consumer business. We are building the next generation...

  • Big Data

    4 weeks ago


    India Technomech Placements Full time

    Job Title Big Data DeveloperExperience 4 to 10 yearsLocation Pune Bangalore Gurgaon Develop optimize and maintain big data solutions Work with Hadoop Spark Hive and other big data technologies Design and implement scalable data pipelines Collaborate with cross-functional teams for data-driven solutions Strong programming skills in Java Scala...

  • Big Data Developer

    4 weeks ago


    India DigiHelic Solutions Pvt. Ltd. Full time

    Job descriptionKey Responsibilities:Big Data Architecture: Design, develop, and maintain scalable and distributed data architectures capable of processing large volumes of data.Data Storage Solutions: Implement and optimize data storage solutions using technologies such as Hadoop, Spark, and PySpark.PySpark Development: Develop and implement efficient ETL...

  • Big Data Architect

    7 days ago


    India beBeeDataEngineering Full time ₹ 1,00,00,000 - ₹ 2,00,00,000

    Senior Big Data EngineerWe are seeking an experienced data professional to design, build and maintain large-scale data pipelines. The ideal candidate will have a strong understanding of big data technologies, including Spark, PySpark and SQL.Main Responsibilities:Create efficient data pipelines using Apache Spark and ETL workflowsProcess large datasets using...


  • India UST Full time

    If you arehighlyinterested and availableimmediately , please submit your resume along with your total experience, current CTC, notice period, and current location details toNitin.patil@ust.comKey Responsibilities:Design, develop, and optimizedata pipelines and ETL workflows .Work withApache Hadoop, Airflow, Kubernetes, and Containersto streamline data...


  • India DataE2E Technologies Full time

    Technical Manager – AzureLocation: 100% RemoteEmployment Type: Full-timeShift Timing : 3 pm – 11 pm ISTJob Summary:About the Role:We are seeking a highly experienced and strategic Engineering Manager with deep expertise in Big Data platforms, Microsoft Azure, and Databricks. The ideal candidate will lead a team of talented data engineers to design and...


  • India DataE2E Technologies Full time

    Technical Manager – Azure Location: 100% Remote Employment Type: Full-time Shift Timing : 3 pm – 11 pm IST Job Summary: About the Role: We are seeking a highly experienced and strategic Engineering Manager with deep expertise in Big Data platforms , Microsoft Azure , and Databricks . The ideal candidate will lead a team of talented data engineers...


  • India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Job OverviewThe Scala Big Data Engineer will design, develop and optimize data pipelines and ETL workflows. They will work with Apache Hadoop, Airflow, Kubernetes and Containers to streamline data processing.Key Responsibilities:Design and develop data pipelines and ETL workflowsWork with Apache Hadoop, Airflow, Kubernetes and Containers to streamline data...


  • India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    The Travel Industry is Evolving. Be a Part of It.In today's digital age, the travel industry is witnessing a paradigm shift. The traditional approach to booking travel arrangements is being revolutionized by innovative technologies and forward-thinking companies. As a Data Engineer, you will play a crucial role in this transformation.Job DescriptionWe are...


  • India Idyllic Services Full time

    Job Title: Big Data Engineer – Scala Location: Experience: 7–10 Years (Minimum 3+ years in Scala)Immediate to 30 Days Mode of Work: Hybrid &##Click the link below to learn more about the role and take the AI Interview to begin your application journey: We are looking for a highly skilled Big Data Engineer (Scala) with strong expertise in Scala,...