Implementing Scalable Data Pipelines for IoT Systems

4 days ago


Salem, Tamil Nadu, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 30,00,000
Senior Data Engineer - IoT Systems

We are seeking a highly skilled and experienced Senior Data Engineer to help design and implement a data processing pipeline using streaming analytics and telemetry data for a large retailer.

The ideal candidate will have hands-on coding expertise in Python and Pyspark, as well as strong Big Data experience, preferably on GCP. A strong understanding of data flow through IoT units and the ability to explain how sensors are designed and monitored is essential.

Key Responsibilities:

  1. Design and implement a scalable data processing pipeline using streaming analytics and telemetry data.
  2. Collaborate with cross-functional teams to identify business requirements and develop solutions that meet their needs.
  3. Maintain and improve existing data pipelines, ensuring high-quality data delivery and minimizing downtime.

Required Skills and Qualifications:

  • Hands-on experience with Python, Pyspark, and Big Data technologies.
  • Strong understanding of data flow through IoT units and sensor monitoring.
  • Experience working with equipment and systems from Emerson, Honeywell, or similar.
  • Excellent business analytics skills and ability to work directly with business partners.
  • Strong communication and collaboration skills.

Benefits:

This is an excellent opportunity for someone who is passionate about IoT systems and has a strong background in data engineering. If you are looking for a challenging role that offers opportunities for growth and development, this could be the perfect fit for you.



  • Salem, Tamil Nadu, India beBeeDataEngineer Full time ₹ 17,70,000 - ₹ 25,15,000

    We are seeking a Data Engineer with 5-7 years of experience in IoT data engineering and strong Python programming skills to design and implement scalable IoT data solutions.Key Responsibilities:Develop and deploy efficient data pipelines using cloud servicesWrite high-quality, reusable, and maintainable code for data processing tasksMaintain system...


  • Salem, Tamil Nadu, India beBeeDataEngineer Full time ₹ 1,80,00,000 - ₹ 2,50,00,000

    Job SummaryWe are seeking a seasoned Data Engineer to join our team. This is a key role that involves designing and implementing scalable data processing systems.The ideal candidate will have 5+ years of experience in data engineering, with strong expertise in Python and PySpark. They should also possess a deep understanding of Big Data concepts and...

  • Big Data Expert

    7 days ago


    Salem, Tamil Nadu, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Senior Data Engineer - Real-Time & Big QueryWe are seeking a seasoned professional to join our team as a Senior Data Engineer, specializing in real-time and batch data processing on the Google Cloud Platform.Experience: 10+ yearsWork Location: Remote, IndiaShift: 3:00 PM to 12:00 AM ISTNotice Period: Immediate to 15 daysAbout the RoleThis is an exciting...


  • Salem, Tamil Nadu, India beBeeDataEngineer Full time ₹ 40,00,000 - ₹ 50,00,000

    Job TitleWe are seeking a Data Engineer to design, develop, and maintain scalable ETL/ELT pipelines using Apache Airflow, Apache Spark, Azure Data Factory, and Databricks.This role involves integrating and managing structured and unstructured data from diverse sources including Azure Cosmos DB, Azure Data Lake, and Azure Synapse Analytics.The successful...


  • Salem, Tamil Nadu, India beBeeData Full time ₹ 80,00,000 - ₹ 1,50,00,000

    Job Title: Technical SpecialistThis is a challenging and exciting role that offers the opportunity to work on designing, implementing, and managing data pipelines using Azure Data Factory. You will implement scalable data processing solutions within Azure Synapse Analytics, and have the chance to work with data modeling, ETL processes, and query...


  • Salem, Tamil Nadu, India beBeeCloud Full time ₹ 15,00,000 - ₹ 20,00,000

    Cloud Solution Architect for IoT IntegrationWe are seeking a skilled Cloud Solution Architect to design and implement scalable, secure, and efficient cloud solutions using Azure.The ideal candidate will have experience with Azure cloud services, particularly IoT Edge and IoT Hub.A strong understanding of .Net Core and its application in cloud environments is...


  • Salem, Tamil Nadu, India HCLTech Full time

    Dear Candidate, Greetings from HCL Tech We are hiring Azure Cloud Solution Architect JD :Azure Cloud Solution Architect JD :Notice Period : Immediate Joiner or Less than One month of noticeLocation : Noida OnlyAzure Cloud Solution Architect JD :Objective: To design and implement scalable, secure, and efficient cloud solutions using Azure, with a focus on IoT...


  • Salem, Tamil Nadu, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    Data Engineer RoleWe are seeking a skilled Data Engineer to join our crew as a key member of our engineering team.You will be responsible for designing and implementing scalable data processing systems using SQL, Python, and PySpark.Develop large-scale data pipelines using distributed systems.Implement efficient data storage solutions using Linux.Collaborate...


  • Salem, Tamil Nadu, India beBeeDataEngineer Full time ₹ 12,56,775 - ₹ 25,13,550

    Job TitleSenior Data EngineerWe are seeking an experienced data engineer with expertise in cloud-based platforms and big data tools to design, develop, and maintain scalable data pipelines. The ideal candidate will have a strong background in AWS and Databricks services, as well as experience in building and optimizing ETL/ELT workflows for large-scale...


  • Salem, Tamil Nadu, India beBeeData Full time ₹ 60,00,000 - ₹ 1,20,00,000

    We're seeking an experienced Data Engineer to design and build robust data pipelines handling high-volume financial data from various sources.Main Responsibilities:Develop and manage end-to-end data pipelines for stocks, cryptocurrencies, and other financial datasets ensuring scalability and real-time availability.Integrate third-party APIs and data feeds...