Principal Data Pipelines Specialist

3 days ago

Hyderabad, Telangana, India beBeeDataEngineer Full time ₹ 1,80,00,000 - ₹ 2,00,00,000

Job Description

">Robust Data Pipelines Engineer">

We are seeking an experienced engineer to design, build, and optimize robust data pipelines for our SmartFM platform.

">Key Responsibilities:">
  • ">
  • Design, develop, and maintain scalable and efficient data ingestion pipelines from diverse sources using technologies like StreamSets, Azure Data Factory, Apache Spark, Flink, and Kafka.">
  • Implement robust data transformation and processing logic to clean, enrich, and structure raw data into formats suitable for analysis and machine learning models.">
  • Manage and optimize data storage solutions, primarily within MongoDB, ensuring efficient schema design, data indexing, and query performance for large datasets.">
  • Collaborate closely with data scientists to understand their data needs, provide high-quality, reliable datasets, and assist in deploying data-driven solutions.">
  • Ensure data quality, consistency, and integrity across all data pipelines and storage systems, implementing monitoring and alerting mechanisms for data anomalies.">
">

Requirements:

">
  • ">
  • 5-8 years of professional experience in engineering or a related field.">
  • Proven hands-on experience with data pipeline tools such as StreamSets, Azure Data Factory, Apache Spark, Flink, and Apache Kafka.">
  • Strong expertise in database management, particularly with MongoDB, including schema design, data ingestion pipelines, and data aggregation.">
  • Proficiency in at least one programming language commonly used in data engineering, such as Python or Java/Scala.">
">

Benefits:

">

As a key member of our team, you will have the opportunity to work on challenging projects, collaborate with experienced professionals, and grow your skills and knowledge in data engineering.

">

  • Principal Pipeline Specialist

    6 days ago

    Hyderabad, Telangana, India beBeePipeline Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Pipeline Engineering ExcellenceWe seek a skilled pipeline specialist to lead the design and development of complex pipeline systems. Key responsibilities include:Developing and reviewing technical documents, such as specifications, data sheets, drawings, and reports.Evaluating pipeline designs for compliance with industry standards (e.g., ASME B31.4, B31.8,...

  • Data Pipeline Specialist

    1 week ago

    Hyderabad, Telangana, India beBeeDataPipeline Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job OverviewWe are seeking an accomplished Data Pipeline Specialist to join our team. The successful candidate will be responsible for creating and maintaining data pipelines that drive business growth.Main ResponsibilitiesCreate and implement new data pipelines to meet business needsEssential Skills and Qualifications4-6 years of experience in designing and...

  • Data Pipelines Expert

    2 weeks ago

    Hyderabad, Telangana, India beBeeDataSpecialist Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job DescriptionWe are seeking a skilled Technical Data Specialist with expertise in designing, developing, and maintaining robust and scalable data pipelines. The ideal candidate will be responsible for implementing efficient data solutions, collaborating with cross-functional teams, and ensuring high-quality data delivery.The Technical Data Specialist will...

  • Principal Data Engineer

    6 days ago

    Hyderabad, Telangana, India ixceed Full time ₹ 3,00,000 - ₹ 40,00,000 per year

    Role: Principal Data EngineerLocation: HyderabadMode: HybridType: ContractJob Description:We are seeking a Principal Data Engineer with strong enterprise-level data architecture and engineering experience, specifically within the logistics and manufacturing domains. This role is heavily focused on architecting and developing scalable data solutions using the...

  • Data Pipeline Specialist

    7 days ago

    Hyderabad, Telangana, India beBeeDataPipelineManager Full time ₹ 1,00,00,000 - ₹ 2,00,00,000

    Job Title: Data Team LeadData Pipeline ManagerWe are seeking a seasoned data pipeline manager with experience in designing and developing robust data pipelines using Azure Databricks, Data Factory, and Datalake.The role involves overseeing the development of complex ETL solutions, managing large volumes of data, and working closely with business teams to...

  • Data Pipeline Specialist

    2 days ago

    Hyderabad, Telangana, India beBeeDataEngineer Full time ₹ 8,00,000 - ₹ 12,00,000

    Data Engineer PositionWe are seeking a skilled data engineer to join our team. The ideal candidate will be responsible for designing, implementing, and optimizing data pipelines on our platform.Data Pipeline Development: Design, develop, and maintain scalable data pipelines using Azure Synapse, Databricks & Apache Spark (PySpark).Data Integration: Integrate...

  • Principal/Senior Data Engineer

    7 days ago

    Hyderabad, Telangana, India One Click AI Full time

    Role : Principal/Senior Data Engineer Product DevelopmentAbout Us :Agivant Technologies is a new-age AI-first digital and cloud engineering services company, building innovative solutions for modern enterprises.Job Description :We are looking for a Principal/Senior Data Engineer to design, develop, and maintain high-performance distributed systems and data...

  • Data Pipeline Specialist

    2 weeks ago

    Hyderabad, Telangana, India beBeeBusiness Full time ₹ 12,00,000 - ₹ 20,00,000

    Job Title: Business Intelligence ArchitectWe are seeking an experienced Business Intelligence Architect with a strong background in data engineering and a passion for designing, building, and optimizing scalable data pipelines.The ideal candidate will have hands-on experience in Snowflake, AWS Lambda, Glue, DBT, and SQL. They will be responsible for...

  • Data Pipeline Specialist

    4 days ago

    Hyderabad, Telangana, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    Data Scientist RoleThe ideal candidate will have a strong background in digital channel activities, data engineering and cloud technologies, particularly in AWS.We are seeking an experienced professional to design, build and maintain robust data pipelines for processing channel activity data, focusing on digital channels and integrating multiple sources of...

  • Principal Pipeline Systems Specialist

    1 week ago

    Hyderabad, Telangana, India beBeePipeline Full time ₹ 20,00,000 - ₹ 40,00,000

    About the RoleWe are seeking a highly skilled Pipeline Engineer to lead the design and engineering of pipeline systems, encompassing route selection, material specification, stress analysis, and hydraulics.The ideal candidate will have expertise in preparing and reviewing technical documents such as specifications, data sheets, drawings, and...