Data Pipeline Specialist

5 days ago

Bengaluru, Karnataka, India beBeeBackend Full time ₹ 15,00,000 - ₹ 25,00,000

Job Role: MLOps Engineer

With over 7 years of experience in the field, you will develop and maintain scalable machine learning pipelines.

Key Responsibilities:
  • Develop Efficient Pipelines: Create and maintain efficient machine learning pipelines using Python and frameworks like Tornado and FastAPI.
  • Build and Manage Applications: Utilize Python and popular frameworks to build, deploy, and manage backend applications.
  • Work with RDBMS Models: Collaborate with cloud environments for data storage and retrieval using RDBMS models.
  • Design RESTful APIs: Implement token-based authentication and compression techniques while designing and implementing RESTful APIs.
  • Collaborate with Cross-Functional Teams: Work closely with Agile teams to deliver high-quality solutions.
  • Troubleshoot Issues: Identify and resolve issues, optimize performance, and ensure robust version control using Git/Bitbucket.

Required Skills:

  • 5+ years of backend application development experience with Python.
  • Strong knowledge of RDBMS and cloud database models.
  • Hands-on experience with Python Tornado and FastAPI frameworks.
  • In-depth understanding of RESTful APIs, token authentication, and compression techniques.
  • Experience with version control and issue tracking tools: Bitbucket, Git CLI, Jira.
  • Excellent problem-solving skills and ability to work collaboratively in a team.

  • Data Pipeline Specialist

    1 week ago

    Bengaluru, Karnataka, India beBeeDataPipeline Full time ₹ 12,00,000 - ₹ 25,00,000

    Job Opportunity: Data Pipeline SpecialistWe are seeking a skilled data pipeline expert to validate and optimize our data transformations.ETL testing methodologies and best practicesDebugging data issues and resolving discrepanciesWorking with large datasets in cloud environmentsThe ideal candidate should have hands-on experience in Databricks, Python, SQL,...

  • Data Pipeline Specialist

    2 weeks ago

    Bengaluru, Karnataka, India beBeeDataPipeline Full time

    Job Title: Data Pipeline SpecialistA leading IT consulting and software solutions provider is seeking a highly skilled professional to design, build, and maintain scalable and reliable data pipelines.This role involves developing ETL processes to ensure data quality, integrity, and consistency. The ideal candidate will collaborate with analysts, scientists,...

  • Data Pipeline Specialist

    7 days ago

    Bengaluru, Karnataka, India beBeeData Full time ₹ 15,00,000 - ₹ 28,00,000

    Job Title : Data Pipeline SpecialistKey Responsibilities :Develop and manage scalable data pipelines using PySpark and SQL to drive business growth.Collaborate with cross-functional teams to implement data-driven solutions leveraging AWS services.Utilize Databricks for advanced data processing and analytics, working closely with data scientists and analysts...

  • Senior Data Pipeline Specialist

    2 weeks ago

    Bengaluru, Karnataka, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    We are seeking a highly skilled Senior Data Pipeline Specialist to join our team.As a Senior Data Pipeline Specialist, you will be responsible for designing and developing real-time and batch data pipelines using tools like Apache NiFi, Apache Kafka, and Apache Airflow.Design and develop scalable data pipelines that meet the needs of various business...

  • Senior Data Pipeline Specialist

    1 week ago

    Bengaluru, Karnataka, India beBeeDataPipelineSpecialist Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    We are seeking an experienced Senior Data Pipeline Specialist to lead the development and maintenance of complex data pipelines and enterprise-grade data systems.Job DescriptionThe ideal candidate will have 6-15 years of experience in ETL testing, software development, and data engineering. They must be proficient in Python, SQL, DWH, CI/CD, AWS, Automation,...

  • Data Pipeline Specialist

    2 weeks ago

    Bengaluru, Karnataka, India beBeeBackend Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Backend Developer Job DescriptionWe are seeking a skilled Backend Developer to join our team. The ideal candidate will have a strong background in developing scalable data collection pipelines and implementing automated web data extraction solutions.The successful candidate will be responsible for designing, developing, and maintaining large-scale data...

  • Data Pipeline Engineer

    5 days ago

    Bengaluru, Karnataka, India beBeeData Full time ₹ 22 - ₹ 28

    Job OpportunityWe are seeking a skilled professional to fill the role of Big Data Specialist. This position requires expertise in designing, developing, and maintaining large-scale data pipelines using AWS services such as Glue, Lambda, and DMS.The ideal candidate will have hands-on experience with Apache Spark (Py Spark) for processing and transforming big...

  • Data Pipelines Specialist

    1 week ago

    Bengaluru, Karnataka, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 25,00,000

    About Our Data Engineering PositionAt our company, we are seeking an experienced data engineer to join our team. The ideal candidate will have a strong background in building scalable data pipelines and working on modern cloud & big data platforms.Key Responsibilities:Design, develop, and maintain large-scale data systems using Python, PySpark, and SQL.Work...

  • Data Pipelines Specialist

    6 days ago

    Bengaluru, Karnataka, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000

    Job DescriptionWe are seeking an experienced Data Engineer to join our team. The ideal candidate will have a strong focus on designing, developing, and maintaining scalable and reliable data pipelines using PySpark.This role involves leveraging the Databricks Lakehouse Platform and its advanced AI/ML features to unlock data-driven insights and power our...

  • Data Pipeline Specialist

    2 weeks ago

    Bengaluru, Karnataka, India beBeedata Full time ₹ 10,00,000 - ₹ 15,00,000

    Job Opportunity    Description:A Data Engineer Associate/Jr Data Engineer position is available in our organization. The jobholder will be responsible for designing, building and managing scalable data pipelines to support business needs. They will also perform complex data transformations using SQL and Spark, conduct performance tuning to improve the...