Data Pipelines Engineer

2 weeks ago

Varanasi, Uttar Pradesh, India beBeeSoftware Full time ₹ 90,00,000 - ₹ 1,50,00,000
Job Description">

Overview:

We are seeking a skilled Python Developer to join our team. This full-time position will involve building automated data pipelines, implementing analytical algorithms, and developing REST APIs.

Key Responsibilities:

  • Design and implement automated data pipelines using Google Cloud Platform.
  • Develop analytical algorithms to drive business insights.
  • Build REST APIs to facilitate data exchange between systems.
  • Work with SQL databases and Neo4j graph databases to store and retrieve data.
  • Create LLM-driven analytics engines to enhance decision-making capabilities.

Required Skills and Qualifications:

  • 1-3 years of experience in Python development.
  • Proficiency in data processing libraries (Pandas, NumPy).
  • Experience with API development (FastAPI, Flask, or Django REST).
  • Familiarity with Google Cloud Platform (BigQuery, Cloud Storage, Vertex AI).
  • Strong knowledge of SQL and database design.
  • Proficiency in Git version control.

Preferred Qualifications:

  • LLM integration experience (OpenAI API, Vertex AI).
  • Graph database experience (Neo4j).
  • Experience with data visualization tools.
  • Understanding of ML concepts and time series analysis.

Technical Environment:

  • Languages: Python, SQL.
  • Cloud: AWS OR Google Cloud Platform.
  • Databases: PostgreSQL/MySQL, Neo4j, BigQuery.
  • Tools: Git, Docker, PowerBI.

Requirements:

  • Bachelor's degree in Computer Science, Engineering, or related field.
  • Strong problem-solving skills.
  • Ability to work in a fast-paced startup environment.

  • Expert Data Pipeline Architect

    1 week ago

    Varanasi, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    Data Engineering ExpertiseWe are seeking a highly skilled Data Engineer to join our team. As a key member of our data engineering group, you will play a vital role in designing and building scalable data pipelines and architectures.This position offers the chance to work closely with talented teams, solve real-world data challenges, and make a direct impact...

  • Senior Data Pipeline Specialist

    2 weeks ago

    Varanasi, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 90,00,000 - ₹ 1,80,00,000

    Data Engineering ProfessionalWe are seeking a highly skilled Data Engineer to join our team. The ideal candidate will have expertise in building, deploying, and managing data pipelines using Python and PySpark.

  • Senior Data Pipeline Specialist

    1 week ago

    Varanasi, Uttar Pradesh, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Unlock the full potential of your data career with this exciting opportunity.Job DescriptionWe are seeking a skilled Data Engineer to join our organization. As a key member of our team, you will be responsible for designing, developing, and maintaining large-scale data pipelines and systems.Key Responsibilities:Designing and implementing scalable data...

  • Senior Cloud Data Pipeline Specialist

    2 weeks ago

    Varanasi, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000

    Cloud Data EngineerWe are seeking a skilled cloud data engineer to design, build and maintain scalable data pipelines and ETL solutions. The ideal candidate will have hands-on experience with AWS services, PySpark, Airflow and Python.Key Responsibilities:Design and develop scalable data pipelines using AWS services.Collaborate closely with data analysts,...

  • Data Pipeline Architect

    2 weeks ago

    Varanasi, Uttar Pradesh, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Title:Data Pipeline ArchitectCreate and implement scalable, event-driven data pipelines that support real-time clinical workflows.Design and integrate systems with EHR/EMR platforms (e.g., Epic) using FHIR and HL7 standards.Develop high-quality systems to ingest, track, and update clinical events in real-timeEnsure downstream analytics systems receive...

  • Expert Data Pipeline Developer

    2 weeks ago

    Varanasi, Uttar Pradesh, India beBeeDataEngineer Full time US$ 90,000 - US$ 1,20,000

    Job Title: Data EngineerWe are looking for a highly skilled Data Engineer to join our team. The successful candidate will have expertise in the Google Cloud stack and be able to work with BigQuery, SQL, and Python to design, build, test, and deploy large-scale data processing systems.Responsibilities:Design and develop scalable data pipelines using tools...

  • Data Engineering Expert

    2 weeks ago

    Varanasi, Uttar Pradesh, India beBeeDataEngineering Full time ₹ 1,01,40,000 - ₹ 1,41,20,000

    Transform Your Career with Data EngineeringLeverage your technical expertise to propel the growth of our organization by architecting scalable data pipelines and robust frameworks for generating reports.Design and develop efficient Spark-based data processing pipelines to transform high-volume datasets.Utilize Snowflake SQL to perform complex aggregations on...

  • Advanced Data Pipelining Specialist

    2 weeks ago

    Varanasi, Uttar Pradesh, India beBeeDeveloper Full time ₹ 14,00,000 - ₹ 17,00,000

    Senior Data DeveloperAre you looking for a challenging opportunity to work with complex data pipelines and scalable architectures?This role is perfect for an experienced ETL developer who can design, develop, and maintain efficient, high-quality data integration solutions.Design and implement robust, scalable ETL processes using industry-leading tools and...

  • Data Engineering Specialist

    2 weeks ago

    Varanasi, Uttar Pradesh, India beBeeEngineering Full time ₹ 15,00,000 - ₹ 25,00,000

    Job OverviewWe are seeking a skilled Data Engineering Specialist to lead our analytics team. This role is ideal for someone with a strong background in data handling, cross-platform engineering, and business intelligence.Key Responsibilities:Lead and mentor a team of analysts, ensuring quality delivery and technical upskilling.Design, develop, and maintain...

  • Career Opportunities as a Data Engineer

    6 days ago

    Varanasi, Uttar Pradesh, India beBeeDataEngineer Full time US$ 1,00,000 - US$ 1,40,000

    Unlock Career Opportunities as a Data EngineerJob OverviewWe are seeking an experienced Data Engineer to join our team and drive data-driven decision making.About the RoleData Modeling and Engineering: Design, build, and maintain scalable and reusable data models using tools like dbt (Data Build Tool).Data Ingestion and Transformation: Collaborate with data...