Expert in Data Pipeline Development

1 week ago

Vijayawada, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000
Job Opportunity

We are seeking a highly skilled Data Engineer with a strong background in computer science and experience working with data pipelines, cloud data warehousing platforms, and distributed frameworks.

Key Responsibilities:
  • Design and Develop Robust Data Pipelines
  • Maintain existing data pipelines and ensure they meet the required performance standards.
  • Work closely with data scientists to build machine learning models by providing them with well-maintained and scalable data pipelines.
  • Develop and maintain tools and libraries used by multiple teams across the organization.
Requirements:
  • Bachelor's or master's degree in Computer Science, Data Science, Engineering, or a related field.
  • 3+ years of experience in working with Python, SQL, PySpark, and bash scripts.
  • Experience in developing and maintaining robust data pipelines for both structured and unstructured data.
  • 2+ years of hands-on experience in using Databricks platform for data engineering.
  • Detailed knowledge of Delta Lake, Databricks Workflow, Job Clusters, Databricks CLI, Databricks Workspace, etc.
Preferred Skills:
  • Solid understanding of machine learning life cycle, data mining, and ETL techniques.
  • Familiarity with commonly used machine learning libraries (like scikit-learn, xgboost) in terms of exposure and handling of code base which makes use of these libraries for model training & scoring.
  • Proficiency in understanding of REST APIs and experience in using different types of APIs to either extract data or perform a functionality exposed by APIs.
  • Hands-on experience in building and maintaining tools and libraries which have been used by multiple teams across organization.

  • Key Data Pipelines Developer

    2 weeks ago

    Vijayawada, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 14,40,000 - ₹ 23,15,000

    Data Engineering Expertise RequiredWe are seeking a skilled Data Engineer to join our team. This individual will play a pivotal role in designing, developing, and maintaining data pipelines.

  • Data Pipeline Architect

    2 weeks ago

    Vijayawada, Andhra Pradesh, India beBeeData Full time US$ 1,50,000 - US$ 2,00,000

    Job Title: Data Platform Specialist">Data Platform SpecialistWe are seeking an experienced Data Platform Specialist to join our team. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining data pipelines to extract, transform, and load (ETL) data from various sources into our data warehouse or data...

  • Data Science Expert

    2 weeks ago

    Vijayawada, Andhra Pradesh, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Data Science ExpertJob Opportunity:We seek an experienced Data Science Expert to contribute to the development of advanced data solutions. As a critical member of our team, you will be responsible for designing and implementing cutting-edge data pipelines and working on modern cloud platforms.Main Responsibilities:Create high-quality data pipelines using...

  • Data Pipeline Specialist

    1 week ago

    Vijayawada, Andhra Pradesh, India beBeeBackend Full time ₹ 15,00,000 - ₹ 25,00,000

    We are seeking an experienced Backend Data and Integration Engineer to build data pipelines and connect external systems and interfaces. The ideal candidate will have a strong background in backend development, data engineering, and cloud computing, with experience in Azure services such as Functions, Container Apps, and Storage. Key...

  • Data Scientist/ML Engineer

    3 weeks ago

    Vijayawada, Andhra Pradesh, India Quant-data Full time

    We're Hiring: Machine Learning Engineer / Data Engineer (Remote | Full-Time) Build AI-powered credit decisioning systems on Microsoft AzureWe're looking for a Machine Learning Engineer / Data Engineer with 5+ years of experience to join our AI-driven credit lending platform team. In this role, you'll design and deploy scalable ML solutions that power loan...

  • Senior Cloud Data Expert

    1 week ago

    Vijayawada, Andhra Pradesh, India beBeeData Full time ₹ 1,00,00,000 - ₹ 1,75,00,000

    Snowflake Data ArchitectWe are seeking a highly skilled data expert with hands-on experience in Snowflake and proven expertise in the BFSI domain.The ideal candidate will design, develop, and optimize scalable data pipelines, data models, and analytics solutions on Snowflake, ensuring compliance, security, and performance to meet regulatory and business...

  • Senior ETL Data Pipeline Specialist

    2 weeks ago

    Vijayawada, Andhra Pradesh, India beBeeDatastage Full time ₹ 20,00,000 - ₹ 30,00,000

    Datastage Developer Job DescriptionThe role of a Datastage Developer is to design, develop, and implement ETL data pipelines using IBM Datastage. This position requires strong technical skills in SQL, UNIX, and Datastage.As a Datastage Developer, you will work on designing complex business requirements and creating new Datastage Jobs to solve them. You will...

  • Expert Data Solution Developer

    2 weeks ago

    Vijayawada, Andhra Pradesh, India beBeeDataEngineer Full time US$ 1,50,000 - US$ 2,00,000

    Job TitleAbout UsWe are a global leader in providing premium data services for the evolving AI ecosystem. From machine learning to computer vision and GenAI, we empower the next generation of AI-powered experiences with high-quality data and human intelligence.Key Responsibilities:Develop scalable cloud-based data solutions using Python and PySpark.Own...

  • High-Level Data Pipeline Architect

    2 weeks ago

    Vijayawada, Andhra Pradesh, India beBeeBackend Full time ₹ 20,00,000 - ₹ 25,00,000

    Role OverviewThis is a critical role that involves building and maintaining data extractors to convert on-chain events into structured trade data.Owning the development of event decoders for major DeFi protocols.Building data extractors that convert on-chain events into structured trade data.Implementing logic to calculate trade prices, including handling...

  • Data Science Expert

    2 weeks ago

    Vijayawada, Andhra Pradesh, India beBeeDataScience Full time ₹ 25,00,000 - ₹ 35,00,000

    Job Title: Data Science ExpertWe are looking for a skilled Data Science Expert to join our team. As a key member of the organization, you will be responsible for developing and deploying advanced AI/ML models to power mortgage automation agents.Key Responsibilities:Design and implement data-driven solutions to improve business outcomes.Develop and deploy...