Building Scalable Data Pipelines

2 weeks ago

Solapur, Maharashtra, India beBeeDataMigration Full time ₹ 8,00,000 - ₹ 15,00,000

Job Title: Data Migration Specialist

About the Project

This role is critical for ensuring a smooth transition of a Fortune 500 client's large-scale database migration initiative. The project involves transitioning from Fivetran to Nexla, with Snowflake as the target data platform.

The successful candidate will have hands-on experience with data migration and exposure to diverse database systems.

  • Migrate ETL pipelines and plugins from Fivetran into Nexla/Snowflake.
  • Build automation for ingestion, transformation, and observability.
  • Deliver under tight deadlines in a fast-paced environment.

This is a technical contributor role—ideal for someone who thrives on execution rather than high-level architecture.

Key Responsibilities
  • Execute migrations from Fivetran and other legacy connectors into Snowflake/Nexla.
  • Design and maintain ETL pipelines using Python, PySpark, DBT, and related tools.
  • Build and optimize API-based integrations (authentication, pagination, automation).
  • Ensure data quality, consistency, and monitoring across pipelines.
  • Contribute to prioritization and phased delivery of ~1,500+ plugins.
Requirements
  • 3–6 years in data engineering or ETL development, with hands-on migration work.
  • Strong knowledge of Snowflake (data ingestion, transformation, optimization).
  • Proficiency in Python for scripting and automation.
  • Experience with PySpark, DBT, and API-driven data integrations.
  • Familiarity with AWS/cloud-hosted data solutions and observability.
  • Solid track record in ETL → Data Engineering transition.
Benefits

This role offers the opportunity to work on a high-visibility project with a Fortune 500 client. The successful candidate will be part of a dynamic team and have the chance to develop their skills and expertise in data migration and engineering.

Nice to Have
  • Prior experience with large-scale plugin migrations.
  • Familiarity with Fivetran, Nexla, or similar aggregation platforms.
  • Ability to balance scripting-level problem-solving with broader data engineering.
  • Comfort working in time-sensitive, high-stakes environments.

  • Building Scalable Solutions as a Data Engineer

    2 weeks ago

    Solapur, Maharashtra, India beBeeDataEngineering Full time ₹ 90,00,000 - ₹ 1,20,00,000

    Job Opportunity: Data Engineering SpecialistWe are seeking a skilled and innovative Data Engineering Specialist to play a critical role in shaping our technology vision, architecture, and engineering culture.This position is ideal for someone who thrives on early-stage challenges and loves building scalable solutions from day zero.Responsibilities:Web...

  • Senior Data Pipeline Specialist

    2 weeks ago

    Solapur, Maharashtra, India beBeedataengineer Full time ₹ 15,00,000 - ₹ 25,00,000

    About the RoleWe are seeking a skilled Data Pipeline Engineer to build scalable and efficient data pipelines.You will work on creating robust data systems using IBM DataStage, AWS Glue, and Snowflake.

  • Data Pipeline Specialist

    2 weeks ago

    Solapur, Maharashtra, India beBeeDataEngineering Full time ₹ 25,00,000 - ₹ 35,00,000

    Data Engineer RoleAs a Data Engineer, you will be responsible for designing, building, and maintaining robust data pipelines that power our Agentic AI solutions on AWS.The role focuses on developing efficient ETL/ELT workflows, ensuring data quality, security, and scalability to support AI/ML model training, inference, and intelligent decision-making...

  • Senior Data Pipeline Developer

    2 weeks ago

    Solapur, Maharashtra, India beBeeDataPipelineDeveloper Full time ₹ 15,00,000 - ₹ 25,00,000

    We are seeking a highly skilled Data Pipeline Developer to design, develop and maintain scalable ETL pipelines using Azure services.The ideal candidate will have extensive experience with cloud-based analytics, data engineering and a strong background in data warehousing. They will be responsible for designing, developing and maintaining efficient data...

  • Building Scalable Data Solutions Expert

    1 week ago

    Solapur, Maharashtra, India beBeeDataEngineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    End-to-End Data Solutions EngineerWe are seeking an experienced professional to design, build and optimize end-to-end data solutions using Microsoft's data platforms.Key Responsibilities:Design contemporary data architecture patterns for real-time, batch and BYOD processingCreate robust data pipelines in Power BIRequirements:5-7 years of experience in data...

  • Data Engineer for Scalable Data Solutions

    2 weeks ago

    Solapur, Maharashtra, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    About People Prime Worldwide:We are a technology-driven organization committed to unleashing human energy through technology for an inclusive and sustainable future. We help organizations accelerate their transition to a digital and sustainable world by providing a wide range of services, including consulting, technology, professional, and outsourcing...

  • Senior Data Engineer

    2 weeks ago

    Solapur, Maharashtra, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    We're looking for a seasoned data engineer to create and maintain large-scale, high-performance data pipelines on the AWS platform.Key Responsibilities:Develop and optimize robust ETL/ELT processes using Spark, PySpark, SQL, and PythonCollaborate with AWS services like Glue, EMR, S3, Lambda, and Redshift to build scalable data architecturesEnsure data...

  • GCP Data Pipeline Specialist

    2 weeks ago

    Solapur, Maharashtra, India beBeeDataEngineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Senior GCP Data Engineer PositionWe're looking for a seasoned data professional with extensive experience in designing, developing, and maintaining scalable data pipelines on the Google Cloud Platform. The ideal candidate will have a deep understanding of GCP services, including Big Query, Cloud Dataflow (Apache Beam), Cloud Run, Cloud Functions, Pub/Sub,...

  • Principal Data Pipeline Specialist

    2 weeks ago

    Solapur, Maharashtra, India beBeeDataEngineer Full time ₹ 12,00,000 - ₹ 20,10,000

    Data Engineer Position OverviewWe are seeking a highly skilled and experienced Data Engineer to join our team. In this role, you will have the opportunity to work on complex data engineering projects using Databricks.Key Responsibilities:Design, develop, and deploy scalable data pipelines and ETL processes in Databricks.Collaborate with stakeholders to...

  • Senior Data Pipeline Specialist

    2 weeks ago

    Solapur, Maharashtra, India beBeeBigData Full time ₹ 20,00,000 - ₹ 25,00,000

    Job OpportunityWe are seeking an experienced Big Data Solutions Architect to join our team. As a key member of our data engineering team, you will design, develop, and optimize large-scale data pipelines and distributed data processing systems.The ideal candidate will have a strong background in Scala, Spark (PySpark), and Python, as well as hands-on...