Data Pipelines Expert

19 hours ago

Mumbai, Maharashtra, India beBeePipeline Full time ₹ 15,00,000 - ₹ 28,00,000
Job Title: Data Pipeline Specialist

We are seeking a highly skilled and experienced professional to join our team as a Data Pipeline Specialist. In this role, you will be responsible for designing, developing, and maintaining large-scale data pipelines that enable us to extract insights from complex datasets.

Required Skills:

  • Proficiency in cloud-based technologies, particularly Amazon Web Services (AWS), including services such as S3, EC2, and SageMaker.
  • Experience with Infrastructure as Code (IaC) tools like Terraform or CloudFormation.
  • Strong understanding of distributed systems and parallel computing concepts for efficient ML pipeline execution.

Soft Skills:

  • Excellent problem-solving and analytical skills, with the ability to break down complex problems into manageable tasks.
  • Effective communication and collaboration abilities, with experience working in cross-functional teams.
  • Adaptability to fast-paced environments and a willingness to continuously learn and improve processes.

Educational Qualifications:

  • Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
  • Certifications in Azure, AWS, or Kubernetes can be advantageous but are not mandatory.

Benefits:

  • Competitive salary and benefits package.
  • Opportunities for professional growth and development.
  • A dynamic and collaborative work environment.

Others:

  • Background checks and reference verification will be conducted prior to employment.
  • Relocation assistance may be available for qualified candidates.

  • Data Pipeline Specialist

    4 days ago

    Mumbai, Maharashtra, India beBeeSpark Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Big Data Expert Wanted We are seeking a skilled Big Data expert to join our team. As a Big Data Engineer, you will design and develop scalable data pipelines using Apache Spark and Scala. Responsibilities :Design and develop scalable data pipelines using Apache Spark and Scala.Optimize and troubleshoot Spark jobs for performance (e.g. memory management,...

  • Leading Data Pipeline Expert

    4 days ago

    Mumbai, Maharashtra, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Cloud Data EngineerWe are seeking a seasoned Cloud Data Engineer with expertise in designing, building and maintaining large-scale data pipelines. The ideal candidate has experience with AWS cloud services such as S3, EC2, RDS, DynamoDB, Athena and Redshift.Design, build and maintain production-level data pipelines that handle terabytes of structured and...

  • Data Pipeline Architect

    2 days ago

    Mumbai, Maharashtra, India beBeePipeline Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job Title: Data Pipeline ArchitectWe are seeking an experienced professional to design, develop and manage scalable data pipelines.Key Responsibilities:Design and Develop Pipelines: Utilize expertise in designing and developing data pipelines using Oracle Data Flow or Apache Spark (PySpark) to create efficient and reliable data solutions.Ensure Seamless...

  • Lead Data Pipeline Specialist

    4 days ago

    Mumbai, Maharashtra, India beBeeData Full time ₹ 1,20,00,000 - ₹ 2,40,00,000

    Senior Data EngineerWe are seeking a Senior Data Engineer to join our team. As a member of this team, you will be responsible for building data pipelines to ingest various source data from enterprise technologies and PitchBook Platform data.You will work with a range of data and reporting technologies (e.g. Python, Docker, Tableau, Power BI) to build upon a...

  • Data Pipeline Architect

    2 days ago

    Mumbai, Maharashtra, India beBeeETL Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job OverviewThe ETL Developer role encompasses the design, development, and automation of data pipelines in a cloud-based environment. Key responsibilities include crafting efficient and scalable data transformation processes, ensuring data quality and integrity, optimizing workflow performance, and implementing security measures.Key...

  • Data Pipeline Architect

    2 weeks ago

    Mumbai, Maharashtra, India beBeeDataScience Full time ₹ 15,00,000 - ₹ 30,00,000

    We are seeking a detail-oriented and proactive professional to support the development and maintenance of data pipelines that fuel AI/ML initiatives.Key ResponsibilitiesCollaborate with cross-functional teams to translate business challenges into deployable AI solutionsImplement automated data labeling pipelines using techniques like active learning, weak...

  • Data Pipeline Specialist

    1 week ago

    Mumbai, Maharashtra, India beBeeDataEngineer Full time US$ 1,00,000 - US$ 1,50,000

    Data Engineer OpportunityWe are seeking a skilled Data Engineer to design and develop scalable data pipelines.This role involves working with streaming data, collaborating with data scientists, and delivering high-quality solutions.

  • Data Engineering Expert

    5 days ago

    Mumbai, Maharashtra, India beBeeDataEngineering Full time ₹ 1,04,000 - ₹ 1,30,878

    Job Title: Data Engineering ExpertWe are seeking an experienced Data Engineering Expert to join our team. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining large-scale data systems.Your primary focus will be on creating efficient data pipelines that move data from various sources to storage and...

  • Expert Data Engineer

    5 days ago

    Mumbai, Maharashtra, India beBeeDataEngineer Full time ₹ 18,08,000 - ₹ 30,52,000

    Job Title: Data EngineerJob Description:We are seeking a highly skilled and accomplished Data Engineer to fill this key role. The successful candidate will have a proven track record in designing, developing, and maintaining complex data pipelines using PySpark.The ideal candidate will work closely with cross-functional teams to identify business...

  • Data Pipeline Migration Specialist

    6 days ago

    Mumbai, Maharashtra, India beBeeDataGovernance Full time ₹ 1,75,00,000 - ₹ 2,50,00,000

    Technical Leadership OpportunityThis is a senior-level position that oversees the technical aspects of implementing data pipeline migration requirements, ensuring our platform is used to its full potential through designing and building applications around business stakeholder needs.Main ResponsibilitiesCollaborate directly with stakeholders to gather...