Data Pipeline Architect

11 hours ago

Mumbai, Maharashtra, India beBeeETL Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

Job Overview

The ETL Developer role encompasses the design, development, and automation of data pipelines in a cloud-based environment. Key responsibilities include crafting efficient and scalable data transformation processes, ensuring data quality and integrity, optimizing workflow performance, and implementing security measures.

Key Responsibilities:

  1. Designing and developing ETL processes to migrate and transform data from diverse sources into data warehouses or data lakes.
  2. Ensuring data quality through validation, cleansing, and monitoring ETL processes.
  3. Optimizing ETL workflows for performance, scalability, and cost efficiency.
  4. Troubleshooting and resolving issues related to data processing and ETL workflows.
  5. Implementing and maintaining security measures for data pipelines and infrastructure.

Required Skills:

  • Strong SQL skills for querying databases and manipulating data during the transformation process.
  • Programming and scripting proficiency in Python for automating tasks and interacting with AWS services via SDKs and APIs.
  • Data warehousing and modeling expertise, including understanding data warehousing concepts and schema design.
  • Familiarity with DevOps practices and CI/CD pipelines.

Desirable Experience: Previous experience working with ETL tools and technologies, as well as knowledge of big data tools and AWS services, is highly desirable.

  • Data Pipeline Architect

    2 hours ago

    Mumbai, Maharashtra, India beBeePipeline Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job Title: Data Pipeline ArchitectWe are seeking an experienced professional to design, develop and manage scalable data pipelines.Key Responsibilities:Design and Develop Pipelines: Utilize expertise in designing and developing data pipelines using Oracle Data Flow or Apache Spark (PySpark) to create efficient and reliable data solutions.Ensure Seamless...

  • Data Pipeline Architect

    1 week ago

    Mumbai, Maharashtra, India beBeeDataScience Full time ₹ 15,00,000 - ₹ 30,00,000

    We are seeking a detail-oriented and proactive professional to support the development and maintenance of data pipelines that fuel AI/ML initiatives.Key ResponsibilitiesCollaborate with cross-functional teams to translate business challenges into deployable AI solutionsImplement automated data labeling pipelines using techniques like active learning, weak...

  • Data Pipeline Architect

    2 days ago

    Mumbai, Maharashtra, India beBeeAnalysis Full time ₹ 60,00,000 - ₹ 1,50,00,000

    About the Opportunity: A strategic, results-driven Analytics & Technology Professional is required to lead the Business Intelligence (BI) and analytics function. This role demands expertise in building scalable data pipelines, delivering actionable insights, and enhancing operational efficiency in fast-paced digital environments.

  • Data Architect

    5 days ago

    Mumbai, Maharashtra, India beBeeData Full time US$ 1,20,000 - US$ 2,00,000

    Job Title: Data ArchitectWe are seeking a highly skilled and experienced Data Architect to lead our data engineering efforts. This is an excellent opportunity for someone who has a passion for building and maintaining scalable and efficient data pipelines, as well as optimizing databases for high-performance analytics.

  • Data Architect and Pipeline Specialist

    14 hours ago

    Mumbai, Maharashtra, India beBeeDataEngineer Full time ₹ 1,80,00,000 - ₹ 2,50,00,000

    Job SummaryWe are seeking a seasoned Senior Data Engineer to spearhead data engineering efforts.The successful candidate will design and develop scalable data pipelines, oversee junior data engineers, and collaborate with cross-functional teams to drive business outcomes.Key Responsibilities:Create and maintain optimal data pipeline architecture for...

  • Senior Data Pipeline Architect

    4 days ago

    Mumbai, Maharashtra, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000

    Transforming marketing data into actionable insights requires a unique blend of technical expertise and analytical thinking. As a key member of our data infrastructure team, you will design, develop, and maintain robust data pipelines, warehouses, and analytics platforms.Design and implement scalable data pipelines for marketing data ingestion and...

  • High-Quality Data Pipeline Specialist

    4 days ago

    Mumbai, Maharashtra, India beBeeDataPipeline Full time US$ 1,50,000 - US$ 2,50,000

    Job OverviewWe are seeking a highly skilled Data Architect to design and build high-quality data pipelines using cloud-based platforms.",

  • Data Architect

    1 week ago

    Mumbai, Maharashtra, India beBeeData Full time ₹ 8,00,000 - ₹ 12,00,000

    Job Title: Visionary Data ArchitectAbout the Role:We are seeking a seasoned and innovative Data Architect to spearhead our data strategy, ensuring seamless integration across various systems. As a key member of our team, you will design and implement robust data pipelines, facilitate collaboration among stakeholders, and drive business growth through...

  • Senior Data Pipeline Specialist

    4 days ago

    Mumbai, Maharashtra, India beBeeDataEngineer Full time ₹ 1,20,00,000 - ₹ 2,00,00,000

    ETL Lead with IBM DataStageDesign and develop scalable data pipelines using IBM DataStage on Cloud Pak for Data. This is a key role in our organization, requiring a seasoned ETL developer to collaborate with architects, business analysts, and data modelers.Develop and maintain ETL pipelines using IBM DataStage and AWS Glue/Lambda.Create and optimize data...

  • Data Architect

    2 days ago

    Mumbai, Maharashtra, India Weekday AI Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Job Description: Requirements:About the RoleKey ResponsibilitiesArchitect Scalable Data Solutions: Design and implement robust, secure, and scalable data architectures using Microsoft Azure, Databricks, and ADF for large-scale enterprise environments. Data Engineering Leadership: Provide technical leadership and mentoring to data engineering teams on...