Data Pipeline Architect

1 day ago

Dombivli, Maharashtra, India beBeeAzure Full time ₹ 12,00,000 - ₹ 20,10,000
Job Description

ThreatXIntel, a cybersecurity company dedicated to protecting businesses from cyber threats, is seeking an experienced Freelance Azure Data Factory (ADF) Specialist to support our data integration and ETL needs.

The ideal consultant will have strong hands-on expertise in Azure ADF pipelines, data orchestration, and transformations to ensure smooth, scalable, and secure data flows across multiple sources and destinations.

  • Data Integration: Design, build, and maintain Azure Data Factory pipelines for ETL and ELT processes.
  • Data Orchestration: Integrate data from multiple sources (on-premise, cloud, structured, and unstructured).
  • Pipeline Optimization: Optimize pipelines for performance, scalability, and cost efficiency.
  • Data Transformations: Implement data transformations, mapping, and workflow orchestration.
  • ADF Configuration: Configure triggers, parameters, and dynamic pipelines in ADF.
  • Collaboration: Collaborate with data engineers, analysts, and business stakeholders to meet data requirements.
  • Security and Compliance: Ensure security, compliance, and monitoring of pipelines using Azure best practices.
  • Documentation: Provide documentation and knowledge transfer to internal teams.
Required Skills and Qualifications

This role requires experience with Azure Data Factory (ADF), ETL/ELT processes, data integration, and pipeline design. Strong troubleshooting and optimization skills are also essential.

Benefits

As an Freelance Azure Data Factory Specialist, you will contribute to the development of robust data pipelines, ensuring seamless data integration and ETL processes. You will collaborate with cross-functional teams to deliver high-quality solutions that meet business needs.

  • Highly Skilled Data Pipeline Architect

    2 days ago

    Dombivli, Maharashtra, India beBeeDataEngineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    About Foodsmart:We are a leading provider of personalized nutrition and foodcare solutions.Our platform is designed to foster healthier eating habits, drive lasting behavior change, and deliver long-term health outcomes.We serve 2.2 million members on a tailored journey to eating well while saving time and money.We partner with national and regional...

  • Cloud Data Architect – Design and Build Scalable Data Pipelines

    8 minutes ago

    Dombivli, Maharashtra, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job OpportunityWe are seeking a seasoned Data Engineer to architect, deploy and maintain scalable data pipelines using cloud-based technologies like GCP, AWS or Azure.This is an exciting chance to work on cutting-edge data infrastructure with real-world impact, ensuring data reliability, quality and availability to support business needs.Design, develop and...

  • Data Pipeline Architect

    1 day ago

    Dombivli, Maharashtra, India beBeePython Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Senior Python EngineerWe are seeking a seasoned Senior Python Engineer to lead our engineering group. As a key member of the team, you will be responsible for designing and developing scalable data pipelines using Python and Pandas.You will work closely with Data Scientists, Analysts, and Engineering teams to support data-driven applications and reporting...

  • Expert Data Pipeline Specialist

    2 days ago

    Dombivli, Maharashtra, India beBeeData Full time ₹ 9,00,000 - ₹ 15,00,000

    Job OverviewWe are seeking a skilled Data Engineer to design, develop and maintain large-scale data pipelines that can handle structured and unstructured data.This role involves key responsibilities such as implementing data pipelines, building ETL/ELT workflows and ensuring data quality across all pipelines.

  • Data Pipeline Specialist

    4 days ago

    Dombivli, Maharashtra, India beBeeTalend Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Title: Talend ETL DeveloperWe are seeking a qualified professional to take on the role of a Talend ETL Developer with expertise in Talend Open Studio for an immediate contractual position.Below are the key responsibilities and requirements for this job:Key Responsibilities:- Design and optimize complex ETL pipelines using Talend Data Integration- Debug...

  • Data Architect Lead

    2 days ago

    Dombivli, Maharashtra, India beBeeDataArchitect Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Opportunity: Data Architect LeadKey Responsibilities:Design and implement scalable data architectures following best practices.Develop and optimize ETL/ELT pipelines using Azure services.Perform data ingestion, transformation, and orchestration across structured and unstructured datasets.Develop and maintain data lake solutions in Azure Data Lake Storage...

  • Data Solutions Architect

    7 days ago

    Dombivli, Maharashtra, India beBeeDatabricks Full time ₹ 18,00,000 - ₹ 25,00,000

    Job OverviewWe are seeking an experienced data architect to lead the design, development and implementation of scalable, secure and high-performance data solutions. The ideal candidate will have 7+ years of experience in data engineering, a strong background in Databricks (including Databricks SQL, Delta Lake, and MLflow), and proficiency in PySpark, Spark...

  • Data Architect Specialist

    3 days ago

    Dombivli, Maharashtra, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Title: Data Architect SpecialistThis role involves the design, development and maintenance of data pipelines for efficient data ingestion, processing and storage. The ideal candidate will be proactive in designing scalable data architectures and data models to ensure high availability and performance.Required Skills:Expertise in Data Integration and...

  • Data Pipeline Specialist – Cloud Engineering

    1 day ago

    Dombivli, Maharashtra, India beBeeDataEngineer Full time US$ 1,00,000 - US$ 1,50,000

    Freelance Data Engineer OpportunityJoin a collaborative environment where you can utilize your expertise in designing and optimizing large-scale data pipelines.Role OverviewAs an experienced Freelance Data Engineer, you will work closely with internal teams to design, build, and maintain ETL/ELT pipelines using PySpark, AWS, and Databricks. The ideal...

  • Senior Data Pipeline Specialist

    3 days ago

    Dombivli, Maharashtra, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 25,00,000

    Data Engineering RoleJob OverviewThis is a key role within our organization, focusing on designing and developing data pipelines to ingest data from various sources into our data warehouse. The ideal candidate will have experience with AWS services such as Lambda, DMS, and Glue for data ingestion and transformation processes.Key ResponsibilitiesDesign and...