Data Pipeline Specialist

2 days ago

Anand, Gujarat, India beBeedataengineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000
Senior Software Engineer

Job Description:

  • Develop and optimize data pipelines using Azure Data Factory, Databricks, and Synapse Analytics.
  • Design scalable data architectures following best practices.
  • Perform data ingestion, transformation, and orchestration across structured and unstructured datasets.

Key Responsibilities:

  1. Develop and maintain data lake solutions in Azure Data Lake Storage Gen2.
  2. Write and optimize SQL queries for data extraction, transformation, and analysis.
  3. Implement CI/CD pipelines for data workflows using Azure DevOps.
  4. Collaborate with stakeholders to understand data requirements.
  5. Maintain data governance, security, and compliance in Azure-based data solutions.

Mandatory Skills and Qualifications:

  • Azure Data Engineering expertise with Data Factory, Synapse, Fabric, Databricks.
  • Expertise in SQL, T-SQL, and Python for data processing.
  • Hands-on experience with PySpark for big data processing.
  • Experience in designing ETL/ELT pipelines and working with large datasets.
  • Proficiency with Azure Data Lake Gen2 for data storage.

About Us:

We are a global technology company with a wide range of technological prowess and industry-leading platforms.

We believe in empowering our people to perform and grow by offering opportunities, learning, and inspiration. If you are a self-starter looking for an open and collaborative work culture to excel in career, we are the place for you.

  • Data Pipeline Specialist

    18 hours ago

    Anand, Gujarat, India beBeeDataQuality Full time ₹ 18,00,000 - ₹ 23,00,000

    About Data Quality EngineersWe are looking for skilled professionals to join our team of Data Quality Engineers.Data Quality Engineers play a vital role in ensuring the accuracy and reliability of our clients' data pipelines.Key Responsibilities:Develop and execute automated tests to identify and resolve data quality issues.Requirements:Hands-on experience...

  • Senior Data Pipeline Specialist

    4 days ago

    Anand, Gujarat, India beBeeDataEngineer Full time ₹ 1,80,00,000 - ₹ 2,40,00,000

    Job Opportunity: We are seeking a highly skilled Azure Databricks Engineer for a short-term contract position.The ideal candidate will have hands-on experience with designing and developing data pipelines using Azure Data Factory, Databricks notebooks with SQL & Python, and file formats such as Parquet, Delta, and CSV. A professional with 7+ years of...

  • Data Architect Specialist

    21 hours ago

    Anand, Gujarat, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    Data Architect SpecialistWe are seeking a highly skilled Data Architect Specialist to design, build, and optimize scalable data pipelines using Snowflake, AWS (Lambda, Glue), DBT, and SQL.

  • Chief Data Pipeline Architect

    1 day ago

    Anand, Gujarat, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    Job TitleData Engineer LeaderWe are seeking a skilled data engineer leader to design, develop, and maintain data pipelines and ETL processes on Databricks.Key Responsibilities:Design, develop, and maintain data pipelines and ETL processes on Databricks.Lead the architecture and implementation of scalable, secure, and high-performance data...

  • Expert Cloud Data Pipeline Architect

    2 days ago

    Anand, Gujarat, India beBeeDataEngineering Full time ₹ 7,20,000 - ₹ 14,40,000

    Cloud Data Engineering SpecialistWe are seeking a highly skilled Cloud Data Engineer to join our team. The ideal candidate will have extensive experience in designing, building, and maintaining large-scale data pipelines on the cloud platform.Bachelor's degree in Computer Science, Information Technology, or a related field is required. Master's degree is...

  • Chief Data Pipeline Architect

    3 days ago

    Anand, Gujarat, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 20,10,000

    Data Engineer Role Summary"> \We are seeking a Data Engineer to design, build and maintain scalable data pipelines for data ingestion, processing and storage.\

  • Data Pipeline Architect

    2 days ago

    Anand, Gujarat, India beBeeMachineLearning Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title: ML Ops EngineerAs a seasoned professional, you will be responsible for designing, developing, and deploying scalable and efficient machine learning pipelines using popular frameworks such as TensorFlow, PyTorch, and Scikit-learn.Develop and implement monitoring and logging systems to ensure seamless operation of ML models, utilizing tools like...

  • Data Engineering Specialist

    6 days ago

    Anand, Gujarat, India beBeeEngineering Full time ₹ 18,00,000 - ₹ 24,00,000

    The primary function of a Data Engineering Specialist involves designing and implementing efficient data pipelines using industry-standard tools.Key Responsibilities include:Designing, developing, and maintaining ETL processes for ingestion from various sourcesCreating optimized data flows for loading curated datasets into cloud-based data...

  • Data Engineering Specialist

    16 hours ago

    Anand, Gujarat, India beBeeData Full time ₹ 18,00,000 - ₹ 25,00,000

    Job Title: Data Engineering SpecialistAbout the Role:This position involves designing data pipelines using AWS Glue, PySpark, and Step Functions. The ideal candidate should have a solid understanding of data engineering principles and be able to implement ETL/ELT processes for ingesting, transforming, and delivering data from multiple sources.Key...

  • Freelance Big Data Specialist

    21 hours ago

    Anand, Gujarat, India beBeeDataEngineer Full time ₹ 90,00,000 - ₹ 1,20,00,000

    We are seeking a seasoned Freelance Data Engineer to design and develop large-scale data pipelines using Python, SQL, and AWS.Key Responsibilities:Design, build, and maintain ETL/ELT pipelines using PySpark, AWS, and Databricks for robust and high-performance data solutions.Perform data profiling, validation, and transformation using Python and SQL.Optimize...