Highly Skilled Data Pipeline Specialist

4 days ago

Anand, Gujarat, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 22,50,000
Job Opportunity

We are seeking a skilled Data Engineer with proficient knowledge in Spark and SQL to fill this critical role.

Job Description:

The ideal candidate will be responsible for designing, implementing, and optimizing data pipelines on our Data platform. You will work closely with data architects, and other stakeholders to ensure data accessibility, reliability, and performance.

Key Responsibilities:
  • Data Pipeline Development: Design, develop, and maintain scalable data pipelines using Azure Synapse, Databricks & Apache Spark (PySpark).
  • Data Integration: Integrate data from various sources, ensuring data quality and consistency.
  • Performance Optimization: Optimize data processing workflows for performance and cost-efficiency.
  • Collaboration: Work with data architects, analysts, and product owners to understand data requirements and deliver solutions.
  • Monitoring and Troubleshooting: Monitor data pipelines and troubleshoot issues to ensure data integrity.
  • Documentation: Document data workflows, processes, and best practices.
Required Skills and Qualifications:
  • Proficiency in Azure Synapse/Databricks and Apache Spark.
  • Strong PySpark and SQL skills for data manipulation and querying.
  • Familiarity with Delta Live Tables and Databricks workflows.
  • Experience with ETL tools and processes.
  • Knowledge of cloud platforms (AWS, Azure, GCP).
  • Minimum 2 years of work experience with Azure Synapse.
  • 5 years of experience in data engineering.
Benefits:
  • Opportunity to work on large-scale data projects.
  • Chance to collaborate with experienced data professionals.
  • Professional growth and development opportunities.
Others:
  • Excellent problem-solving abilities.
  • Strong communication and collaboration skills.
  • Ability to work in a fast-paced environment and manage multiple priorities.

This is an exciting opportunity for a skilled Data Engineer to join our team and contribute to the success of our data initiatives.

  • Highly Skilled Cloud Data Architect

    1 week ago

    Anand, Gujarat, India beBeeDatabricks Full time ₹ 20,00,000 - ₹ 25,00,000

    Job DescriptionWe are seeking a highly skilled Databricks Data Engineer to join our dynamic data engineering team.The ideal candidate will be well-versed in PySpark, CI/CD pipelines, and Terraform for infrastructure as code.Key Responsibilities:Design and develop scalable and high-performance data pipelines using Databricks and PySpark.Implement and manage...

  • Highly Skilled Data Solutions Specialist

    1 week ago

    Anand, Gujarat, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    Data Engineering PositionDeliver cutting-edge data solutions that drive business growth and innovation.As a Data Engineer, you will play a pivotal role in designing, building, and managing scalable data pipelines and enterprise data solutions. This includes developing ETL/ELT pipelines using Azure Data Factory (ADF) and Databricks for batch and real-time...

  • Senior Data Pipeline Specialist

    2 weeks ago

    Anand, Gujarat, India beBeeDataEngineer Full time ₹ 1,80,00,000 - ₹ 2,40,00,000

    Job Opportunity: We are seeking a highly skilled Azure Databricks Engineer for a short-term contract position.The ideal candidate will have hands-on experience with designing and developing data pipelines using Azure Data Factory, Databricks notebooks with SQL & Python, and file formats such as Parquet, Delta, and CSV. A professional with 7+ years of...

  • Data Architect Specialist

    1 week ago

    Anand, Gujarat, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    Data Architect SpecialistWe are seeking a highly skilled Data Architect Specialist to design, build, and optimize scalable data pipelines using Snowflake, AWS (Lambda, Glue), DBT, and SQL.

  • Data Pipeline Specialist

    1 week ago

    Anand, Gujarat, India beBeedataengineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Senior Software EngineerJob Description:Develop and optimize data pipelines using Azure Data Factory, Databricks, and Synapse Analytics.Design scalable data architectures following best practices.Perform data ingestion, transformation, and orchestration across structured and unstructured datasets.Key Responsibilities:Develop and maintain data lake solutions...

  • Data Pipeline Specialist

    1 week ago

    Anand, Gujarat, India beBeeDataQuality Full time ₹ 18,00,000 - ₹ 23,00,000

    About Data Quality EngineersWe are looking for skilled professionals to join our team of Data Quality Engineers.Data Quality Engineers play a vital role in ensuring the accuracy and reliability of our clients' data pipelines.Key Responsibilities:Develop and execute automated tests to identify and resolve data quality issues.Requirements:Hands-on experience...

  • Data Pipeline Specialist

    3 days ago

    Anand, Gujarat, India beBeeMachineLearning Full time ₹ 12,00,000 - ₹ 25,00,000

    AI Engineer Role OverviewThe primary objective of this position is to design and optimize data pipelines using Python, Pandas, and Scikit-learn.Key Responsibilities:Develop and refine data pipelines for AI applications.Support Large Language Model (LLM) based initiatives through prompt engineering.Conduct thorough model evaluation and testing to ensure...

  • Highly Skilled Azure Data Migration Specialist

    3 days ago

    Anand, Gujarat, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Sr. Azure Data Engineer Job Overview">Job Description: We are seeking a highly skilled Azure Data Engineer to lead the migration of large-scale SQL workloads from on-premise environments to Azure. The ideal candidate will have hands-on experience in modern data engineering tools and platforms within the Azure ecosystem, including data integration,...

  • Expert Cloud Data Pipeline Architect

    1 week ago

    Anand, Gujarat, India beBeeDataEngineering Full time ₹ 7,20,000 - ₹ 14,40,000

    Cloud Data Engineering SpecialistWe are seeking a highly skilled Cloud Data Engineer to join our team. The ideal candidate will have extensive experience in designing, building, and maintaining large-scale data pipelines on the cloud platform.Bachelor's degree in Computer Science, Information Technology, or a related field is required. Master's degree is...

  • Data Automation Specialist

    1 day ago

    Anand, Gujarat, India beBeeAutomation Full time ₹ 1,00,00,000 - ₹ 2,00,00,000

    Job Title: Data Automation SpecialistWe are seeking a highly skilled and detail-oriented professional to join our team as a Data Automation Specialist.Key Responsibilities:Design and develop automated scripts in Python to create a golden model within SQL Server for use in test automation.Collaborate with developers and analysts to understand data...