Big Data Transformation Specialist

3 days ago

Rajkot, Gujarat, India beBeeData Full time ₹ 96,00,000 - ₹ 1,29,90,000
About the Role

We are seeking an experienced professional to design, develop, and maintain ETL pipelines using Azure Data Factory. As a key member of our team, you will be responsible for writing complex SQL queries, stored procedures, and performance-tuned scripts for data transformation and validation.

You will integrate data from various sources including Azure Blob Storage, SQL Server, REST APIs, and on-premise systems, monitoring and troubleshooting data pipelines and workflows to ensure data quality and reliability.

Collaborate with data architects, analysts, and business stakeholders to understand data requirements and implement data governance, security, and compliance best practices.

  • Key Responsibilities:
  • Design, develop, and maintain ETL pipelines using Azure Data Factory.
  • Write complex SQL queries, stored procedures, and performance-tuned scripts for data transformation and validation.
  • Integrate data from various sources including Azure Blob Storage, SQL Server, REST APIs, and on-premise systems.
  • Monitor and troubleshoot data pipelines and workflows to ensure data quality and reliability.
  • Collaborate with data architects, analysts, and business stakeholders to understand data requirements.
  • Implement data governance, security, and compliance best practices.
Requirements
  • Required Skills & Qualifications:
  • Strong hands-on experience with Azure Data Factory (pipelines, triggers, linked services, datasets).
  • Proficiency in T-SQL and SQL Server (SSMS, stored procedures, indexing, optimization).
  • Experience with Azure SQL Database, Azure Synapse Analytics, or Data Lake.
  • Familiarity with parameterization, dynamic content, and data flows in ADF.
  • Understanding of data warehousing concepts, ETL best practices, and data modeling.
  • Experience with Git, Azure DevOps, or other version control systems.
Benefits
  • Preferred Qualifications:
  • Microsoft Certified: Azure Data Engineer Associate or equivalent.
  • Experience with Power BI, Databricks, or Logic Apps is a plus.
  • Knowledge of Python or PowerShell for automation.

  • Big Data Specialist

    5 hours ago

    Rajkot, Gujarat, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Big Data SpecialistAbout the Role:Data specialists play a critical role in extracting valuable insights from complex data sets. They design, build, deploy, and maintain large-scale data processing systems that enable organizations to make informed business decisions.Key Responsibilities:Design and develop scalable data pipelines using modern...

  • Big Data Specialist

    3 days ago

    Rajkot, Gujarat, India LTIMindtree Full time

    Greetings from LTIMindtree We are currently hiring for Bigdata Scala Spark. The position is ideal for professionals with 6–12 years of experience in Bigdata and related technologies.Experience : 6 to 12Location : Coimbatore/PuneWork Mode : Hybrid ModeNotice Period : Upto 30 DaysInterview Mode : In Person (Saturday, 13-Sep-2025)Key Skills We're Looking...

  • Data Transformation Specialist

    22 hours ago

    Rajkot, Gujarat, India beBeeTransformation Full time ₹ 8,00,000 - ₹ 12,00,000

    Job Title: Data Transformation SpecialistWe are seeking an experienced data transformation professional to join our team. As a data transformation specialist, you will be responsible for ensuring the quality and integrity of large datasets.Key Responsibilities:Transform and validate data from various sources to ensure accuracy and consistency.Identify and...

  • ETL/Big Data Solutions Architect

    21 hours ago

    Rajkot, Gujarat, India beBeeData Full time US$ 1,20,000 - US$ 1,50,000

    Lead ETL/Big Data TesterWe are seeking a skilled professional to lead our team in the development and execution of user acceptance tests in QA/production labs with multiple machines/VMs.This role involves working on the deployment of product suite/components spread across multiple machines/VMs, utilizing expertise in Big Data components like Hadoop, SOLR,...

  • Big Data Architect

    7 days ago

    Rajkot, Gujarat, India beBeeDataEngineer Full time ₹ 35,00,000 - ₹ 45,00,000

    Job Title:Data Engineer SpecialistDescription:This is a challenging role requiring a strong technical background and experience in designing and implementing data architectures. We are looking for an individual who can lead multiple data engagements, interface with stakeholders, and take complete responsibility for the successful delivery of allocated...

  • Highly Skilled Big Data Specialist

    2 days ago

    Rajkot, Gujarat, India beBeeExpertise Full time ₹ 20,00,000 - ₹ 25,00,000

    Big Data ExpertWe are currently seeking highly skilled professionals to join our team as Big Data Experts.The ideal candidate will have a solid foundation in big data concepts, excellent problem-solving skills, and the ability to work on complex projects.Responsibilities:Design and implement scalable big data pipelines using advanced technologies.Develop and...

  • Senior Big Data Developer

    7 days ago

    Rajkot, Gujarat, India beBeeData Full time ₹ 20,00,000 - ₹ 30,00,000

    Job Title: Big Data EngineerWe are seeking a skilled Big Data Engineer to join our data engineering team. The ideal candidate will have strong expertise in Scala, Spark, Python, NiFi, and Apache Kafka.Key Responsibilities:Design, develop, and optimize large-scale data pipelines and distributed data processing systems.Work extensively with Scala, Spark...

  • Senior Big Data Engineer

    7 days ago

    Rajkot, Gujarat, India beBeeBigDataEngineer Full time ₹ 75,00,000 - ₹ 1,50,00,000

    Senior Big Data EngineerWe are seeking a highly skilled Senior Big Data Engineer to join our team. The successful candidate will be responsible for designing, building, and maintaining large-scale data systems.

  • Data Transformation Expert

    6 days ago

    Rajkot, Gujarat, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Data Integration Specialist This is a unique opportunity to work with data integration and ETL needs. As a Freelance Azure Data Factory (ADF) Specialist, you will support business requirements by designing, building, and maintaining data pipelines. Required Skills and Qualifications: Design, build, and maintain Azure Data Factory pipelines for ETL and ELT...

  • Senior Data Infrastructure Specialist

    2 days ago

    Rajkot, Gujarat, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000

    Job DescriptionOur organization is seeking a skilled Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing and building scalable data pipelines.The ideal candidate will have a strong understanding of GCP services, including Bigquery, SQL, and Python dataflow skills. You will also have experience...