Data Engineering Specialist

4 days ago

Vadodara, Gujarat, India beBeeDataEngineering Full time ₹ 20,00,000 - ₹ 25,00,000
Job Opportunity: Data Engineering Specialist

At our organization, we are currently seeking an experienced data engineering specialist to lead the design, development, and optimization of ETL pipelines. The ideal candidate will possess strong programming skills in Python and Scala, with hands-on experience working with Spark (PySpark & Scala Spark). Additionally, proficiency in SQL for data querying and transformation is required.

The successful candidate will be responsible for implementing scalable ETL pipelines using Azure Data Factory, Databricks, and Spark. They will also work extensively with Azure Cloud services, including Azure Data Lake, Azure SQL Database, and related services. Furthermore, the candidate will collaborate with business and technical teams to gather requirements and translate them into effective data solutions.

Key Responsibilities:
  • Design and Develop Scalable ETL Pipelines: Utilize Azure Data Factory, Databricks, and Spark to create efficient and reliable data pipelines.
  • Implement Data Transformation Workflows: Leverage PySpark and Scala Spark for high-performance data processing and transformation.
  • Work with Azure Cloud Services: Collaborate with Azure Cloud services, including Azure Data Lake, Azure SQL Database, and related services.
  • Troubleshoot and Debug Job Failures: Identify root causes of job failures and implement solutions to prevent future occurrences.
Required Skills and Qualifications:
  • Programming Skills: Proficiency in Python and Scala programming languages.
  • Spark Experience: Hands-on experience working with Spark (PySpark & Scala Spark).
  • SQL Knowledge: Strong understanding of SQL for data querying and transformation.
  • Azure Cloud Experience: Good knowledge of Azure Cloud, Azure Data Factory (ADF), and Azure Databricks.

Benefits of Working with Us: As a member of our team, you will have the opportunity to work on challenging projects, collaborate with experienced professionals, and contribute to the growth and success of our organization.

Why Apply? If you are passionate about data engineering and eager to take on new challenges, we encourage you to apply for this exciting opportunity.

  • Data Engineering Specialist

    5 days ago

    Vadodara, Gujarat, India beBeeDataEngineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job Summary:We are seeking a highly skilled Data Engineer to design, develop, and optimize data ingestion, transformation, and governance frameworks.Key Skills and Responsibilities:Data Engineering Expertise: Design and implement scalable, robust, and secure data pipelines using cloud-native technologiesDevelop and maintain ETL/ELT processes for structured...

  • Manufacturing Engineering Specialist

    4 days ago

    Vadodara, Gujarat, India beBeeManufacturing Full time ₹ 15,00,000 - ₹ 20,20,000

    Production Engineering SpecialistWe are seeking a highly skilled production engineering specialist to lead our production team and drive continuous improvement initiatives.Job Summary:The ideal candidate will have a strong background in mechanical engineering, with experience in mass production processes and process improvement.Key Responsibilities:Develop...

  • Data Engineer

    3 weeks ago

    Vadodara, Gujarat, India Kyara Consulting Full time

    Job Title Data EngineerExperience 1 5 to 2 YearsLocation Shyaml cross road AhmedabadEmployment Type Full-time We are looking for a Data Engineer with 1 5 to 2 years of experience who has expertise in Python and data scraping The ideal candidate will be responsible for building and optimizing data pipelines extracting and processing data from various...

  • Data Insights Specialist

    1 day ago

    Vadodara, Gujarat, India beBeeData Full time ₹ 25,00,000 - ₹ 40,00,000

    Key Role: Data Insights SpecialistAbout the Job:We are seeking an exceptional Data Insights Specialist to join our team. The ideal candidate will have a strong background in data analysis, machine learning, and statistical modeling.In this role, you will be responsible for collecting, organizing, and analyzing large datasets to uncover valuable insights that...

  • Geospatial Data Specialist

    3 days ago

    Vadodara, Gujarat, India beBeeData Full time ₹ 8,00,000 - ₹ 12,00,000

    Geospatial Data Specialist - Laser Scanning & Point Cloud Processing"> Job Overview: As a Geospatial Data Specialist, you will be responsible for processing and managing point cloud datasets from laser scanning equipment. Key Responsibilities: Process and manage point cloud datasets from laser scanning equipment.Perform geo-referencing and ensure high...

  • Piping Engineering Specialist

    1 day ago

    Vadodara, Gujarat, India beBeePiping Full time ₹ 15,00,000 - ₹ 18,00,000

    Job Title: Piping Engineering SpecialistWe are seeking a highly skilled Piping Engineering Specialist to join our team. As a key member of our engineering department, you will be responsible for designing and developing piping systems for various industrial projects.Required Skills and Qualifications:Piping stress analysis and calculation experience using...

  • Data Annotation Specialist

    4 days ago

    Vadodara, Gujarat, India beBeeDataAnnotation Full time ₹ 35,00,000 - ₹ 60,00,000

    Job Role: Data Annotation SpecialistThis role is fully remote.We are seeking a skilled professional for a contract position.Key Responsibilities:Annotate data accurately and consistently in line with project guidelines, encompassing text, image, video, or audio formats.Verify existing annotations for consistency and quality, making adjustments as...

  • Unlocking Pharmaceutical Supply Chain Insights Through Advanced Data Engineering

    22 hours ago

    Vadodara, Gujarat, India beBeeDataIntegration Full time ₹ 15,00,000 - ₹ 20,00,000

    Senior Data Integration SpecialistWe are seeking a skilled Senior Data Integration Specialist to join our team. This is an exciting opportunity for someone who is passionate about data engineering and integration.About the RoleThis position involves designing, building, and maintaining scalable data pipelines using Azure Data Factory, Azure Synapse...

  • Financial Data Insights Specialist

    1 day ago

    Vadodara, Gujarat, India beBeeData Full time ₹ 60,00,000 - ₹ 1,50,00,000

    Financial Data Insights SpecialistWe are seeking a highly skilled Financial Data Insights Specialist to join our AI-driven lending platform team. In this role, you will analyze financial and customer data to generate valuable insights for credit decisioning models.Key Responsibilities:Analyze large datasets from banking, fintech, and telco usage to identify...

  • Data Governance Specialist

    1 day ago

    Vadodara, Gujarat, India beBeeDataGovernance Full time ₹ 17,50,000 - ₹ 24,25,000

    Job Title: Data Governance SpecialistRole OverviewThe Data Governance Specialist role is a critical position that requires expertise in vendor master data management. The ideal candidate will possess advanced knowledge of the I2P process and vendor relations experience.Key ResponsibilitiesAct as a Subject Matter Expert (SME) for Vendor Master (VM) global...