Senior Data Developer

2 weeks ago

Palakkad, Kerala, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000
Job Description
A Data Engineer with Fabric is required to design, develop, and maintain data pipelines and infrastructure. This role will involve working closely with data scientists, analysts, and other stakeholders to ensure accurate, timely, and accessible data.

Key Responsibilities:
  • Data Pipeline Development: Design, develop, and implement data pipelines using Azure Data Factory and Databricks to support the ingestion, transformation, and movement of data.
  • ETL Processes: Develop and optimize ETL (Extract, Transform, Load) processes to ensure efficient data flow and transformation.
  • Data Lake Management: Develop and maintain Azure Data Lake solutions, ensuring efficient storage and retrieval of large datasets.
  • Data Warehousing: Work with Azure Synapse Analytics to build and manage scalable data warehousing solutions that enable advanced analytics and reporting.
  • Data Integration: Integrate various data sources into MS-Fabric, ensuring data consistency, quality, and accessibility across different platforms.
  • Performance Optimization: Optimize data processing workflows and storage solutions to improve performance and reduce costs.
  • Database Management: Manage and optimize databases (SQL and NoSQL) to support high-performance queries and data storage requirements.
  • Data Quality: Implement data quality checks and monitoring to ensure accuracy and consistency of data.
  • Collaboration: Work closely with data scientists, analysts, and other stakeholders to understand data requirements and deliver actionable insights.
  • Documentation: Create and maintain comprehensive documentation for data processes, pipelines, and infrastructure, architecture and best practices.
  • Troubleshooting and Support: Identify and resolve issues in data pipelines, data lakes, and warehousing solutions, providing timely support and maintenance.

Required Skills and Qualifications
  • Experience: 2-4 years of experience in data engineering or a related field.
  • Technical Skills:
    • Proficiency with Azure Data Factory, Azure Synapse Analytics, Databricks, and Azure Data Lake.
    • Experience with Microsoft Fabric is a plus.
    • Strong SQL skills and experience with data warehousing concepts (DWH).
    • Knowledge of data modeling, ETL processes, and data integration.
    • Experience with relational databases (e.g., MS-SQL, PostgreSQL, MySQL).
    • Hands-on experience with ETL tools and frameworks (e.g., Apache Airflow, Talend).
    • Knowledge of big data technologies (e.g., Hadoop, Spark) is a plus.
    • Familiarity with cloud platforms (e.g., AWS, Azure, Google Cloud) and associated data services (e.g., S3, Redshift, BigQuery).
    • Familiarity with data visualization tools (e.g., Power BI) and experience with programming languages such as Python, Java, or Scala.
    • Experience with schema design and dimensional data modeling.
  • Analytical Skills: Strong problem-solving abilities and attention to detail.
  • Communication: Excellent verbal and written communication skills, with the ability to explain technical concepts to non-technical stakeholders.
  • Education: Bachelor's degree in computer science, Engineering, Mathematics, or a related field. Advanced degrees or certifications are a plus.

About Us
We are looking for a skilled Data Engineer to join our team. If you have the required skills and qualifications, please apply today.

  • Senior Cloud Data Scientist

    1 week ago

    Palakkad, Kerala, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Role:Senior Data Engineer with GCP, ETLAs a Senior Data Engineer at our company, you will play a crucial role in designing and developing large-scale data processing systems.Key Responsibilities:Design and develop efficient ETL pipelines on Google Cloud Platform (GCP) using Python or Java.Built and maintain large-scale data processing systems using GCS,...

  • Senior Big Data Specialist

    2 weeks ago

    Palakkad, Kerala, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Senior Big Data SpecialistDescriptionWe are seeking a highly skilled Senior Big Data Specialist to join our team. The ideal candidate will have a minimum of 3-5 years of experience in designing and implementing data pipelines using various technologies.The successful candidate will be responsible for developing and maintaining large-scale data...

  • Senior Data Scientist

    2 weeks ago

    Palakkad, Kerala, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job OpportunityWe are seeking a skilled professional to take on the role of Senior Data Engineer- Data Modeler.Key Responsibilities:Data Modeling: Develop and implement conceptual, logical, and physical data models using Entity-Relational, Data Vault, and Dimensional Data modeling techniques.Requirements Gathering: Gather requirements from stakeholders and...

  • Senior Data Engineering Specialist

    2 weeks ago

    Palakkad, Kerala, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title: Senior Data Engineering SpecialistDescription:Our organization is seeking a highly skilled data engineer to lead our data engineering practice and drive initiatives to develop and continuously improve the Data/AI Practice.Key Responsibilities:Develop, implement, and optimize data pipelines for large-scale structured and unstructured datasets using...

  • Senior Data Testing Professional

    2 weeks ago

    Palakkad, Kerala, India beBeeDataTesting Full time ₹ 15,00,000 - ₹ 20,00,000

    Senior Data Testing Professional">We are seeking a highly skilled and detail-oriented Senior Data Testing Professional to join our data engineering team.">About the Role:">The ideal candidate will have a solid understanding of data validation, data processing, and data integrity across various sources including APIs and databases.">Key...

  • Senior Data Protection Specialist

    1 week ago

    Palakkad, Kerala, India beBeeDataProtection Full time ₹ 1,80,00,000 - ₹ 2,50,00,000

    Job Title: Senior Data Protection SpecialistAbout the Role:We are seeking an experienced data protection professional to join our team as a senior data protection specialist. The role involves leading and executing data protection engagements, ensuring compliance with global data protection regulations, and embedding data protection by design into client...

  • Senior Data Systems Architect

    2 weeks ago

    Palakkad, Kerala, India beBeeData Full time US$ 2,00,000 - US$ 2,50,000

    Senior Data Systems ArchitectWe are seeking an experienced Senior Data Systems Architect to join our team.

  • Senior Data Architect

    7 days ago

    Palakkad, Kerala, India beBeeData Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Principal Data EngineerJob Summary:We are seeking an accomplished data engineering expert to join our dynamic team. As a key member, you will play a pivotal role in shaping the architecture of our data warehouse, mentoring senior engineers, and engaging directly with clients.About the Role:The successful candidate will be responsible for building a...

  • Senior Data Pipeline Developer

    1 week ago

    Palakkad, Kerala, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Data Engineer PositionWe are seeking a skilled Data Engineer to join our team. As a key member of the data team, you will be responsible for designing and developing scalable data pipelines using Google Cloud Platform (GCP) tools.This is a remote opportunity that requires 10+ years of experience in data engineering with a focus on real-time and big query...

  • Senior Data Systems Developer

    7 days ago

    Palakkad, Kerala, India beBeeDataEngineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Data Engineer Role Overview">This Data Engineer role involves designing, developing, and maintaining large-scale data systems. The ideal candidate will have experience with database tools like dbt (Data Build Tool), as well as collaboration skills to work with data engineers on ingesting and transforming data from various sources.The successful candidate...