Sr. Data Engineer

5 days ago

Greater Bengaluru Area, India VNB Consulting Services Full time ₹ 15,00,000 - ₹ 25,00,000 per year

Location
: Work from Office (Bengaluru)

Experience
: 3-5 years

About Us
:

VNB Consulting Services, headquartered in New Jersey, is an end-to-end technology solution provider specializing in Apps, Automation, Analytics, and AI. Our mission is to deliver tested technology solutions that enhance existing technology, improve business processes, or develop new solutions.

Role Overview
:

We are looking for a motivated Data Engineer to join our team and work with Microsoft Fabric to design, develop, and maintain data solutions. The candidate will support building data pipelines, integrate data sources, and enable analytics across the enterprise using Fabric's unified platform.

Key Responsibilities
:

  • Design, build, and maintain scalable data pipelines using
    Microsoft Fabric technologies
    (Dataflow Gen2, Data Pipelines, PySpark notebooks, Spark SQL, and Python).
  • Develop and optimize
    ETL/ELT processes
    using
    Azure Data Factory
    , ensuring efficient data extraction, transformation, and loading between source systems and D365.
  • Execute data ingestion, transformation, and loading for both
    structured and unstructured data
    from diverse sources.
  • Perform
    data transformations, cleaning, and validation
    to ensure high data quality.
  • Write and optimize
    SQL queries
    on
    Azure Synapse Analytics
    , leveraging both dedicated and serverless resources.
  • Conduct deep code-level analysis and troubleshooting of
    Spark core internals
    , Spark SQL, Structured Streaming, and Delta.
  • Monitor, troubleshot, and fine-tune data pipelines and workflows to enhance performance, especially with large datasets.
  • Ensure
    data governance, security
    , and compliance with privacy regulations throughout the data engineering lifecycle.
  • Build and maintain infrastructure for optimal data performance and reliability.
  • Document processes, workflows, and data models, and provide
    knowledge transfer/training
    to team members as needed.
  • Build
    reporting and dashboards
    using tools like
    Power BI
    .

Required Skills & Qualifications

  • SQL and Data Modelling Concepts
  • Familiarity with Microsoft Fabric or Azure Cloud Platform
  • Exposure to Microsoft Power BI, Azure Data Factory, or Fabric
  • Strong problem-solving and analytical skills
  • Eagerness to learn new tools and technologies in the data engineering ecosystem
  • Understanding of Python, Spark, or DAX

Nice to have:

  • Knowledge of data governance and security principles
  • Experience with any ETL tool or cloud data warehouse
  • Experience of Power BI, Azure Analysis Services
  • CI/CD of data pipelines
  • Microsoft Certifications (AZ-900, DP-203, DP-600)
  • Working knowledge of multiple database technologies
  • Experience working in agile methodology using either Azure DevOps or any similar tool

Why Join VNB
Consulting Services?

  • Excellent pay and benefits
  • Flexible working schedule
  • Opportunity to work with cutting-edge Microsoft Fabric and Power BI technologies

Information Security Requirement
- Basic awareness of Information Security (IS

Candidates must apply with the latest copy of their resume.

  • Sr. Data Engineer

    1 week ago

    Bengaluru, India NTT DATA Full time

    Job Description Req ID:     NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Sr. Data Engineer to join our team in Bangalore, Karnātaka (IN-KA), India (IN). Primary Responsibility...

  • Sr. Data Engineer Data Science

    1 day ago

    Bengaluru, Karnataka, India NTT DATA Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    Req ID: 342869NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Sr. Data Engineer Data Science to join our team in Bangalore, Karnātaka (IN-KA), India (IN). ...

  • Sr Data Engineer

    1 week ago

    Bengaluru, Karnataka, India NTT DATA Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Req ID: 340286NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Sr Data Engineer (Life and Annuity) to join our team in Bangalore, Karnātaka (IN-KA), India (IN). Job Duties: At...

  • Sr Data Engineer

    2 weeks ago

    Greater Bengaluru Area, India Illumina Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    What if the work you did every day could impact the lives of people you know? Or all of humanity?At Illumina, we are expanding access to genomic technology to realize health equity for billions of people around the world. Our efforts enable life-changing discoveries that are transforming human health through the early detection and diagnosis of diseases and...

  • Sr. Data Engineer

    1 week ago

    Bengaluru, India Onebridge Full time

    Onebridge, a Marlabs Company, is a global AI and Data Analytics Consulting Firm that empowers organizations worldwide to drive better outcomes through data and technology. Since 2005, we have partnered with some of the largest healthcare, life sciences, financial services, and government entities across the globe. We have an exciting opportunity for a highly...

  • Sr. Data Modeler

    1 week ago

    Bengaluru, India NTT DATA Full time

    Job Description Req ID:     NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Sr. Data Modeler to join our team in Bangalore, Karnātaka (IN-KA), India (IN). Primary Responsibility...

  • Sr. Data Science

    1 week ago

    Bengaluru, India NTT DATA Full time

    Job Description Req ID:     NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Sr. Data Science & AIML, GenAI Lead/Engineer to join our team in Bangalore, Karnātaka (IN-KA), India...

  • Sr Data Engineer

    1 week ago

    Bengaluru East, Karnataka, India NTT DATA North America Full time ₹ 8,00,000 - ₹ 12,00,000 per year

    Req ID:340286NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Sr Data Engineer (Life and Annuity) to join our team in Bangalore, Karnātaka (IN-KA), India (IN).Job Duties:At least 6+...

  • Sr Data Engineer

    1 day ago

    Bengaluru, Karnataka, India Nam Info Full time ₹ 10,00,000 - ₹ 25,00,000 per year

    Dear Candidate,Hope you are doing well.Greeting from NAM Info INC.NAM Info Inc. is a technology-forward talent management organization dedicated to bridging the gap between industry leaders and exceptional human resources. They pride themselves on delivering quality candidates, deep industry coverage, and knowledge-based training for consultants. Their...

  • Sr. Data Engineer

    1 week ago

    Bengaluru, India Epergne Solutions Full time

    Epergne Solutions is looking for Sr. Data Engineer Payroll : Epergne Solution Years of Experience: 6-10 yrs relevant work-experience in PL/SQL Relevant Yrs. of experience* MBA Finance with at least 6 -8 years of experience as data engineer in Financial Services domain, preferably in risk management (AML/Fraud transformation) function of a bank Detailed JD...