Senior Data Engineer

2 weeks ago

Bengaluru, Karnataka, India INFOTECH CONSULTANCY PRIVATE LIMITED Full time

Job Title : Senior Data Engineer - Microsoft Fabric & Azure/AWS

Location : Rajajinagar, Bengaluru - 4 days Onsite

Experience Level : 5+ Years

Job Overview :

We are seeking a highly skilled Senior Data Engineer with strong expertise in Azure Data Services, Microsoft Fabric, OneLake, PySpark (Notebooks), and Databricks to join our growing data engineering team. The ideal candidate will be responsible for building scalable data pipelines, designing robust data lake/warehouse solutions, and driving high-impact data integrations and analytics across the enterprise data ecosystem.

Key Responsibilities :

- Design, build, and maintain data warehouses, data lakes, and lakehouses with a focus on scalability, reliability, and performance.

- Develop and manage end-to-end ETL/ELT workflows to seamlessly ingest, transform, and load

structured and unstructured data into the data platform.

- Build and optimize pipelines using Azure Synapse, Microsoft Fabric, OneLake, and Databricks.

- Create and maintain PySpark Notebooks for advanced transformation and automation use

cases.

- Translate business and data requirements into technical designs, data models, and ETL

strategies on cloud-native data platforms.

- Ingest data from diverse source systems, ensuring completeness, accuracy, and performance

through effective pipeline design.

- Maintain and enhance complex data environments by integrating multiple data sources and

managing real-time and batch data processing.

- Implement robust backup, recovery, and archiving strategies for data platforms and databases.

- Collaborate with cross-functional teams to support BI tools (e.g., Power BI, Tableau), and downstream applications through clean, enriched data.

- Drive improvements in DevOps practices within the data platform team to ensure agility and continuous Monitor data quality and operational health of all pipelines; troubleshoot and resolve integration failures or data inconsistencies.

Required Skills & Experience :

- Proven experience in data engineering with a focus on cloud-native platforms.

- Expertise in Azure Data Services, Microsoft Fabric, OneLake, Databricks, and PySpark (Notebooks).

- Solid understanding of data modeling, database design, data lake architecture, and ETL frameworks.

- Strong SQL skills and working knowledge of both relational and NoSQL databases.

- Experience with building enterprise-grade, distributed data systems with high availability and fault tolerance.

- Hands-on experience in building data pipelines using a combination of batch and streaming technologies.

- Strong understanding of data validation, quality assurance, and data governance practices.

- Working knowledge of data visualization tools like Power BI and Tableau.

- Experience integrating with CI/CD pipelines and monitoring tools in a DevOps environment.

- Excellent communication skills to articulate complex data engineering concepts to both technical and non-technical stakeholders.

Preferred Qualifications :

- Azure Data Engineer Certification (DP-203) or equivalent.

- Prior experience in implementing solutions using Microsoft Fabric and OneLake in production environments.

- Familiarity with data cataloging, metadata management, and data lineage tracking tools.

(ref:hirist.tech)

  • Senior Associate Data Engineer

    3 weeks ago

    Bengaluru, Karnataka, India NTT DATA, Inc. Full time

    Job DescriptionMake an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion its a place where you can grow, belong and thrive.Your day at NTT DATAThe...

  • Data Entry Operator

    2 days ago

    Bengaluru, Karnataka, India Design Engineer Full time ₹ 2,64,000 per year

    We are seeking a dedicated and detail-oriented Data Entry Operator (DEO) to support R&D projects. The role involves accurate data entry, documentation, and maintenance of research records in secure systems. The DEO will assist scientists, engineers, and administrative staff by ensuring timely and error-free handling of project information.Key...

  • Senior Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 25,00,000

    Data Engineering Role OverviewWe are seeking a senior data engineer to drive business strategies through robust data pipelines.Develop and refine intricate ETL pipelines for processing high volumes of data.Maintain data precision, coherence, and system performance.Collaborate with cross-functional teams for impactful solutions.Implement top-notch practices...

  • Senior Data Engineer

    4 days ago

    Bengaluru, Karnataka, India Tap Growth ai Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    We're Hiring: Senior Data Engineer We are seeking an experienced Senior Data Engineer to design, build, and maintain robust data infrastructure and pipelines. The ideal candidate will have expertise in big data technologies, cloud platforms, and data architecture to support our analytics and business intelligence initiatives. Location:Bengaluru, India Work...

  • Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA, Inc. Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    Req ID:321800We are currently seeking a Data Engineer (Talend &Pyspark) to join our team in Bangalore, Karntaka (IN-KA), India (IN)."Job Duties: Key Responsibilities: Design and implement tailored data solutions to meet customer needs and use cases, spanning from streaming to data lakes, analytics, and beyond within a dynamically evolving technical...

  • Senior Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India eClerx Full time

    Job Title: Senior Data Engineering Lead (Databricks) Next Step: If this role excites you and matches your expertise, kindly fill out the Google Form with the required details so we can reach out to you and make the process seamless: Role Overview: We are seeking a highly experienced Senior Data Engineering Lead with a strong focus on Databricks and...

  • Senior Data Engineer

    2 days ago

    Bengaluru, Karnataka, India Genpact Full time ₹ 1,50,00,000 - ₹ 3,00,00,000 per year

    Urgent Hiring in Genpact for Senior Data EngineerLocation: Bangalore, Genpact office Prestige ParkShift Timings- 12 PM to 10 PM ISTWork Mode: HybridPermanent roleLooking for candidate with immediate to 30 days' notice periodTitle: Senior Data Engineer AWS | ETL | SQL | PythonJob Description: We are looking for a Senior Data Engineer (2+ years with strong...

  • Senior Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Planwo software solutions Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    Company DescriptionWelcome to Planwo - Innovating Tomorrow's Solutions Today At Planwo, we push the boundaries of technological innovation, creating robust and cutting-edge software solutions that empower businesses to thrive in the digital era. Our team of skilled software engineers, developers, and designers specialize in crafting bespoke software...

  • Technical Lead- Data Engineer

    2 days ago

    Bengaluru, Karnataka, India Astar Data Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Kindly find the Job Description Below.Job Title:Technical Lead- Data EngineerLocation: BangaloreYears of Experience: 8+ years of experienceSigmoidworks with a variety of clients from start-ups to fortune 500 companies. We are looking for a detailed oriented self-starter to assist our engineering and analytics teams in various roles as a Software...

  • Lead Data Scientist

    2 weeks ago

    Bengaluru, Karnataka, India Data Science Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Get to know the team GrabFin is an aggregate of FinTech businesses spread across 6 countries in S.E. Asia, in the Lending, Payments and Insurance domains. We are excited to provide innovative financial services to all participants of the Grab Ecosystem be it our Drivers, Consumers or Merchants. Our products are built on fundamental market insights combined...