Infocepts - Senior Data Engineer - Azure Databricks

4 weeks ago

Pune, India InfoCepts Technologies Pvt. Ltd. Full time

Description : Key Responsibilities : Data Pipeline Development : - Design and implement robust batch and real-time streaming data pipelines leveraging Azure Databricks and Apache Spark.- Build scalable and maintainable ETL/ELT workflows to support data ingestion, transformation, and integration from diverse sources.Data Architecture Implementation : - Apply the Medallion Architecture to organize data into distinct layers raw, enriched, and curated ensuring clarity, quality, and usability of data assets.- Collaborate in designing data models and schemas that support analytics and business intelligence needs.Data Quality & Governance : - Define and enforce data quality rules and principles to maintain data accuracy and consistency across the pipeline.- Implement data governance policies and manage metadata using tools like Azure Purview and Unity Catalog.- Monitor data lineage and ensure compliance with organizational and regulatory standards.Performance Optimization : - Optimize Spark jobs, Delta Lake tables, and SQL queries for improved efficiency, reduced latency, and cost-effectiveness.- Identify and resolve bottlenecks in data processing workflows to ensure high availability and reliability.Collaboration & Delivery : - Work closely with data analysts, solution architects, business stakeholders, and other engineering teams to deliver end-to-end data solutions aligned with business goals.- Participate in Agile/Scrum ceremonies and contribute to continuous improvement initiatives within the team.Required Qualifications : - Bachelors or Masters degree in Computer Science, Engineering, Information Technology, or related fields.- 5+ years of experience in data engineering, with strong expertise in Azure Databricks and Apache Spark.- Proficiency in data integration techniques, ETL/ELT processes, and data pipeline design.- Experience implementing Medallion Architecture or similar data layering concepts.- Knowledge of Delta Lake and experience managing large-scale data lakes.- Familiarity with data quality frameworks and governance tools such as Azure Purview and Unity Catalog.- Strong SQL skills and experience optimizing complex queries for performance.- Experience with cloud data storage, processing, and orchestration tools within Azure ecosystem.- Good understanding of data security, privacy, and compliance requirements.- Excellent communication, collaboration, and problem-solving skills. (ref:hirist.tech)

  • Azure Architect

    1 week ago

    Pune, India Infocepts Full time

    **Position**: Azure Architect **Purpose of the Position**: To provide client advisory, pre-sales, and practice development support for Infocepts cloud and data engineering competency center. The position enables Infocepts to meet its business goals by forging enduring practice initiated solutions, supporting delivery teams with technical advisory and...

  • Data engineer- databricks

    4 weeks ago

    Pune, India InfoCepts Full time

    Position: Data Engineer- DatabricksPurpose of the Position:Develop, support and steer end-to-end business intelligence using Databricks.Location: Nagpur/ Pune/ Chennai/ BangaloreKey Responsibilities:- Work with business analysts and data architects to translate requirements into technical implementations.- Design, develop, implement, and maintain pyspark...

  • Senior Data Engineer

    3 weeks ago

    Pune, India Talent Pro Full time

    Description :We are seeking a highly experienced Senior Data Engineer with strong architectural capability, excellent optimisation skills, and deep hands-on experience in modern data platforms. The ideal candidate will have advanced SQL skills, strong expertise in Databricks, and practical experience working across cloud environments such as AWS and Azure....

  • Newscape - Senior Databricks Engineer - Azure Data Services

    3 weeks ago

    Pune, India Newscape Consulting Full time

    Description : Were Hiring : Senior Databricks Engineer / Azure Data Engineer / Lead Data engineer.Location : Baner, Pune (Onsite Only).Work Mode : Full-time | Office-based.Availability : Immediate Joiners / Notice Period ? 30 Summary : We are looking for a Senior Databricks Engineer / Azure Data Engineer who will be responsible for designing and implementing...

  • Newscape - Senior Databricks Engineer - Azure Data Services

    3 weeks ago

    Pune, India Newscape Consulting Full time

    Job Description Description Were Hiring : Senior Databricks Engineer / Azure Data Engineer / Lead Data engineer. Location : Baner, Pune (Onsite Only). Work Mode : Full-time | Office-based. Availability : Immediate Joiners / Notice Period 30 Summary : We are looking for a Senior Databricks Engineer / Azure Data Engineer who will be responsible for designing...

  • Azure Databricks Data Engineer

    2 days ago

    Pune, Maharashtra, India Reveille Technologies,Inc Full time

    Hiring: Azure Databricks Data Engineer (FTE | Face-to-Face Interview) Location: Pune Experience: 9+ Years Notice Period: 0–30 Days (Serving candidates preferred)We're looking for an experienced Data Engineer with strong hands-on expertise in Azure Databricks and a solid data background. Key Skills:Primary: Azure, Databricks, ADF, PySpark/PythonSecondary:...

  • Azure Databricks Engineer

    1 week ago

    Pune, Maharashtra, India Savi Technologies Full time

    Opening: Azure Databricks EngineerLocation: Pune, Maharashtra (Onsite)Experience Range: 5-6 YearsApply at: -Required Skills:Azure Data Factory (ADF)PySparkAzure Databricks (ADB)SQLJob Description:We're looking for an experienced Azure Databricks Engineer with a background in financial crime analytics and hands-on expertise in:Databricks engineering &...

  • Azure Databricks Developer

    1 week ago

    Pune, Maharashtra, India Newscape Consulting Full time ₹ 8,00,000 - ₹ 16,00,000 per year

    We're Hiring: Senior Databricks Engineer / Azure Data Engineer Location:Baner, Pune (Onsite Only) Work Mode:Full-time | Office-based Availability:Immediate Joiners / Notice Period ≤ 15 Days Note:Only local Pune candidates or those willing to relocate to Pune may apply.* L2 interviews will be conductedin person— apply only if you are open to face-to-face...

  • Databricks Data Engineer

    3 weeks ago

    Pune, India Ascendion Full time

    Job Title: Senior Data Engineer Experience : 5+ years Location: Gurgaon /Pune / Bangalore Skills : Databricks , Delta Lake, PySpark , SQL Desired Skills and Experience: • 3–5 years of experience in data engineering, preferably with Azure Databricks. • Strong technical expertise in PySpark, SQL, and Delta Lake. • Familiarity with Unity Catalog, data...

  • Databricks Data Engineer

    2 weeks ago

    Pune, India Ascendion Full time

    Job Title: Senior Data Engineer Experience : 5+ years Location: Gurgaon /Pune / Bangalore Skills : Databricks , Delta Lake, PySpark , SQL Desired Skills and Experience: • 3–5 years of experience in data engineering, preferably with Azure Databricks. • Strong technical expertise in PySpark, SQL, and Delta Lake. • Familiarity with Unity Catalog, data...