Azure Data Engineer-Technical Lead

20 hours ago

bangalore, India Sigmoid Full time

Kindly find the Job Description Below.Job Title:Technical Lead-Azure Data EngineerLocation: BangaloreYears of Experience: 10+ years of experienceSigmoid works with a variety of clients from start-ups to fortune 500 companies. We are looking for a detailed oriented self-starter to assist our engineering and analytics teams in various roles as a Software Development Engineer.As an Technical Lead- Data Engineer, you will be responsible for building a highly-scalable and extensible big data platform that provides the foundation for collecting, storing, modeling, and analyzing massive data sets from multiple channels.We are looking for a skilled Data Engineer with 10+ years of experience in big data technologies, particularly Azure, Python, PYSpark, SQL and data lakehouse architectures. The ideal candidate will have a strong background in building scalable data pipelines and experience with modern data storage formats, including Apache Iceberg. You will work closely with cross-functional teams to design and implement efficient data solutions in a cloud-based environment.Key Responsibilities:Data Pipeline Development:Design, build, and optimize scalable data pipelines using Apache Spark.Implement and manage large-scale data processing solutions across data lakehouses.Data Lakehouse Management:Work with modern data lakehouse platforms (e.g.Apache Iceberg) to handle large datasets.Optimize data storage, partitioning, and versioning to ensure efficient access and querying.SQL & Data Management:Write complex SQL queries to extract, manipulate, and transform data.Develop performance-optimized queries for analytical and reporting purposes.Data Integration:Integrate various structured and unstructured data sources into the lakehouse environment.Work with stakeholders to define data needs and ensure data is available for downstream consumption.Data Governance and Quality:Implement data quality checks and ensure the reliability and accuracy of data.Contribute to metadata management and data cataloging efforts.Performance Tuning:Monitor and optimize the performance of Spark jobs, SQL queries, and overall data infrastructure.Work with cloud infrastructure teams to optimize costs and scale as needed.Qualifications:Bachelor’s or Master’s degree in Computer Science, Information Technology, or a related field.9+ years of experience in data engineering, with a focus on Java/python, Spark and SQL Programming languages.Hands-on experience with Apache Iceberg, Snowflake, or similar technologies.Strong understanding of data lakehouse architectures and data warehousing principles.Proficiency in AWS data services.Experience with version control systems like Git and CI/CD pipelines.Excellent problem-solving and analytical skills.Strong communication and collaboration skills.Nice to Have:Experience with containerization (Docker, Kubernetes) and orchestration tools like Airflow.Certifications in Azure cloud technologies

  • Azure Data Engineer-Technical Lead

    13 hours ago

    bangalore, India Sigmoid Full time

    Kindly find the Job Description Below. Job Title:Technical Lead-Azure Data Engineer Location: Bangalore Years of Experience: 10+ years of experience Sigmoid works with a variety of clients from start-ups to fortune 500 companies. We are looking for a detailed oriented self-starter to assist our engineering and analytics teams in various roles as a Software...

  • Lead Data Engineer

    7 days ago

    bangalore, India NexGen Tech Solutions Full time

    Job Title: Lead Data Engineer – Wealth ManagementLocation: [Noida/Gurgaon/Remote]Experience: 10+ yearsMust Have: Wealth Management Domain, Fabric, Data Lake, PythonJob Summary:We are seeking a highly skilled Lead Data Engineer (Azure) with deep expertise in the Wealth Management domain to design, implement, and manage scalable data solutions.Experience in...

  • Senior Azure Data Engineer/Lead

    2 weeks ago

    bangalore, India Ekfrazo Technologies Private Limited Full time

    Role: Senior Data Engineer/Lead Location : Bangalore , Noida, Gurgaon, Pune, Mumbai, Kochi – Bangalore ( preferred) – Hybrid Model ( weekly 2 days ) Position 1 - Job Details – Data Engineer Lead Experience – 8 – 12 yrs - Data Engineer Lead Key skills : Databricks + SQL combination is must The Azure Data Engineer (Lead) is a management-level role...

  • Lead Azure Data Engineer

    1 week ago

    Bangalore, India IQVIA Full time

    Work Experience: 9 to 13 Years Work location: Bengaluru Work Mode: Hybrid Must Have Skills: Data Engineering, Python, Azure Databricks, Database, People management experience Job Overview Manages a team of professional-level employees. Develops and communicates plans and priorities to meet team performance and results requirements. Essential Functions...

  • Azure Data Engineer

    1 week ago

    bangalore, India Elongo Global Solutions Full time

    🚀 About the Role We are looking for an experienced Azure Data Engineer to lead the design and implementation of scalable, high-performance data solutions on the Azure Data Platform. In this role, you will focus on integrating financial data from SAP BW and SAP BFC into Azure, establishing a robust and automated data foundation that supports advanced...

  • Senior Azure Data Engineer/Lead

    2 weeks ago

    bangalore, India Ekfrazo Technologies Private Limited Full time

    Role: Senior Data Engineer/LeadLocation : Bangalore , Noida, Gurgaon, Pune, Mumbai, Kochi – Bangalore ( preferred) – Hybrid Model ( weekly 2 days )Position 1 - Job Details – Data Engineer LeadExperience – 8 – 12 yrs - Data Engineer LeadKey skills : Databricks + SQL combination is mustThe Azure Data Engineer (Lead) is a management-level role...

  • Azure Data Engineer

    8 hours ago

    bangalore, India Wall Street Consulting Services LLC Full time

    Job description: Job Title: Azure Data Engineer Location: Onsite in Rayadurgam, Hyderabad Employment Type: Full-time About the Role: We are seeking an experienced Azure Data Engineer Architect with hands-on expertise in designing and implementing scalable data platforms in the Microsoft Azure ecosystem. The ideal candidate will have multiple end-to-end...

  • Azure Cloud Data Engineer

    3 weeks ago

    bangalore, India Intelebee Full time

    End-to-End Data Engineering We’re looking for a hands-on Cloud Data Engineer who’s an expert in Python, PySpark, and SQL — with proven experience building end-to-end data pipelines on Azure using Data Factory, Synapse, and Databricks . This role blends strong technical skills with sharp business understanding — ideal for someone who loves solving...

  • Azure Data Engineer

    7 days ago

    bangalore, India Inumellas Full time

    Position - Azure Data EngineerRole - Data Engineer & Senior Data EngineerExp range - 4 Yrs to 10 YrsPosition Type - Permanent FTELocations - Bengaluru, Chennai, HyderabadCompany - Global Leader in Data Analytics, Cloud and AINotice Period - Serving or Immediate Joiners ONLY (Need joining in November or before 15-Dec)Skills & Experience:5+ years of overall...

  • Senior Azure Data Engineer/Lead

    2 weeks ago

    bangalore district, India Ekfrazo Technologies Private Limited Full time

    Role: Senior Data Engineer/Lead Location : Bangalore , Noida, Gurgaon, Pune, Mumbai, Kochi – Bangalore ( preferred) – Hybrid Model ( weekly 2 days ) Position 1 - Job Details – Data Engineer Lead Experience – 8 – 12 yrs - Data Engineer Lead Key skills : Databricks + SQL combination is must The Azure Data Engineer (Lead) is a management-level role...