Azure Data Engineer-Technical Lead

12 hours ago

bangalore, India Sigmoid Full time

Kindly find the Job Description Below. Job Title:Technical Lead-Azure Data Engineer Location: Bangalore Years of Experience: 10+ years of experience Sigmoid works with a variety of clients from start-ups to fortune 500 companies. We are looking for a detailed oriented self-starter to assist our engineering and analytics teams in various roles as a Software Development Engineer. As an Technical Lead- Data Engineer, you will be responsible for building a highly-scalable and extensible big data platform that provides the foundation for collecting, storing, modeling, and analyzing massive data sets from multiple channels. We are looking for a skilled Data Engineer with 10+ years of experience in big data technologies, particularly Azure, Python, PYSpark, SQL and data lakehouse architectures. The ideal candidate will have a strong background in building scalable data pipelines and experience with modern data storage formats, including Apache Iceberg. You will work closely with cross-functional teams to design and implement efficient data solutions in a cloud-based environment. Key Responsibilities: Data Pipeline Development: Design, build, and optimize scalable data pipelines using Apache Spark. Implement and manage large-scale data processing solutions across data lakehouses. Data Lakehouse Management: Work with modern data lakehouse platforms (e.g.Apache Iceberg) to handle large datasets. Optimize data storage, partitioning, and versioning to ensure efficient access and querying. SQL & Data Management: Write complex SQL queries to extract, manipulate, and transform data. Develop performance-optimized queries for analytical and reporting purposes. Data Integration: Integrate various structured and unstructured data sources into the lakehouse environment. Work with stakeholders to define data needs and ensure data is available for downstream consumption. Data Governance and Quality: Implement data quality checks and ensure the reliability and accuracy of data. Contribute to metadata management and data cataloging efforts. Performance Tuning: Monitor and optimize the performance of Spark jobs, SQL queries, and overall data infrastructure. Work with cloud infrastructure teams to optimize costs and scale as needed. Qualifications: Bachelor’s or Master’s degree in Computer Science, Information Technology, or a related field. 9+ years of experience in data engineering, with a focus on Java/python, Spark and SQL Programming languages. Hands-on experience with Apache Iceberg, Snowflake, or similar technologies. Strong understanding of data lakehouse architectures and data warehousing principles. Proficiency in AWS data services. Experience with version control systems like Git and CI/CD pipelines. Excellent problem-solving and analytical skills. Strong communication and collaboration skills. Nice to Have: Experience with containerization (Docker, Kubernetes) and orchestration tools like Airflow. Certifications in Azure cloud technologies

  • Azure Data Engineer-Technical Lead

    20 hours ago

    bangalore, India Sigmoid Full time

    Kindly find the Job Description Below.Job Title:Technical Lead-Azure Data EngineerLocation: BangaloreYears of Experience: 10+ years of experienceSigmoid works with a variety of clients from start-ups to fortune 500 companies. We are looking for a detailed oriented self-starter to assist our engineering and analytics teams in various roles as a Software...

  • Lead Data Engineer

    7 days ago

    bangalore, India NexGen Tech Solutions Full time

    Job Title: Lead Data Engineer – Wealth ManagementLocation: [Noida/Gurgaon/Remote]Experience: 10+ yearsMust Have: Wealth Management Domain, Fabric, Data Lake, PythonJob Summary:We are seeking a highly skilled Lead Data Engineer (Azure) with deep expertise in the Wealth Management domain to design, implement, and manage scalable data solutions.Experience in...

  • Lead Azure Data Engineer

    1 week ago

    Bangalore, India IQVIA Full time

    Work Experience: 9 to 13 Years Work location: Bengaluru Work Mode: Hybrid Must Have Skills: Data Engineering, Python, Azure Databricks, Database, People management experience Job Overview Manages a team of professional-level employees. Develops and communicates plans and priorities to meet team performance and results requirements. Essential Functions...

  • Senior Azure Data Engineer/Lead

    2 weeks ago

    bangalore, India Ekfrazo Technologies Private Limited Full time

    Role: Senior Data Engineer/Lead Location : Bangalore , Noida, Gurgaon, Pune, Mumbai, Kochi – Bangalore ( preferred) – Hybrid Model ( weekly 2 days ) Position 1 - Job Details – Data Engineer Lead Experience – 8 – 12 yrs - Data Engineer Lead Key skills : Databricks + SQL combination is must The Azure Data Engineer (Lead) is a management-level role...

  • Azure Data Engineer

    1 week ago

    bangalore, India Elongo Global Solutions Full time

    🚀 About the Role We are looking for an experienced Azure Data Engineer to lead the design and implementation of scalable, high-performance data solutions on the Azure Data Platform. In this role, you will focus on integrating financial data from SAP BW and SAP BFC into Azure, establishing a robust and automated data foundation that supports advanced...

  • Senior Azure Data Engineer/Lead

    2 weeks ago

    bangalore, India Ekfrazo Technologies Private Limited Full time

    Role: Senior Data Engineer/LeadLocation : Bangalore , Noida, Gurgaon, Pune, Mumbai, Kochi – Bangalore ( preferred) – Hybrid Model ( weekly 2 days )Position 1 - Job Details – Data Engineer LeadExperience – 8 – 12 yrs - Data Engineer LeadKey skills : Databricks + SQL combination is mustThe Azure Data Engineer (Lead) is a management-level role...

  • Azure Data Engineer

    8 hours ago

    bangalore, India Wall Street Consulting Services LLC Full time

    Job description: Job Title: Azure Data Engineer Location: Onsite in Rayadurgam, Hyderabad Employment Type: Full-time About the Role: We are seeking an experienced Azure Data Engineer Architect with hands-on expertise in designing and implementing scalable data platforms in the Microsoft Azure ecosystem. The ideal candidate will have multiple end-to-end...

  • Azure Cloud Data Engineer

    3 weeks ago

    bangalore, India Intelebee Full time

    End-to-End Data Engineering We’re looking for a hands-on Cloud Data Engineer who’s an expert in Python, PySpark, and SQL — with proven experience building end-to-end data pipelines on Azure using Data Factory, Synapse, and Databricks . This role blends strong technical skills with sharp business understanding — ideal for someone who loves solving...

  • Azure Data Engineer

    7 days ago

    bangalore, India Inumellas Full time

    Position - Azure Data EngineerRole - Data Engineer & Senior Data EngineerExp range - 4 Yrs to 10 YrsPosition Type - Permanent FTELocations - Bengaluru, Chennai, HyderabadCompany - Global Leader in Data Analytics, Cloud and AINotice Period - Serving or Immediate Joiners ONLY (Need joining in November or before 15-Dec)Skills & Experience:5+ years of overall...

  • Azure Data Engineer

    1 week ago

    bangalore, India Tata Consultancy Services Full time

    Greetings from TCS!Job Title: Azure Data Engineer With DatabricksRequired Skillset: Azure Databricks, SQL, Python, Spark.Location: HYD, Chennai, BLR, Noida, Pune, KolkataExperience Range: 4-8 yearsJob DescriptionMust-Have**1. Design, develop, and deploy data processing solutions using Azure Databricks.2. Collaborate with data engineers, architects, and...