Azure Data Engineer-Technical Lead

4 weeks ago

Thrissur, India Sigmoid Full time

Kindly find the Job Description Below.Job Title:Technical Lead-Azure Data EngineerLocation: BangaloreYears of Experience: 10+ years of experienceSigmoid works with a variety of clients from start-ups to fortune 500 companies. We are looking for a detailed oriented self-starter to assist our engineering and analytics teams in various roles as a Software Development Engineer.As an Technical Lead- Data Engineer, you will be responsible for building a highly-scalable and extensible big data platform that provides the foundation for collecting, storing, modeling, and analyzing massive data sets from multiple channels.We are looking for a skilled Data Engineer with 10+ years of experience in big data technologies, particularly Azure, Python, PYSpark, SQL and data lakehouse architectures. The ideal candidate will have a strong background in building scalable data pipelines and experience with modern data storage formats, including Apache Iceberg. You will work closely with cross-functional teams to design and implement efficient data solutions in a cloud-based environment.Key Responsibilities:Data Pipeline Development:Design, build, and optimize scalable data pipelines using Apache Spark.Implement and manage large-scale data processing solutions across data lakehouses.Data Lakehouse Management:Work with modern data lakehouse platforms (e.g.Apache Iceberg) to handle large datasets.Optimize data storage, partitioning, and versioning to ensure efficient access and querying.SQL & Data Management:Write complex SQL queries to extract, manipulate, and transform data.Develop performance-optimized queries for analytical and reporting purposes.Data Integration:Integrate various structured and unstructured data sources into the lakehouse environment.Work with stakeholders to define data needs and ensure data is available for downstream consumption.Data Governance and Quality:Implement data quality checks and ensure the reliability and accuracy of data.Contribute to metadata management and data cataloging efforts.Performance Tuning:Monitor and optimize the performance of Spark jobs, SQL queries, and overall data infrastructure.Work with cloud infrastructure teams to optimize costs and scale as needed.Qualifications:Bachelor’s or Master’s degree in Computer Science, Information Technology, or a related field.9+ years of experience in data engineering, with a focus on Java/python, Spark and SQL Programming languages.Hands-on experience with Apache Iceberg, Snowflake, or similar technologies.Strong understanding of data lakehouse architectures and data warehousing principles.Proficiency in AWS data services.Experience with version control systems like Git and CI/CD pipelines.Excellent problem-solving and analytical skills.Strong communication and collaboration skills.Nice to Have:Experience with containerization (Docker, Kubernetes) and orchestration tools like Airflow.Certifications in Azure cloud technologies

  • Lead Azure Data Solutions Developer

    1 week ago

    thrissur, India beBeeData Full time

    Azure Data Engineer Job DescriptionWe are seeking an experienced Azure Data Engineer to design, develop, and maintain our data platform and systems required for data storage, processing, and analysis.]Data Engineering Responsibilities:Design and develop data solutions using Azure Databricks, Azure Data Factory (ADF), Azure Data Lake Storage (ADLS), Event...

  • Azure Data Solutions Architect

    7 days ago

    thrissur, India beBeeDataEngineer Full time

    Job Title: Azure Data EngineerAzure Data Engineer RoleWe are seeking an experienced Azure Data Engineer to design and implement a scalable, Azure-based Central Asset Registry.This role involves integrating data from 120+ SQL Server e-Quip databases and 130+ CSV-based hospital systems.The engineer will be responsible for validating architecture decisions...

  • Lead AI Architect and Data Science Innovator

    2 weeks ago

    thrissur, India beBeeDataScientist Full time

    Senior Data Scientist SME and AI ArchitectAs a Senior Data Scientist Subject Matter Expert (SME) with over 10 years of experience, you will lead our advanced analytics and AI initiatives. This pivotal role requires deep technical mastery across large-scale Big Data technologies, multi-cloud environments, and cutting-edge specialized AI domains.Key...

  • Senior Technical Project Lead

    6 days ago

    thrissur, India beBeeTechnicalProgramManager Full time

    Role Overview:We are seeking a seasoned Tech Lead to oversee the development of complex projects, drive innovation, and foster strong relationships with our clients.Key Responsibilities:Mentor and lead cross-functional teams in delivering high-quality software solutions.Develop and execute project plans, ensuring timely completion and optimal resource...

  • Linux Technical Lead

    4 weeks ago

    Thrissur, India HashRoot Full time

    Job Title: Linux Technical Lead – Server Administration, Web Hosting & Data Center OperationsLocation: Kochi, KeralaExperience: 10+ YearsType: Full-time / PermanentOverviewWe are seeking an experienced Linux Technical Lead to oversee and optimize our end-to-end infrastructure covering web hosting platforms, Linux server administration, virtualization...

  • Sr. data architect

    3 weeks ago

    Thrissur, India TUTOADDA Full time

    Senior Data Architect – SnowflakeLocation: Trivandrum / Kochi (Hybrid / Remote Flexibility) Experience: 10+ Years Budget: Up to ₹30 LPA Notice Period: Immediate Joiners Preferred Working Hours: 12 PM – 9 PM IST (Mandatory EST Overlap) We are looking for an experienced Senior Data Architect with strong expertise in Snowflake, enterprise data...

  • Lead Data Infrastructure Specialist

    2 weeks ago

    thrissur, India beBeeDataArchitect Full time

    Senior Data Architect PositionJob Description:We are seeking an experienced Senior Data Architect with 10+ years in data engineering, data warehousing, and large-scale data platform design. The ideal candidate must have strong hands-on expertise in Snowflake, data architecture, ETL processes, and large data migration solutioning. The role involves leading...

  • Technical Data Expert

    7 days ago

    thrissur, India beBeeDataSupportEngineer Full time

    Data Support Engineer RoleAt our organization, we're seeking a skilled Data Support Engineer to collaborate with our team and contribute to the success of our projects.Identify and resolve data support issues within specified service level agreements (SLA).Adhere to defined guidelines and rules to address these issues efficiently.Provide customers with...

  • Senior Data Scientist

    2 days ago

    Thrissur, Kerala, India HireFlex Full time

    Senior Data ScientistPosition OverviewWe are seeking a highly skilledSenior Data Scientistto lead advanced analytics projects and deliver end-to-end data solutions. The ideal candidate will have extensive experience turning complex datasets into actionable insights through robust statistical and machine learning models. You will work closely with...

  • Azure Cloud Data Engineer Specialist

    2 weeks ago

    thrissur, India beBeeDataEngineering Full time

    Data Engineering ExpertiseAzure data infrastructure is shaped by skilled professionals who design and implement scalable pipelines, optimize database performance, and ensure seamless data flow.Key Skills:Databricks (Expert)Data ArchitectureBig DataCloud ComputingProgrammingThe ideal candidate will have 5-10 years of experience in cloud data engineering with...