Azure Data Engineer-Technical Lead

1 day ago

Thrissur, India Sigmoid Full time

Kindly find the Job Description Below.Job Title:Technical Lead-Azure Data EngineerLocation: BangaloreYears of Experience: 10+ years of experienceSigmoid works with a variety of clients from start-ups to fortune 500 companies. We are looking for a detailed oriented self-starter to assist our engineering and analytics teams in various roles as a Software Development Engineer.As an Technical Lead- Data Engineer, you will be responsible for building a highly-scalable and extensible big data platform that provides the foundation for collecting, storing, modeling, and analyzing massive data sets from multiple channels.We are looking for a skilled Data Engineer with 10+ years of experience in big data technologies, particularly Azure, Python, PYSpark, SQL and data lakehouse architectures. The ideal candidate will have a strong background in building scalable data pipelines and experience with modern data storage formats, including Apache Iceberg. You will work closely with cross-functional teams to design and implement efficient data solutions in a cloud-based environment.Key Responsibilities:Data Pipeline Development:Design, build, and optimize scalable data pipelines using Apache Spark.Implement and manage large-scale data processing solutions across data lakehouses.Data Lakehouse Management:Work with modern data lakehouse platforms (e.g.Apache Iceberg) to handle large datasets.Optimize data storage, partitioning, and versioning to ensure efficient access and querying.SQL & Data Management:Write complex SQL queries to extract, manipulate, and transform data.Develop performance-optimized queries for analytical and reporting purposes.Data Integration:Integrate various structured and unstructured data sources into the lakehouse environment.Work with stakeholders to define data needs and ensure data is available for downstream consumption.Data Governance and Quality:Implement data quality checks and ensure the reliability and accuracy of data.Contribute to metadata management and data cataloging efforts.Performance Tuning:Monitor and optimize the performance of Spark jobs, SQL queries, and overall data infrastructure.Work with cloud infrastructure teams to optimize costs and scale as needed.Qualifications:Bachelor’s or Master’s degree in Computer Science, Information Technology, or a related field.9+ years of experience in data engineering, with a focus on Java/python, Spark and SQL Programming languages.Hands-on experience with Apache Iceberg, Snowflake, or similar technologies.Strong understanding of data lakehouse architectures and data warehousing principles.Proficiency in AWS data services.Experience with version control systems like Git and CI/CD pipelines.Excellent problem-solving and analytical skills.Strong communication and collaboration skills.Nice to Have:Experience with containerization (Docker, Kubernetes) and orchestration tools like Airflow.Certifications in Azure cloud technologies

  • Data engineer

    2 weeks ago

    Thrissur, India Philodesign Technologies Inc Full time

    Job Title: Data Engineer Experience: 6–8 Years Work Mode: Remote (9 AM – 5 PM EST) Employment Type: Full-time Notice Period: Immediate Joiner About the Role We are seeking an experienced Data Engineer to design, develop, and implement robust data exchange and processing solutions using Azure technologies. The ideal candidate will have strong hands-on...

  • Data Engineer

    2 weeks ago

    Thrissur, India Philodesign Technologies Inc Full time

    Job Title: Data EngineerExperience: 6–8 YearsWork Mode: Remote (9 AM – 5 PM EST)Employment Type: Full-timeNotice Period: Immediate JoinerAbout the RoleWe are seeking an experienced Data Engineer to design, develop, and implement robust data exchange and processing solutions using Azure technologies. The ideal candidate will have strong hands-on expertise...

  • AI Engineer – Azure AI Specialist

    4 weeks ago

    Thrissur, India High Volt Analytics Full time

    Company DescriptionHigh Volt Analytics assists medium to large organizations in becoming AI ready, starting with Finance & Accounts automation. We focus on automating financial processes to deliver real-time insights and error-free reports, integrating data into a secure AI-ready foundation, offering interactive AI-powered insights, and developing enterprise...

  • Senior Technical Lead

    1 week ago

    Thrissur, India HCLTech Full time

    Role Overview We are seeking a highly skilled and experienced Senior MicroStrategy Developer to join our team. In this role, you will play a pivotal part in designing, developing, and optimizing business intelligence solutions, leveraging the MicroStrategy platform to drive data-driven decision-making across the organization. Responsibilities • Architect...

  • Lead Engineer

    3 days ago

    thrissur, India Synechron Full time

    Greetings,We currently have an urgent opening for a Lead Full Stack Engineer with more than 8 years of experience at Synechron in Bangalore.Job Role: - Sr. Lead Full Stack EngineerJob Location- GTP Bangalore.Work Mode - Weekly Hybrid (3 days from Office and 2 days from home)Experience: 8 – 15 YearsDomain: Banking / Corporate Banking / PaymentsAbout...

  • Azure Backend Engineer

    3 days ago

    Thrissur, India Big Rattle Technologies | Big Rattle AI Full time

    Position: Azure Backend Engineer (.NET Developer) (8 - 10 years)Location: Remote (Company in Mumbai)Company: Big Rattle Technologies Private LimitedImmediate Joiners only.We are seeking an experienced Software Engineer proficient in modern .NET (8 or higher), Microsoft Azure, and Terraform to join our team in building scalable backend cloud solutions. You...

  • Senior Data Engineer

    1 week ago

    Thrissur, India American Inference Full time

    Note: Please apply directly through LinkedIn for this position. We kindly request that candidates refrain from contacting company officials via email or messages regarding this role. About the Company We are an AI and Data Consulting Startup transforming how businesses leverage technology through four core service lines: - Consulting Services: AI Strategy,...

  • Machine Learning Engineer

    4 weeks ago

    Thrissur, India BayOne Solutions Full time

    Responsibilities: Machine Learning Development & Implementation (40%) Design and implement end-to-end ML pipelines for recommendation systems, search ranking, and classification problems Build and optimize traditional ML models using techniques such as ensemble methods, SVMs, gradient boosting, and neural networks Develop time series forecasting models and...

  • Azure Integration Developer

    4 weeks ago

    Thrissur, India Brace Infotech Private Ltd Full time

    Design, develop, and deploy enterprise-level application integration solutions using Azure Logic Apps, Azure Functions (C# or JavaScript), Azure Service Bus, and Azure Event Grid.About the RoleImplement and manage Azure API Management (APIM) gateways to secure, publish, and govern APIs for both internal and external consumption.ResponsibilitiesDevelop robust...

  • Senior data architect- snowflake

    2 days ago

    Thrissur, India USEReady Full time

    USEReady is a data and analytics firm that provides the strategies, tools, capability, and capacity that businesses need to turn their data into a competitive advantage. USEReady partners with cloud and data ecosystem leaders like Tableau, Salesforce, Snowflake and Amazon Web Services, and has been named Tableau partner of the year multiple times. We are...