Senior data engineer

2 weeks ago

Thrissur, India Infogain Full time

Job Summary:Big Data Engineer (Lead): As a Big Data Engineer (Lead), you will be responsible for leading a team of big data engineers. You will work closely with clients and team members to understand their requirements and develop architectures that meet their needs. You will also be responsible for providing technical leadership and guidance to your team.Job Description:Job Profile Summary:In this role, you will support the Data Engineering team in setting up the Data Lake on Cloud and the implementation of standardized Data Model, single view of customer. You will develop data pipelines for new sources, data transformations within the Data Lake , implementing graphql , work on no sql database, CI/CD and data delivery as per the business requirements.Job Description:· Build pipelines to bring in wide variety of data from multiple sources within the organization as well as from social media and public data sources.· Collaborate with cross functional teams to source data and make it available for downstream consumption.· Work with the team to provide an effective solution design to meet business needs.· Ensure regular communication with key stakeholders, understand any key concerns in how the initiative is being delivered or any risks/issues that have either not yet been identified or are not being progressed.· Ensure dependencies and challenges (risks) are escalated and managed. Escalate critical issues to the Sponsor and/or Head of Data Engineering.· Ensure timelines (milestones, decisions and delivery) are managed and value of initiative is achieved, without compromising quality and within budget.· Ensure an appropriate and coordinated communications plan is in place for initiative execution and delivery, both internal and external.· Ensure final handover of initiative to business-as-usual processes, carry out a post implementation review (as necessary) to ensure initiative objectives have been delivered, and any lessons learned are fed into future initiative management processes. Who we are looking for:Competencies & Personal Traits· Work as a team player· Excellent problem analysis skills. Good in the Azure Databricks platform· Experience with at least one Cloud Infra provider (Azure/AWS)· Experience in building data pipelines using batch processing with Apache Spark (Spark SQL, Dataframe API) or Hive query language (HQL)· Experience in building streaming data pipeline using Apache Spark Structured Streaming or Apache Flink on Kafka & Delta Lake· Knowledge of NOSQL databases. Good to have experience in Cosmos DB, Restful API’s and Graph QL· Knowledge of Big data ETL processing tools, Data modelling and Data mapping.· Experience with Hive and Hadoop file formats (Avro / Parquet / ORC)· Basic knowledge of scripting (shell / bash)· Experience of working with multiple data sources including relational databases (SQL Server / Oracle / DB2 / Netezza), No SQL / document databases, flat files· Basic understanding of CI CD tools such as Jenkins, JIRA, Bitbucket, Artifactory, Bamboo and Azure Dev-ops.· Basic understanding of Dev Ops practices using Git version control· Ability to debug, fine tune and optimize large scale data processing jobs

  • Senior Data Engineer

    2 weeks ago

    Thrissur, Kerala, India DAIC Full time

    Company DescriptionAs a technology consulting and delivery company, DAIC partners with businesses to unlock the power of their data, optimize their technology infrastructure, and drive data-driven success. We provide expert guidance and solutions in data analytics and cloud technologies. Our mission is to empower businesses to transform data into actionable...

  • Data Engineer

    3 weeks ago

    Thrissur, Kerala, India People Tech Group Inc Full time

    Practice Lead – Data PractitionerLocation: HyderabadDepartment: Data & AI StrategyJob Summary:We are seeking a dynamic and technically accomplished Practice Lead – Data Engineering & Data Science to lead the development of scalable, high-performance data platforms and advanced analytics capabilities across the enterprise. This role combines deep...

  • Senior Data Scientist

    2 weeks ago

    Thrissur, India Jk Lucent Pvt Ltd Full time

    Job Title: Senior Data Scientist Experience: 5+ years Location: Infopark, Koratty, Kerala Job Type: Full Time Job Summary: We are looking for a highly skilled Senior Data Scientist to join the team at JK Lucent. The ideal candidate will bring a strong background in developing and deploying machine learning models, extracting actionable insights from complex...

  • Data engineer

    3 days ago

    Thrissur, India RevX Full time

    Data Engineer About Rev XRev X helps app businesses acquire and reengage users via programmatic to retain, monetize, and accelerate revenue. We're all about taking your app businesses to a new growth level. We rely on data science, innovative technology, and AI, and a skilled team, to create and deliver seamless ad experiences to delight your app users....

  • Senior AI Engineer

    3 weeks ago

    Thrissur, Kerala, India BugRaid AI Full time

    Location: Hyderabad/Bangalore/SingaporeAbout BugRaid.AIIncidents are the silent killers of modern enterprises. Every minute of downtime means lost revenue, lost trust, and engineers under fire.BugRaid.AI is building the world's first enterprise-ready incident copilot — intelligent, agentic systems that can detect, diagnose, and resolve complex production...

  • Senior Data Scientist

    1 week ago

    Thrissur, India Delivery Hero Full time

    About Delivery Hero: As the world’s leading local delivery platform, our mission is to deliver an amazing experience, fast, easy, and to your door. We operate in over 70+ countries worldwide, powered by tech but driven by people. As one of Europe’s largest tech platforms, we enable ambitious talent to deliver solutions that create impact within our...

  • PySpark Data Engineer

    3 weeks ago

    Thrissur, Kerala, India BLS360 Full time

    Role OverviewThis is a contract remote role. We are seeking a highly motivated PySpark Data Engineer with 3–4 years of experience in building, optimizing, and maintaining large-scale data processing solutions. The ideal candidate will bring hands-on expertise in PySpark, Python, SQL, and real-time data streaming and will contribute to the design and...

  • Senior GIS Data Migration Specialist

    4 weeks ago

    Thrissur, Kerala, India Gnapi Technologies Full time

    Job Title: Senior GIS Data Migration Specialist (FME & Utility Network Expert)Location: HyderabadDepartment: UtilityEmployment Type: Full-timeEducation: Bachelor's or Master's degree in Geoinformatics, Computer Science, Geography, or related field.Experience: 7+ yearsCompany: Gnapi Technologies., is an Information Technology Company with registered offices...

  • Senior QA Engineer

    6 days ago

    Thrissur, India ZettaMine Labs Pvt. Ltd. Full time

    Hello,Greetings From ZettaMine!!!Job Title: Senior QA EngineerLocation: Bangalore, IndiaMandatory Skill: Playwright (TypeScript)Position OverviewWe are seeking an experienced Senior QA Engineer with deep expertise in test automation frameworks, API testing, and CI/CD integrations. The ideal candidate will have hands-on experience with Playwright...

  • Lead Data Engineer | Revenue Cycle Management Platform in Healthcare | YoE

    3 weeks ago

    Thrissur, Kerala, India Geektrust Full time

    LogixHealth, a Massachusetts-based physician-founded leader in healthcare revenue cycle management, with over 20 years of experience serving providers across 40+ states, is seeking a Senior/Principal Data Engineer to join our technology team.What You'll DoLead development of a self-service data platform for reporting and analytics.Build scalable data...