Data Engineer

7 days ago

kakinada, India beBeeCloud Full time

Senior Cloud Data Scientist for Graph Analytics PlatformJob Summary:Architect and implement distributed graph computing solutions processing large datasets using a microservices architecture.Lead the development of Entity Resolution and Network Generation services.Design and optimize large-scale Apache Spark workloads.Implement graph algorithms in distributed computing frameworks such as Apache Spark, Dask or equivalent with optimized queries and storage formats.Assist the team in building dynamic entity resolution with embedded graph knowledge of GNNs and GT.Key Responsibilities:Entity Resolution Service:Design and implement distributed entity resolution algorithms to process large datasets.Build blocking strategies optimized for Spark at scale.Create AI/ML based advanced matching with explainable AI.Implement incremental resolution supporting real-time and batch modes.Design APIs for entity lookup with sub-100ms latency requirements.Network Generation Service:Architect distributed graph generation pipelines using libraries such as GraphX/GraphFrames.Implement graph analytics algorithms such as PageRank, community detection, and centrality measures.Design storage strategies for multi-billion edge graphs in the cloud.Build temporal graph support for time-evolving networks.Create high-performance graph serving APIs with complex query capabilities.AI/ML Model Development & Explainable AI:Build Graph Neural Networks (GNNs) and models using neighbour sampling techniques such as GraphSAGE to analyze corporate and transaction networks for fraud and risk patterns.Implement AI-based entity resolution algorithms using techniques such as fuzzy matching, semantic matching, and clustering across heterogeneous data sources.Create risk scoring models by combining rule-based, supervised and unsupervised methods, optimized for real-time and large data processing.Requirements:3+ Years Of Experience In Distributed Computing And Big Data Systems.2+ Years' Experience In Entity Resolution And Graph Analytics At Scale.Strong Understanding Of Blocking Algorithms, Probabilistic Record Linkage, And Similarity Measures.Ability To Design And Optimize Large Apache Spark Workloads.Bonus:Master Or PhD In Computer Science Or Related Field With Focus On Graphs/Entity Resolution.Experience With Architecture Design And Implementation Of Large Scaled Graph Databases Or Equivalent.

  • Data Engineer

    7 days ago

    kakinada, India beBeeData Full time

    Job SummaryPrimesoft is looking for an experienced Data Engineer to join our team. As a key member of the Data Products group, you will be responsible for designing and developing data systems, including pipelines, APIs, analytics, AI, and machine learning at scale.This role emphasizes hands-on development, reliability, and collaboration with senior...

  • Senior data engineer

    4 weeks ago

    Kakinada, India InfoBeans Full time

    About the Job We are seeking a highly skilled Senior Data Engineer – Data Acquisition (ODS) to join our data engineering team. The ideal candidate will have extensive hands-on experience in building and optimizing data ingestion and transformation pipelines using Azure Data Platform , Databricks , Snowflake , and Kafka . You will be responsible for...

  • Senior Data Engineer

    5 days ago

    Kakinada, India Koantek Full time

    We are seeking an experienced Full Stack Data Engineer with 5–6 years of industry experience. The ideal candidate will have a proven track record of working on live projects, preferably within the manufacturing or energy sectors. He/she will play a key role in developing and maintaining scalable data solutions using PySpark, SQL, and modern data...

  • Principal Data Engineer

    7 days ago

    kakinada, India beBeeData Full time

    Foundry Engineer RoleJob Overview:This role presents a fantastic opportunity for a talented individual to work on a pivotal project utilizing Palantir Foundry and AIP. As part of our team, you will have the chance to design, build, and maintain scalable data pipelines, transformations, and applications within the Palantir ecosystem.Key...

  • Sr data engineer

    3 weeks ago

    Kakinada, India Futran Solutions Full time

    Job Title: Senior Data Engineer/ Data Engineer Lead Job Description: We are seeking a highly skilled and experienced Senior Data Engineer with a strong background in Microsoft Azure data platforms. The ideal candidate will have a proven track record of designing, implementing, and managing large-scale data solutions using Azure technologies. This role...

  • Azure Data Engineering Visionary

    5 days ago

    kakinada, India beBeeData Full time

    Azure Data Lead/ ArchitectWe are seeking an experienced Azure Data Lead/ Architect to spearhead our organization's data engineering initiatives.6+ years' experience in data engineering environmentsExpertise in CI-CD, PySpark, SQL, ADF, ADLS & ADBProficiency in Azure Services / Key Vault and GIT / Jenkins / Azure DevOpsThis role involves overseeing the...

  • High-Caliber Data Engineer

    3 days ago

    kakinada, India beBeePlatform Full time

    Job DescriptionSyntasa is seeking a high-caliber and dedicated Platform Engineer to join its India subsidiary. This position offers an exciting opportunity to contribute to the growth of a world-class development and support center.The India operations will serve as an extension of Syntasa's US-based software development and support functions.Design and...

  • Sustainability Data Engineer Lead

    7 days ago

    kakinada, India beBeeData Full time

    We are seeking a highly skilled Data Engineer Lead to spearhead our Sustainability Project.This role involves building data pipelines and models to support product-level carbon footprint analysis. Our goal is to integrate structured engineering, manufacturing, and supplier data into a unified model using Databricks on AWS.The successful candidate will be...

  • Remote Data Engineer Support

    7 days ago

    kakinada, India beBeeData Full time

    Remote Data Engineering OpportunityThis is a contract role that offers hands-on exposure to real-world business analysis activities, stakeholder engagement, and technology evaluation.About the RoleWe are seeking an experienced data engineer to support our team in designing, developing, and implementing secure and scalable data pipelines. The successful...

  • Cloud Data Engineer

    3 days ago

    kakinada, India beBeeDataArchitecture Full time

    About the RoleWe are seeking a skilled Data Architect with hands-on experience in designing and optimizing data pipelines, developing data architectures, and working on cloud-native data solutions.The ideal candidate should possess strong technical knowledge in AWS services, data integration, and real-time/batch data processing.Key Responsibilities:Design...