High-Level Data Engineering Specialist

6 days ago

pushkar, India beBeeDataEngineer Full time

Senior Data Engineer PositionWe are seeking a seasoned data engineer to lead the design, development, and maintenance of complex data pipelines that support our operational data store (ODS) modernization and migration to AWS.This role involves implementing the migration of data from legacy systems, developing real-time streaming applications, and supporting the data needs of microservices and shared service teams.Key responsibilities include:Designing and implementing data pipelines for batch and real-time data ingestion into AWSMigrating data from legacy systems to target AWS data stores (Aurora, DynamoDB, S3, Redshift)Developing and optimizing streaming data applications using Kafka, Kafka Connect, and/or AWS Kinesis/EventBridgeImplementing data validation, cleansing, and transformation logic based on specifications from the data architectDeveloping data quality checks, exception handling, and reconciliation processes to ensure system of record accuracyCreating and managing data APIs and services to expose data securely to consuming microservicesCollaborating with development teams to implement optimal data storage solutions (SQL/NoSQL) for their servicesOptimizing pipeline performance, monitoring, and alerting for reliability and scalabilityPartnering with the data architect to translate logical data models into physical implementations and working pipelinesDeveloping and maintaining data lineage documentation and pipeline metadataTroubleshooting data quality issues across the ingestion and transformation layersCollaborating with domain teams to understand source system data structures and integration requirementsCollaborating with DevOps to containerize data applications (Docker) and deploy them on Kubernetes (EKS)Supporting the integration of data platforms with CIAM for security and API Gateway for managementMentoring data engineers on pipeline development best practices and AWS data servicesParticipating in architecture reviews and providing input on pipeline feasibility and performance implicationsRequired qualifications include:Bachelor's or Master's degree in Computer Science, Information Systems, Data Science, or related fieldStrong proficiency in Python and JavaHands-on experience with AWS data services (S3, Glue, Lambda, RDS, DynamoDB, Redshift, Kinesis, Aurora)Proven expertise building data pipelines for real-time and batch ingestion at scalePractical experience building and maintaining streaming applications using Apache Kafka or similar platformsSolid SQL skills and experience working with relational databasesExperience with data quality frameworks, validation patterns, and exception handlingHands-on experience with ETL/ELT design patterns and data transformation logicUnderstanding of data modeling concepts and ability to translate logical models into physical implementationsExperience with infrastructure-as-code tools (Terraform, CloudFormation) and CI/CD pipelinesSolid understanding of data governance, lineage, and metadata management practices

  • High-Level Data Architect

    2 weeks ago

    pushkar, India beBeePlatform Full time

    As a key contributor to our engineering group, we are seeking a skilled Platform Engineer with expertise in designing and developing scalable data pipelines and platform services using Python, Apache Spark, and Databricks.We are looking for a seasoned engineer who can design and develop maintainable data pipelines and platform services using Python, Apache...

  • High-Quality Data Annotation Specialist Wanted

    2 weeks ago

    pushkar, India beBeeDataAnnotation Full time

    Data Annotation Specialist RoleWe are a leading data engineering organization, working with prominent technology companies worldwide.Our team combines cutting-edge machine learning and artificial intelligence technologies with a global workforce of subject matter experts to help drive AI advancements.This role involves reviewing and labeling online content...

  • High-Level AS400 Specialist

    1 week ago

    pushkar, India beBeeas400 Full time

    As400 Developer OpportunityJob Description:We are seeking an experienced professional to fill a key role in our IBM iSeries environment. The successful candidate will be proficient in various technologies, including RPG/LE, COBOL/400, SQL, and DB2/400, as well as tools such as Query/400, QM Query, and IFS.Responsibilities:Minimum of 5-10 years of experience...

  • Data Platform Specialist

    1 week ago

    pushkar, India beBeeData Full time

    Data Platform Specialist RoleWe seek a seasoned professional to lead the design and implementation of cutting-edge data platforms on leading cloud platforms. The ideal candidate has extensive experience, with at least a few years in data-driven industries.Design scalable data platform architectures that meet business needsBuild solutions using best-practice...

  • Data Engine Architect

    6 days ago

    pushkar, India beBeeSpecialist Full time

    Information Retrieval SpecialistWe're seeking an experienced Information Retrieval Specialist to join our team. As a key member of our data engine, you will design and implement search solutions using OpenSearch/Elasticsearch.Key Responsibilities:Develop custom query builders and search pipelines tailored to business requirements.Leverage LLMs and AI for...

  • Data Analyst Specialist

    1 week ago

    pushkar, India beBeeBusiness Full time

    Reporting specialists design and deliver high-quality reports across cloud modules, working closely with business teams to gather reporting requirements. They translate these into technical solutions, developing and customizing reports, dashboards, and analytics.Developing strong skills in OTBI, BI Publisher, and SQL is essential for success. Reporting...

  • Cloud Data Engineer

    2 weeks ago

    pushkar, India beBeeData Full time

    Cloud Data Warehouse SpecialistWe are seeking an experienced and skilled Cloud Data Warehouse Specialist to design and develop a modern, cloud-native data warehouse on AWS.This role is critical to building a scalable, secure, and efficient data platform that supports analytics, reporting, and AI use cases across the organization.The ideal candidate is both...

  • High-Performance Python Developer

    7 days ago

    pushkar, India beBeeDatastructures Full time

    Job Title:Python Systems EngineerAbout the Role:We are seeking a highly skilled Python systems engineer to build, test, and optimize high-performance systems used in large-scale AI and data pipelines. As part of our team, you will design and maintain modular, clean, and production-ready Python codebases, collaborating with cross-functional teams to deliver...

  • AI Training Data Specialist

    6 days ago

    pushkar, India beBeeAnnotation Full time

    We are seeking a detail-oriented and tech-savvy individual to join our team as an annotation specialist. In this role, you will play a crucial part in helping us build high-quality AI training datasets.As an annotation specialist, your primary responsibility will be to review and label online content, ensuring data accuracy and consistency. Your work will...

  • High Performance Tech Specialist

    1 week ago

    pushkar, India beBeeEngineer Full time

    About UsAt a cutting-edge tech firm, we're reimagining how teams work—by building intelligent AI-native workflows and agentic platforms tailored to real-world needs.Role Overview We are seeking a Senior Backend Engineer who can own core backend systems, ship fast, and build scalable infrastructure to power intelligent agent workflows and AI-native...