Senior Data Engineering Professional

1 day ago

nellore, India beBeeDataEngineer Full time

Key ResponsibilitiesWe are seeking a senior data engineer to design, build and maintain scalable data pipelines (batch and streaming) that support analytics, personalization and AI/ML use cases.This role involves developing, deploying and maintaining microservices and data APIs using Python frameworks like FastAPI or Flask.The successful candidate will also be responsible for building and optimizing distributed data processing jobs using technologies such as Apache Spark, Flink or Beam with a strong focus on streaming workloads.They will be expected to design and manage data models, warehouses and data marts; write efficient SQL for analytics and production workloads.This includes implementing and maintaining event-driven architectures using pub/sub or messaging systems.Additionally, the individual will set up and maintain CI/CD pipelines for data and application deployments.Containerization of services using Docker and management of deployments on Kubernetes-based infrastructure is also a key responsibility.Orchestration of complex data workflows using tools like Apache Airflow or Argo Workflows is another critical task.The ideal candidate will collaborate with ML and product teams to build and productionize LLM-powered applications (Agents, RAG-based systems etc.).They will also work with vector databases and retrieval systems for RAG and semantic search use cases.Ensuring data quality, reliability, observability and documentation across all pipelines and services is essential.RequirementsStrong expertise in designing, building and maintaining scalable data pipelines (batch and streaming).Proficiency in developing, deploying and maintaining microservices and data APIs using Python frameworks like FastAPI or Flask.Experience with building and optimizing distributed data processing jobs using technologies like Apache Spark, Flink or Beam.Ability to design and manage data models, warehouses and data marts.SQL skills are necessary for analytics and production workloads.Implementation and maintenance of event-driven architectures using pub/sub or messaging systems.Set up and maintenance of CI/CD pipelines for data and application deployments.Knowledge of containerization using Docker and deployment on Kubernetes-based infrastructure.Orchestration of complex data workflows using tools like Apache Airflow or Argo Workflows.Collaboration with ML and product teams to build and productionize LLM-powered applications.Work with vector databases and retrieval systems for RAG and semantic search use cases.BenefitsCompetitive compensation package.Opportunities for growth and professional development.Collaborative and dynamic work environment.Access to cutting-edge technologies and tools.Flexible work arrangements.Other InformationEqual employment opportunities are provided to all qualified applicants without regard to race, color, religion, sex, national origin, age, disability, veteran status, or any other characteristic protected by law.Applicants must meet the minimum qualifications for the position they apply for.

  • Data Engineering and Analytics Professional

    3 days ago

    nellore, India beBeeDataSpecialist Full time

    About the Role:The role focuses on evaluating learners' technical proficiency in data engineering, analytics, and cloud data platforms.Key responsibilities include designing quality audit frameworks, conducting structured technical interviews, developing comprehensive assessments, and reviewing coding challenges.Develop and execute quality audit frameworks...

  • Senior Data Engineer

    3 weeks ago

    Nellore, India Meril Full time

    🔍 We're Hiring: Senior Data Engineer We are looking for a highly skilled Senior Data Engineer to help build and scale our data pipelines and infrastructure. If you are passionate about modern data architectures, cloud platforms, and high-performance engineering, we want to meet you. 🔧 Key Technical Responsibilities - Design and build scalable ETL/ELT...

  • Senior data engineer

    3 weeks ago

    Nellore, India DataOrbit AI Full time

    Company Description Data Orbit AI is a leading AI consulting firm dedicated to empowering small and medium investment managers to achieve AI readiness. By uniting strategy, data preparation, technology, and execution, we enable organizations to adopt AI solutions that unlock growth opportunities and operational efficiencies. With expertise in AI strategy,...

  • Senior Data Engineer

    1 week ago

    nellore, India beBeeDataEngineer Full time

    We are seeking a skilled Data Engineer to join our team.About the RoleThis is an opportunity to work with cutting-edge technologies, build robust data pipelines, and drive business growth through data-driven decision making.Design, develop, and maintain ETL/ELT pipelines for various data sources using Lakehouse architecture.Work with cross-functional teams...

  • Senior Data Engineer Role

    2 weeks ago

    nellore, India beBeeExpertise Full time

    Data Migration SpecialistWe are seeking an experienced professional to lead and execute data migration initiatives from on-premises environments to cloud platforms, enabling seamless data transfer and unlocking business value.The ideal candidate will have hands-on experience with Databricks, a deep understanding of data engineering best practices, and the...

  • Senior Cloud Data Specialist

    2 weeks ago

    nellore, India beBeeData Full time

    Job Title:GCP Data Engineer position - A Key Role in Our OrganizationAbout the JobWe are seeking an experienced GCP Data Engineer to join our team. As a senior data professional, you will play a vital role in designing, building, and maintaining scalable data processing systems.Key ResponsibilitiesThe successful candidate will be responsible for the...

  • Senior Data Migration Professional

    2 weeks ago

    nellore, India beBeeSpecialist Full time

    Lead Integration SpecialistThis role requires an experienced professional to drive end-to-end integration and data migration solutions into Oracle ERP Cloud.Own all integration deliverables as SMELead end-to-end phases: requirements, design (HLD/LLD), build, UAT, implementation, hypercareBuild robust ETL/ELT pipelines for master & transactional data...

  • Data Warehousing Professional

    7 days ago

    nellore, India beBeeDataWarehousing Full time

    About the RoleA data warehousing professional is required to work with our team. The ideal candidate will have experience in one or more cloud platforms, preferably Azure, AWS, or GCP.Key ResponsibilitiesData Manipulation and Engineering Tasks: Strong experience in SQL and data manipulation techniques is necessary for handling large datasets and complex data...

  • Azure Data Engineer

    2 weeks ago

    Nellore, India EXL Full time

    JobDescription:We are seeking a highly skilled Senior Data Engineer with strong expertise in Azure data ecosystem, Snowflake, and modern data transformation frameworks. The ideal candidate will have extensive hands-on experience in Azure Data Factory, DBT, SQL, and Azure DevOps, with a solid understanding of CI/CD implementation for data pipelines. Excellent...

  • Azure Data Engineer

    2 weeks ago

    Nellore, India EXL Full time

    JobDescription:We are seeking a highly skilled Senior Data Engineer with strong expertise in Azure data ecosystem, Snowflake, and modern data transformation frameworks. The ideal candidate will have extensive hands-on experience in Azure Data Factory, DBT, SQL, and Azure DevOps, with a solid understanding of CI/CD implementation for data pipelines. Excellent...