Data engineer

2 days ago

Anantapur, India Jade Business Services Full time

Role: Data Engineer (AI Knowledge Base Platform)Experience: 4 years to 7 yearsWork location: Anywhere in India (Remote)Notice period: Immediate to 15 daysShift timing: 3:00 PM to 12:00 AM (IST)Budget: As per market stdWe are seeking a Data Engineer to design and maintain the ingestion, processing, and transformation pipelines that feed AI knowledge bases on GCP. The engineer will be responsible for ensuring reliable, scalable, and secure data movement across multiple sources, powering Retrieval-Augmented Generation (RAG) pipelines and automated agent deployment.Required Skills & Qualifications:4+ years of Data engineering experience.Strong programming skills in Python and SQL.Proficiency with GCP data services: Big Query, Cloud Storage, Dataflow, Pub/Sub, Composer/Airflow.Experience with ETL/ELT pipeline design and workflow orchestration.Familiarity with vector databases/embeddings (e.g., Pinecone, FAISS, Vertex AI Matching Engine).Knowledge of data modeling, governance, and version control.Experience with CI/CD, Docker, and Kubernetes for data pipeline deployment.Strong analytical and debugging skills.Key Responsibilities:Design and implement data ingestion pipelines from GCS, Big Query, and Google Drive.Build workflows for knowledge base indexing/vectorization (RAG pipelines).Implement incremental updates, targeted revisions, and full rebuild options for AI agents.Collaborate with ML Engineers to integrate data pipelines with Vertex AI models.Optimize pipelines for cost, performance, and scalability within GCP.Ensure data quality, governance, and security with IAM-based access control.Maintain logging, monitoring, and alerting for pipeline health.Work with Dev Ops to enable self-healing and rollback automation. About JBS:Jade Business Services (JBS) is a US-based company specializing in Data and Analytics solutions for industries such as Energy, Oil & Gas, Healthcare, and Finance. We help our customers become data-driven organizations by providing comprehensive data solutions, including Data Strategy, Data Governance, Advanced Analytics, Business Applications, and Data Visualization. Through our tailored approach and commitment to excellence, we drive digital transformation and build competitive advantages for our clients.Learn more about us at Jade Business Services LLC (jade-biz.com)

  • Data Engineer

    4 weeks ago

    Anantapur, India SolarSquare Full time

    Job Description: Data EngineerAs a Data Engineer, you will own the end-to-end lifecycle of our data infrastructure. You willdesign and implement robust, scalable data pipelines and architect modern data solutionsusing a best-in-class technology stack. Your work will transform raw, messy data into clean,reliable, and actionable data products that power...

  • Data Engineer

    6 days ago

    Anantapur, India Keasis Full time

    We are seeking a Data Engineer with strong Apache NiFi expertise to design and implement pipelines that move and transform data from Cloudera (HDFS/Hive/Impala) into Apache Iceberg tables, with downstream integration into Snowflake and Databricks. The ideal candidate will have hands-on experience with modern data lakehouse architectures and will play a...

  • Backend and data pipeline engineer

    4 weeks ago

    Anantapur, India JRD Systems Full time

    Job Role: Backend and Data Pipeline Engineer - PythonLocation: RemoteJob Type : Fulltime** Only Immediate Joiners **Job Summary:The Team:We’re investing in technology to develop new products that help our customers drive their growth and transformation agenda. These include new data integration, advanced analytics, and modern applications that address new...

  • Data engineering role

    2 days ago

    Anantapur, India 100x.inc Full time

    Minimum Requirements:At least 3 years of professional experience in Data EngineeringDemonstrated end-to-end ownership of ETL pipelinesDeep, hands-on experience with AWS services: EC2, Athena, Lambda, and Step Functions (non-negotiable)Strong proficiency in My SQL (non-negotiable)Working knowledge of Docker: setup, deployment, and troubleshootingHighly...

  • Senior Data Scientist

    7 days ago

    Anantapur, India Recro Full time

    Role : Senior Data Scientist (AI & Data)Location: Remote (Work from Home)We’re hiring a Senior Data Scientist to build the next generation of intelligentdecision systems that power pricing, supply optimization, ranking, and personalizationin our global B2B hotel marketplace.This is a high-impact role at the intersection of machine learning, optimization,...

  • Social Media Data Engineer

    6 days ago

    Anantapur, India Deeter Investments LLP Full time

    NOTE: IF YOU HAVE NO EXPERIENCE AQUIRING BULK SOCIAL MEDIA DATA DO NOT APPLY-Please explain your relevant experience clearly at the TOP of your CV. If you do not you will not be considered About Deeter InvestmentsDeeter Investments is a founder-led proprietary trading firm built around real-time, data-driven decision-making. We prize curiosity,...

  • sap abap

    7 days ago

    Anantapur, Andhra Pradesh, India NTT DATA Full time ₹ 5,00,000 - ₹ 15,00,000 per year

    Company DescriptionNTT DATA, a part of NTT Group, is headquartered in Tokyo and provides IT and business services globally. We help clients transform through consulting, industry solutions, business process services, digital and IT modernization, and managed services. Our commitment to our clients' long-term success allows us to enable not only them but...

  • Data Architect

    4 weeks ago

    Anantapur, India ThoughtFocus Full time

    ONLY IMMEDIATE JOINERS (0-10 days)Data Architect / Data ModelerPosition Overview Experienced Data Architect / Data Modeler with strong expertise in Financial Services, and preferably exposure to Private Equity. The role involves designing enterprise-level data models, defining data architecture standards, and ensuring the scalability, performance, and...

  • Enterprise Data Architect

    2 weeks ago

    Anantapur, India Patch the Skill Full time

    Company DescriptionPatch the Skill is a provider of corporate training services, specializing in technical and soft skills training such as Voice & Accent, Cloud, AI, Machine Learning, IoT, Data Science, and more. With a focus on enhancing communication skills and team building, we offer a wide range of training programs including AWS, Azure, Java...

  • Mern, data observability and ai tech lead

    4 days ago

    Anantapur, India Seosaph-infotech Full time

    Company DescriptionSeosaph-infotech is a growing company in the field of customized software development, offering a range of tech solutions to businesses in different verticals. Within just two years, Seosaph-infotech has delivered exceptional solutions to industries such as Finance, Healthcare, and E-commerce. Our vision is to help our clients become...