Python Data Engineer

7 days ago

Hyderabad, Telangana, India Delphie Consulting services Full time

Role Overview :

We are looking for an experienced Python Data Engineer with strong expertise in PySpark, distributed data engineering, and LLM integration.

The role involves building scalable data pipelines, AI-powered workflows, and enabling data-driven automation using platforms such as Databricks, AWS EMR, and LangChain.

As an SE3 engineer, you will primarily be responsible for hands-on development and delivery, while also contributing to solution design and collaborating with cross-functional teams.


Key Responsibilities :

- Develop and optimize ETL pipelines using PySpark, SparkSQL, and distributed frameworks.

- Work with LangChain to integrate LLM-based solutions into data workflows (Agents, Toolkits, Vector Stores).

- Implement data transformations, lineage, and governance controls in data platforms.

- Support ML teams in deploying embeddings, retrieval-augmented generation (RAG), and NLP pipelines.

- Build workflows on Databricks and AWS EMR, ensuring cost and performance efficiency.

- Apply best practices in coding, testing, CI/CD, and Skills :

- Strong proficiency in Python for data engineering.

- Hands-on experience in PySpark, SparkSQL, and ETL design.

- Working knowledge of LangChain, OpenAI APIs, or Hugging Face.

- Experience with Databricks, AWS EMR, or similar cloud data platforms.

- Good understanding of SQL, data modeling, and distributed data Skills :

- Familiarity with Google ADK Prompt Engineering.

- Experience with vector databases like FAISS, Pinecone, or Chroma.

- Exposure to MLflow, Unity Catalog, or SageMaker.

- Interest in LLM-powered applications and generative AI workflows

(ref:hirist.tech)

  • Senior Data Engineer

    7 days ago

    Hyderabad, Telangana, India Enable Data Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Experience Required: 8+YearsMode of work: RemoteSkills Required: Azure DataBricks, Eventhub, Kafka, Architecture,Azure Data Factory, Pyspark, Python, SQL, SparkNotice Period : Immediate Joiners/ Permanent/Contract role (Can join within September 15th 2025)Design, develop, and maintain scalable and robust data solutions in the cloud using Apache Spark and...

  • Python/Hadoop Developer

    3 days ago

    Hyderabad, Telangana, India NTT DATA, Inc. Full time ₹ 1,50,000 - ₹ 28,00,000 per year

    NTT DATA Services currently seeks Python Hadoop Developer to join our team inResponsibilitiesSkillset: Python, Hadoop, ETL, RDBMS, Unix, GCP Vertex AIResponsibilities:Data Ingestion Pipelines, AIML Model deployments, Data Engineering, ML Engineering with Python.

  • Digital Specialist

    4 days ago

    Hyderabad, Telangana, India Python Full time US$ 60,000 - US$ 1,20,000 per year

    Company DescriptionWe suggest you enter details here.Role DescriptionThis is a full-time remote role for an AI Futures - Mentor's Intern at Python. The intern will be responsible for assisting mentors in developing AI-related projects. Day-to-day tasks include research, coding, data analysis, coordination of project activities, and participation in meetings....

  • Data Engineer – Python

    3 days ago

    Hyderabad, Telangana, India CBNsense Full time ₹ 15,00,000 - ₹ 28,00,000 per year

    Job Title: Data Engineer – Python / PySparkNumber of Position:10Experience: 3 to 10 yearsLocation: Hyderabad (Client - USA)Work Model: Full-time, In-Office. This is an offsite opportunity supporting a US client. The role requires you to work from our Hyderabad client location daily.Job Type: Contract-to-HireClient Domain: Utilities / EnergyAbout...

  • Python/Hadoop Developer

    4 days ago

    Hyderabad, Telangana, India NTT DATA Full time ₹ 5,00,000 - ₹ 8,00,000 per year

    Req ID: 334093NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Python/Hadoop Developer to join our team in Hyderabad, Telangana (IN-TG), India (IN). NTT DATA Services currently...

  • Senior Data Engineer

    7 days ago

    Hyderabad, Telangana, India Enable Data Incorporated Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Experience Required: 8+YearsMode of work: RemoteSkills Required: Azure DataBricks, Eventhub, Kafka, Architecture,Azure Data Factory, Pyspark, Python, SQL, SparkNotice Period : Immediate Joiners/ Permanent/Contract role (Can join within September 15th 2025)Design, develop, and maintain scalable and robust data solutions in the cloud using Apache Spark and...

  • Python Data Engineer

    2 weeks ago

    Hyderabad, Telangana, India Talent Worx Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Job DescriptionTalent Worx is a growing services & recruitment consulting firm, we are hiring for our client which is a leading Big4 Consulting firm and provider of financial intelligence, data analytics, and AI-driven solutions, empowering businesses worldwide with insights for confident decision-making. Join to work on cutting-edge technologies, drive...

  • Lead/Senior Data Engineer

    7 days ago

    Hyderabad, Telangana, India Data Economy Full time US$ 1,50,000 - US$ 2,00,000 per year

    We are seeking a Lead/Senior Data Engineer with 7-12 years of experience to architect, develop, and optimize data solutions in a cloud-native environment. The role requires strong expertise in AWS Glue, PySpark, and Python with a proven ability to design scalable data pipelines and frameworks for large-scale enterprise systems. Prior exposure to financial...

  • Data Engineer

    7 days ago

    Hyderabad, Telangana, India ICE Data Services Full time US$ 1,25,000 - US$ 1,75,000 per year

    Job PurposeAt Intercontinental Exchange (ICE), we engineer technology, exchanges and clearing houses that connect companies around the world to global capital and derivative markets. With a leading-edge approach to developing technology platforms, we have built market infrastructure in all major trading centers, offering customers the ability to manage risk...

  • Azure Data Engineer

    5 days ago

    Hyderabad, Telangana, India Enable Data Incorporated Full time US$ 90,000 - US$ 1,20,000 per year

    Experience Required: 5 to 6Years MandateMode of work: Remote (India)Skills Required: Azure Data Factory, Databricks, Pyspark, Python/Scala , SQLNotice Period : Immediate Joiners/ Permanent(Can join Immediately by 8th September 2025 )5 to 6 years of experience with Big Data technologiesExperience with Microsoft Azure cloud platform.Expertise in Azure...