P99Soft - Data Engineer - ETL/Python

2 days ago

Hyderabad, Telangana, India P99SOFT PRIVATE LIMITED Full time ₹ 9,00,000 - ₹ 12,00,000 per year

Description :

Experience : 3-4 yrs.

Location : Hyderabad (Hybrid).

As a Data Engineer, you will be involved in the entire development lifecycle, from brainstorming ideas to implementing scalable solutions that unlock data insights.

You will collaborate with stakeholders to gather requirements, design data models, and build pipelines that support reporting, analytics, business intelligence (BI), and exploratory analysis.

Job Description :

- Primary Skillset: Tableau/Power BI, Python, Snowflake/Red Shift/Big Query, SQL.

- Secondary Skillset : Kafka, Spark, Trino.

Key Responsibilities :

- Design, build, and sustain efficient, scalable, and performant Data Engineering Pipelines to ingest, sanitize, transform (ETL/ELT), and deliver high-volume, high-velocity data from diverse sources.

- Ensure reliable and consistent processing of versatile workloads of granularity such as Real Time, Near Real Time, Mini-batch, Batch, and On-demand.

- Translate business requirements into technical specifications, design and implement solutions with clear documentation.

- Develop, optimize, and support production data workflows to ensure comprehensive and accurate datasets for analytics and BI reporting.

- Apply a Software Engineering mindset/discipline, adopting best practices in writing modular code that is maintainable, scalable, and performant.

- Use orchestration and scheduling tools (e.g., Airflow, GitLab Runners) to streamline workflows.

- Automate deployment and monitoring of data workflows using CI/CD best practices.

- Use DevOps best practices to instrument retries and self-healing to minimize, if not avoid, manual intervention.

- Use AI/Gen AI tools and technologies to build/generate reusable code.

- Collaborate with Engineering Groups, Analysts, Product/Program Management, and other stakeholders to deliver end-to-end solutions.

- Promote strategies to improve our data modelling, quality, architecture, and BI capabilities.

- Mentor junior engineers and contribute to team knowledge sharing.

- Have an analytics and BI mindset to explore and identify opportunities for improved metrics, insights, and dashboards contributing to business growth.

Qualifications :

- Masters or bachelors degree in computer science or associated discipline with relevant industry experience in a data engineering role.

- Strong proficiency in writing and analysing complex SQL, Python, or any 4GL.

- Strong hands-on experience with Cloud Data Warehouses like Snowflake, Redshift, Big Query.

- Expertise & experience with open table formats (e.g., Apache Iceberg).

- Expertise & experience with distributed data processing frameworks (e.g., Apache Spark, Flink, Beam, Trino).

- Experience with real-time/streaming data technologies (e.g., Kafka, Kinesis, Spark Streaming).

- Experience in using Airflow.

- Deep knowledge in data modelling, performance optimization techniques, and BI best practices.

- Experience in version control and CI/CD workflows (e.g., Git).

- Strong familiarity with BI tools such as Looker, Tableau, Power BI, dashboard design.

- Experience working in Agile development environments and with tools like JIRA or Confluence.

- Strong problem-solving, analytical, and debugging skills.

- Excellent communication and collaboration skills, with the ability to work across business, analytics, BI, and engineering teams.

  • Senior Qa Automation Engineer

    7 days ago

    Hyderabad, Telangana, India P99SOFT Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    Company DescriptionP99SOFT supercharges business growth with cutting-edge data and AI accelerators, tailor-made Salesforce and AWS solutions, and breakthrough logistics technology. The company also delivers immersive gaming and custom ERP platforms that drive engagement and control. P99SOFT helps enterprises automate operations, extract insights from data,...

  • P99Soft - Data Engineer II - Java/Python

    2 weeks ago

    Hyderabad, Telangana, India P99SOFT PRIVATE LIMITED Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    Description : Job Title : Data Engineer II. Experience : 5+ Years. Location : Hyderabad (Hybrid). We are looking for an experienced Data Engineer with broad technical skills and ability to work with large amounts of data. You will collaborate with the Game teams to implement data strategies and develop complex ETL pipelines that support...

  • P99Soft - Software Developer - Python/Flask

    2 weeks ago

    Hyderabad, Telangana, India P99SOFT PRIVATE LIMITED Full time ₹ 5,00,000 - ₹ 15,00,000 per year

    Description : About the Role We are seeking a highly skilled professional with strong expertise in Software Development, AI, and Data Science, who can design, develop, and deliver intelligent, data-driven solutions for enterprise clients. The ideal candidate will have hands-on technical expertise, a deep understanding of AI and data engineering...

  • Devops Engineer

    4 days ago

    Hyderabad, Telangana, India P99SOFT Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Job Title: Senior DevOps EngineerLocation: Hyderabad, IndiaJob Type: Full-TimeJob SummaryP99soft is seeking a Senior DevOps Engineer with over 5 years of experience to join our team in Hyderabad. The ideal candidate will have a strong background in DevOps practices and tools, with expertise in Kubernetes, Terraform, CI/CD pipelines, Docker, and AWS (Amazon...

  • P99Soft - Senior Python Engineer - Generative AI

    2 weeks ago

    Hyderabad, Telangana, India P99SOFT PRIVATE LIMITED Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    Description : Develop generative AI solutions on AWS, focusing on LLMs, prompt engineering, RAG, and agentic AI using n8n and Python libraries like LangChain.Key Requirements (8 Points) : - Build LLMs (e.g., Anthropic Claude) on AWS Bedrock with boto3. - Fine-tune LLMs on AWS SageMaker using transformers and LoRA. - Create prompts with...

  • P99Soft - Artificial Intelligence/Machine Learning Engineer - LLM Models

    2 weeks ago

    Hyderabad, Telangana, India P99SOFT PRIVATE LIMITED Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    Description : About the Role We are looking for an innovative and hands-on AI Engineer to design, develop, and deploy intelligent AI agents leveraging the Model Context Protocol (MCP) framework. This role requires a strong understanding of AI system design, LLM integration, and cloud-native deployment (preferably on Azure Foundry or equivalent...

  • P99Soft - Senior Data Scientist - Machine Learning Models

    5 hours ago

    Hyderabad, Telangana, India P99SOFT PRIVATE LIMITED Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Description : We are looking for a highly experienced Senior Data Scientist to join our analytics and machine learning team. This role requires a seasoned professional who can drive the end-to-end lifecycle of machine learning models from data exploration and feature engineering to production deployment and ongoing model management. The ideal...

  • Straive - Senior Data Engineer - ETL/Python

    2 days ago

    Hyderabad, Telangana, India Straive. Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Description : About the job : Job Summary : We're looking for a Senior Data Engineer with 5-8 years of experience to build and maintain scalable, production-grade data pipelines. The ideal candidate is a strong software engineer with hands-on experience in Spark (3.x), Scala, SQL, and Python. You'll be responsible for designing and implementing ETL/ELT...

  • Python/Hadoop Developer

    2 weeks ago

    Hyderabad, Telangana, India NTT DATA, Inc. Full time ₹ 1,50,000 - ₹ 28,00,000 per year

    NTT DATA Services currently seeks Python Hadoop Developer to join our team inResponsibilitiesSkillset: Python, Hadoop, ETL, RDBMS, Unix, GCP Vertex AIResponsibilities:Data Ingestion Pipelines, AIML Model deployments, Data Engineering, ML Engineering with Python.

  • Python Developer

    4 days ago

    Hyderabad, Telangana, India Data Unveil Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Job Description:Position Title: Python DeveloperExperience: 3Years to 5YearsLocation: Hyderabad, TelanganaHire Type: Full Time, On-siteStart Date: ImmediateJob Summary:We are seeking a Python Developer with 2-3 years of experience, skilled in Python, PySpark, Oracle, MySQL, and basic AWS services. The candidate will work on data processing, ETL pipelines,...