P99Soft - Data Engineer - ETL/Python

3 weeks ago

Hyderabad, India P99SOFT PRIVATE LIMITED Full time

Description :Experience : 3-4 yrs.Location : Hyderabad (Hybrid).As a Data Engineer, you will be involved in the entire development lifecycle, from brainstorming ideas to implementing scalable solutions that unlock data insights.You will collaborate with stakeholders to gather requirements, design data models, and build pipelines that support reporting, analytics, business intelligence (BI), and exploratory analysis.Job Description :- Primary Skillset: Tableau/Power BI, Python, Snowflake/Red Shift/Big Query, SQL.- Secondary Skillset : Kafka, Spark, Trino.Key Responsibilities :- Design, build, and sustain efficient, scalable, and performant Data Engineering Pipelines to ingest, sanitize, transform (ETL/ELT), and deliver high-volume, high-velocity data from diverse sources.- Ensure reliable and consistent processing of versatile workloads of granularity such as Real Time, Near Real Time, Mini-batch, Batch, and On-demand.- Translate business requirements into technical specifications, design and implement solutions with clear documentation.- Develop, optimize, and support production data workflows to ensure comprehensive and accurate datasets for analytics and BI reporting.- Apply a Software Engineering mindset/discipline, adopting best practices in writing modular code that is maintainable, scalable, and performant.- Use orchestration and scheduling tools (e.g., Airflow, GitLab Runners) to streamline workflows.- Automate deployment and monitoring of data workflows using CI/CD best practices.- Use DevOps best practices to instrument retries and self-healing to minimize, if not avoid, manual intervention.- Use AI/Gen AI tools and technologies to build/generate reusable code.- Collaborate with Engineering Groups, Analysts, Product/Program Management, and other stakeholders to deliver end-to-end solutions.- Promote strategies to improve our data modelling, quality, architecture, and BI capabilities.- Mentor junior engineers and contribute to team knowledge sharing.- Have an analytics and BI mindset to explore and identify opportunities for improved metrics, insights, and dashboards contributing to business growth.Qualifications :- Masters or bachelors degree in computer science or associated discipline with relevant industry experience in a data engineering role.- Strong proficiency in writing and analysing complex SQL, Python, or any 4GL.- Strong hands-on experience with Cloud Data Warehouses like Snowflake, Redshift, Big Query.- Expertise & experience with open table formats (e.g., Apache Iceberg).- Expertise & experience with distributed data processing frameworks (e.g., Apache Spark, Flink, Beam, Trino).- Experience with real-time/streaming data technologies (e.g., Kafka, Kinesis, Spark Streaming).- Experience in using Airflow.- Deep knowledge in data modelling, performance optimization techniques, and BI best practices.- Experience in version control and CI/CD workflows (e.g., Git).- Strong familiarity with BI tools such as Looker, Tableau, Power BI, dashboard design.- Experience working in Agile development environments and with tools like JIRA or Confluence.- Strong problem-solving, analytical, and debugging skills.- Excellent communication and collaboration skills, with the ability to work across business, analytics, BI, and engineering teams. (ref:hirist.tech)

  • P99Soft - Solution Architect - Backend Technologies

    3 days ago

    Hyderabad, India P99SOFT PRIVATE LIMITED Full time

    About P99Soft :P99Soft Pvt Ltd is a technology-driven organization focused on delivering scalable, high-performance solutions across domains.We specialize in modern software architecture, cloud-native systems, and AI-driven innovation.Role Overview :We are looking for a Solution Architect with strong expertise in backend technologies and a solid...

  • P99Soft - Senior Data Engineer - SQL/Python

    14 hours ago

    Hyderabad, India P99SOFT PRIVATE LIMITED Full time

    About the Role: We are seeking a highly skilled Senior Data Engineer with strong expertise in Snowflake, SQL, and Python to design, build, and optimize our data ecosystem. You will play a critical role in creating scalable data pipelines, ensuring high data quality, and supporting analytics and AI/ML initiatives across the organization. This position is...

  • P99Soft - Software Developer - Python/Flask

    4 weeks ago

    Hyderabad, India P99SOFT PRIVATE LIMITED Full time

    Description :About the RoleWe are seeking a highly skilled professional with strong expertise in Software Development, AI, and Data Science, who can design, develop, and deliver intelligent, data-driven solutions for enterprise clients. The ideal candidate will have hands-on technical expertise, a deep understanding of AI and data engineering workflows, and...

  • Technical Architect

    3 days ago

    Hyderabad, Telangana, India P99SOFT Full time ₹ 10,000 - ₹ 50,000 per year

    About P99SoftP99Soft Pvt Ltd is a technology-driven organization focused on delivering scalable, high-performance solutions across domains. We specialize in modern software architecture, cloud-native systems, and AI-driven innovation.Role OverviewWe are looking for a Solution Architect with strong expertise in backend technologies and a solid understanding...

  • Sr. DATA ENGINEER

    4 days ago

    Hyderabad, India P99SOFT Full time

    Job Description Designation : - Sr. DATA ENGINEER (Snowflake) Experience : - 5+ Yrs Location : - Hyderabad (Hybrid) We're looking for a Data Engineer to build and maintain data pipelines using Snowflake, SQL, and Python. You'll help us create a strong data platform for our team. Responsibilities - Build data pipelines and ETL processes. - Work with Snowflake...

  • P99Soft - Artificial Intelligence/Machine Learning Engineer - LLM Models

    4 weeks ago

    Hyderabad, India P99SOFT PRIVATE LIMITED Full time

    Description :About the RoleWe are looking for an innovative and hands-on AI Engineer to design, develop, and deploy intelligent AI agents leveraging the Model Context Protocol (MCP) framework. This role requires a strong understanding of AI system design, LLM integration, and cloud-native deployment (preferably on Azure Foundry or equivalent platforms). The...

  • Data Quality Engineer

    3 hours ago

    Hyderabad, India Tata Consultancy Services Full time

    TCS Inviting Application for Walk-in Interview on 26th Nov 25 in Bangalore .Role - Data Quality Engineer (Python + ETL):EXP : 5 to 8 + YearsPrimary Skills :Hands-on experience with Data Testing either with Python or Pyspark.Deep understanding of data test concepts primarily inclined towards ETL .Hands-on with ETL/DWH testing and SQL (any RDBMS)Hands-on...

  • Data Engineer

    14 hours ago

    Hyderabad, India PureSearch Full time

    The Data Engineer will be responsible for building and maintaining our data infrastructure to support reporting, analytics, and data science initiatives. The ideal candidate will have strong skills in data architecture, ETL, SQL, and Python within a Git-managed environment, as well as a proven ability to collaborate with both business stakeholders and data...

  • Etl Tester

    1 week ago

    Hyderabad, Telangana, India Enable Data Full time

    **Description**: **Role**: ETL Tester **Location**: Hyderabad (Remote 100%) **Full Time** **Must Have**: - Strong understanding of data warehousing concepts, data modeling, and data integration patterns. - Experience as an ETL developer with expertise in **Azure Databricks** and **Azure Data Factory**. - Strong troubleshooting and analytical skills. -...

  • Etl Tester

    1 week ago

    Hyderabad, Telangana, India Enable Data Incorporated Full time

    **Role**: ETL Tester **Location**: Hyderabad (Remote 100%) Full Time **Must Have**: - Strong understanding of data warehousing concepts, data modeling, and data integration patterns. - Experience as an ETL developer with expertise in Azure Databricks and Azure Data Factory. - Strong troubleshooting and analytical skills. - Strong SQL skills. - Experience...