HYPR4 - Data Lead Engineer - ETL/Data Warehousing

3 days ago

Hyderabad, Telangana, India HYPR4 Cloud Tech Full time ₹ 12,00,000 - ₹ 36,00,000 per year

Description :





Experience : 7 Years

Location : Hyderabad

Job Type : Full-Time

Responsibilities :

- Data Infrastructure & Pipeline Development :

- Design, develop, and optimize scalable, efficient, and reliable data pipelines for large-scale data processing and transformation.

- Manage and maintain data architecture, ensuring high availability and performance using tools like Snowflake, Dataproc, BigQuery and other cloud technologies.

- Lead the integration of data sources from multiple systems, ensuring seamless data flow across various platforms.

- Build and optimize data pipelines using BigQuery, Snowflake, DBT Cloud, and Airflow.

- Expertise in Data Modelling to desing and build Data warehouses, Data Marts and Data lakes

- Manage version control and workflows with GitHub.

- Performance & Optimization :

- Perform tuning and optimization of queries and data pipelines to ensure high-performance data systems.

- Conduct regular performance reviews and recommend improvements or optimizations for system reliability, speed, and cost-efficiency.

- DBT (Data Build Tool) Implementation :

- Implement and maintain DBT models for data transformation workflows.

- Collaborate with data analysts and data scientists to ensure high-quality, well-documented datasets for downstream analysis.

- Ensure the use of best practices for DBT testing, version control, and deployment.

- Leadership & Mentorship :

- Lead and mentor a team of data engineers, ensuring that best practices are followed in development and deployment of data pipelines.

- Conduct code reviews, provide feedback, and ensure the implementation of high-quality data solutions.

- Drive collaboration with product teams and business stakeholders to understand data requirements and deliver scalable solutions.

Preferred Skills :

years of experience in Data Engineering with a strong focus on data warehousing, ETL pipelines, and big data technologies.

- At least 3-5 years of hands-on experience with Snowflake data warehouse or BigQuery, including setup, configuration, optimization, and maintenance.

- Proficiency in SQL for query optimization and performance tuning.

- In-depth experience with Dataproc for running large-scale data processing workflows(e.g., Spark, Hadoop).

- Expertise with DBT or any other ELT tool for data transformation and model building.

Technical Skills :

- Strong experience in cloud platforms like AWS, GCP, or Azure, with a focus on data engineering tools and services.

- Proficient in programming/scripting languages such as Python, Java, or Scala for data processing.

- Experience with CI/CD pipelines and version control (Git, Jenkins, etc.).

- Knowledge of distributed computing frameworks (e.g., Spark, Hadoop) and related data processing concepts.

Data Architecture & Design :

- Experience with building and maintaining data warehouses and lakes.

- Strong understanding of data modelling concepts, data quality, and governance.

- Familiarity with Kafka, Airflow, or similar tools for orchestrating data workflows.

Key skills: GCP/AWS, Python, Terraform, Data Governance & Data Modelling.

  • HYPR4 - Data Lead Engineer - ETL/Data Warehousing

    1 day ago

    Hyderabad, Telangana, India HYPR4 Cloud Tech Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    : 7+ YearsLocation : HyderabadJob Type : Full-TimeResponsibilitiesData Infrastructure & Pipeline Development :Design, develop, and optimize scalable, efficient, and reliable data pipelines for large-scale data processing and transformation.Manage and maintain data architecture, ensuring high availability and performance using tools like Snowflake, Dataproc,...

  • PeopleSoft to Workday Data Conversion Technical Lead

    3 days ago

    Hyderabad, Telangana, India NTT DATA Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    Job summary The PeopleSoft to Workday Data Conversion Technical Lead will be responsible for the technical design, development, and execution of the data migration from PeopleSoft to Workday. This hands-on role requires deep technical expertise in both PeopleSoft and Workday data structures and tools. The lead will manage the technical conversion team,...

  • Databricks Engineer

    1 week ago

    Hyderabad, Telangana, India NTT DATA Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Design, build, and maintain robust ETL/ELT data pipelines using Apache Spark on Databricks. Implement data Lakehouse architecture using Delta Lake for cost-effective data storage and analytics. Use Databricks Workflows for orchestrating batch and streaming pipelines. Develop and maintain CI/CD pipelines for data applications using tools such as Azure DevOps,...

  • Data Engineer Advisor

    1 week ago

    Hyderabad, Telangana, India NTT DATA Full time ₹ 1,00,00,000 - ₹ 2,00,00,000 per year

    Ensure audit trail is in place for data migration and migrated data is traceable back to the cleanup / data enrichment activities and a clear line of sight to the source legacy systems Work closely with SAP S4 HANA implementation teams to ensure blueprint is effectively understood and translated into data migration requirements / data concept documents 10+...

  • Azure Data Engineer

    1 day ago

    Hyderabad, Telangana, India Enable Data Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Enable Data Incorporated is currently seeking a skilled and experienced Azure Data Engineer to join our dynamic team. As a leading provider of advanced application, data, and cloud engineering services, Enable Data has developed deep expertise across various industries. We work closely with our customers to leverage modern solutions and technologies to drive...

  • PeopleSoft To Workday Data Conversion Technical Lead

    1 week ago

    Hyderabad, Telangana, India NTT DATA, Inc. Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Job summaryThe PeopleSoft to Workday Data Conversion Technical Lead will be responsible for the technical design, development, and execution of the data migration from PeopleSoft to Workday. This hands-on role requires deep technical expertise in both PeopleSoft and Workday data structures and tools.The lead will manage the technical conversion team,...

  • Data Engineer

    1 week ago

    Hyderabad, Telangana, India HYPR4 Cloud Tech Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Responsibilities:Build and optimize data pipelines using BigQuery, and Airflow.Design efficient data models and schemas.Manage version control and workflows with GitHub.Requirements:3+ years of experience with BigQuery, Data modeling, Airflow, and GitHub.Strong SQL and Python skills.Preferred Skills:SQL Proficiency: A deep understanding of SQL, especially...

  • Azure Data Engineer With Snowflake

    3 days ago

    Hyderabad, Telangana, India Enable Data Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Enable Data Incorporated is currently seeking a skilled and experienced Azure Data Engineer to join our dynamic team. As a leading provider of advanced application, data, and cloud engineering services, Enable Data has developed deep expertise across various industries. We work closely with our customers to leverage modern solutions and technologies to drive...

  • Data Engineer

    1 week ago

    Hyderabad, Telangana, India HRDisruptive Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Company DescriptionHRdisruptive is dedicated to driving innovation in HR and empowering small and medium-sized enterprises (SMEs) to build exceptional teams. We offer a one-stop solution for all HR needs, making it easier for our clients to focus on their core business operations. With a team of HR experts, we provide a wide range of customized HR services,...

  • Lead GCP Data Engineer

    1 week ago

    Hyderabad, Telangana, India Incedo Inc. Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Role: Lead GCP Data EngineerLocation: Hyderabad/ChennaiExperience: 6+ YearsJob details:Key ResponsibilitiesLead the end-to-end design and implementation of data pipelines , ETL/ELT processes , and data lake/warehouse solutions on GCP.Architect scalable data platforms leveraging BigQuery, Dataflow, Pub/Sub, Dataproc, Cloud Storage, Composer, and Cloud...