
HYPR4 - Data Lead Engineer - ETL/Data Warehousing
1 day ago
Location : Hyderabad
Job Type : Full-Time
Responsibilities
- Data Infrastructure & Pipeline Development :
- Design, develop, and optimize scalable, efficient, and reliable data pipelines for large-scale data processing and transformation.
- Manage and maintain data architecture, ensuring high availability and performance using tools like Snowflake, Dataproc, BigQuery and other cloud technologies.
- Lead the integration of data sources from multiple systems, ensuring seamless data flow across various platforms.
- Build and optimize data pipelines using BigQuery, Snowflake, DBT Cloud, and Airflow.
- Expertise in Data Modelling to desing and build Data warehouses, Data Marts and Data lakes
- Manage version control and workflows with GitHub.
- Performance & Optimization :
- Perform tuning and optimization of queries and data pipelines to ensure high-performance data systems.
- Conduct regular performance reviews and recommend improvements or optimizations for system reliability, speed, and cost-efficiency.
- DBT (Data Build Tool) Implementation :
- Implement and maintain DBT models for data transformation workflows.
- Collaborate with data analysts and data scientists to ensure high-quality, well-documented datasets for downstream analysis.
- Ensure the use of best practices for DBT testing, version control, and deployment.
- Leadership & Mentorship :
- Lead and mentor a team of data engineers, ensuring that best practices are followed in development and deployment of data pipelines.
- Conduct code reviews, provide feedback, and ensure the implementation of high-quality data solutions.
- Drive collaboration with product teams and business stakeholders to understand data requirements and deliver scalable solutions.
Preferred Skills
- 10+ years of experience in Data Engineering with a strong focus on data warehousing, ETL pipelines, and big data technologies.
- At least 3-5 years of hands-on experience with Snowflake data warehouse or BigQuery, including setup, configuration, optimization, and maintenance.
- Proficiency in SQL for query optimization and performance tuning.
- In-depth experience with Dataproc for running large-scale data processing workflows(e.g., Spark, Hadoop).
- Expertise with DBT or any other ELT tool for data transformation and model building.
Technical Skills
- Strong experience in cloud platforms like AWS, GCP, or Azure, with a focus on data engineering tools and services.
- Proficient in programming/scripting languages such as Python, Java, or Scala for data processing.
- Experience with CI/CD pipelines and version control (Git, Jenkins, etc.).
- Knowledge of distributed computing frameworks (e.g., Spark, Hadoop) and related data processing concepts.
Data Architecture & Design
- Experience with building and maintaining data warehouses and lakes.
- Strong understanding of data modelling concepts, data quality, and governance.
- Familiarity with Kafka, Airflow, or similar tools for orchestrating data workflows.
Key skills: GCP/AWS, Python, Terraform, Data Governance & Data Modelling.
)
-
Hyderabad, Telangana, India HYPR4 Cloud Tech Full time ₹ 12,00,000 - ₹ 36,00,000 per yearDescription : Experience : 7 Years Location : Hyderabad Job Type : Full-TimeResponsibilities : - Data Infrastructure & Pipeline Development : - Design, develop, and optimize scalable, efficient, and reliable data pipelines for large-scale data processing and transformation. - Manage and maintain data architecture, ensuring high availability...
-
Hyderabad, Telangana, India NTT DATA Full time ₹ 6,00,000 - ₹ 18,00,000 per yearJob summary The PeopleSoft to Workday Data Conversion Technical Lead will be responsible for the technical design, development, and execution of the data migration from PeopleSoft to Workday. This hands-on role requires deep technical expertise in both PeopleSoft and Workday data structures and tools. The lead will manage the technical conversion team,...
-
Azure Data Engineer
1 day ago
Hyderabad, Telangana, India Enable Data Full time ₹ 15,00,000 - ₹ 25,00,000 per yearEnable Data Incorporated is currently seeking a skilled and experienced Azure Data Engineer to join our dynamic team. As a leading provider of advanced application, data, and cloud engineering services, Enable Data has developed deep expertise across various industries. We work closely with our customers to leverage modern solutions and technologies to drive...
-
Lead Data Engineer
2 weeks ago
Hyderabad, Telangana, India, Telangana Saras Analytics Full timeAbout Saras Analytics:We are an ecommerce focused end to end data analytics firm assisting enterprises & brands in data driven decision making to maximize business value. Our suite of work spans extraction, transformation, visualization & analysis of data delivered via industry leading products, solutions & services. Our flagship product is Daton, an ETL...
-
Data Engineer
1 week ago
Hyderabad, Telangana, India HYPR4 Cloud Tech Full time ₹ 15,00,000 - ₹ 25,00,000 per yearResponsibilities:Build and optimize data pipelines using BigQuery, and Airflow.Design efficient data models and schemas.Manage version control and workflows with GitHub.Requirements:3+ years of experience with BigQuery, Data modeling, Airflow, and GitHub.Strong SQL and Python skills.Preferred Skills:SQL Proficiency: A deep understanding of SQL, especially...
-
Hyderabad, Telangana, India NTT DATA, Inc. Full time ₹ 12,00,000 - ₹ 36,00,000 per yearJob summaryThe PeopleSoft to Workday Data Conversion Technical Lead will be responsible for the technical design, development, and execution of the data migration from PeopleSoft to Workday. This hands-on role requires deep technical expertise in both PeopleSoft and Workday data structures and tools.The lead will manage the technical conversion team,...
-
Data Engineer
1 week ago
Hyderabad, Telangana, India HRDisruptive Full time ₹ 9,00,000 - ₹ 12,00,000 per yearCompany DescriptionHRdisruptive is dedicated to driving innovation in HR and empowering small and medium-sized enterprises (SMEs) to build exceptional teams. We offer a one-stop solution for all HR needs, making it easier for our clients to focus on their core business operations. With a team of HR experts, we provide a wide range of customized HR services,...
-
Lead GCP Data Engineer
1 week ago
Hyderabad, Telangana, India Incedo Inc. Full time ₹ 20,00,000 - ₹ 25,00,000 per yearRole: Lead GCP Data EngineerLocation: Hyderabad/ChennaiExperience: 6+ YearsJob details:Key ResponsibilitiesLead the end-to-end design and implementation of data pipelines , ETL/ELT processes , and data lake/warehouse solutions on GCP.Architect scalable data platforms leveraging BigQuery, Dataflow, Pub/Sub, Dataproc, Cloud Storage, Composer, and Cloud...
-
Azure Data Engineer
3 days ago
Hyderabad, Telangana, India Enable Data Incorporated Full time ₹ 15,00,000 - ₹ 25,00,000 per yearEnable Data Incorporated is currently seeking a skilled and experienced Azure Data Engineer to join our dynamic team. As a leading provider of advanced application, data, and cloud engineering services, Enable Data has developed deep expertise across various industries. We work closely with our customers to leverage modern solutions and technologies to drive...
-
Azure Data Engineer
2 days ago
Hyderabad, Telangana, India Enable Data Incorporated Full time ₹ 20,00,000 - ₹ 25,00,000 per yearEnable Data Incorporated is currently seeking a skilled and experienced Azure Data Engineer to join our dynamic team. As a leading provider of advanced application, data, and cloud engineering services, Enable Data has developed deep expertise across various industries. We work closely with our customers to leverage modern solutions and technologies to drive...