HYPR4 - Data Lead Engineer - ETL/Data Warehousing
1 day ago
Location : Hyderabad
Job Type : Full-Time
Responsibilities
- Data Infrastructure & Pipeline Development :
- Design, develop, and optimize scalable, efficient, and reliable data pipelines for large-scale data processing and transformation.
- Manage and maintain data architecture, ensuring high availability and performance using tools like Snowflake, Dataproc, BigQuery and other cloud technologies.
- Lead the integration of data sources from multiple systems, ensuring seamless data flow across various platforms.
- Build and optimize data pipelines using BigQuery, Snowflake, DBT Cloud, and Airflow.
- Expertise in Data Modelling to desing and build Data warehouses, Data Marts and Data lakes
- Manage version control and workflows with GitHub.
- Performance & Optimization :
- Perform tuning and optimization of queries and data pipelines to ensure high-performance data systems.
- Conduct regular performance reviews and recommend improvements or optimizations for system reliability, speed, and cost-efficiency.
- DBT (Data Build Tool) Implementation :
- Implement and maintain DBT models for data transformation workflows.
- Collaborate with data analysts and data scientists to ensure high-quality, well-documented datasets for downstream analysis.
- Ensure the use of best practices for DBT testing, version control, and deployment.
- Leadership & Mentorship :
- Lead and mentor a team of data engineers, ensuring that best practices are followed in development and deployment of data pipelines.
- Conduct code reviews, provide feedback, and ensure the implementation of high-quality data solutions.
- Drive collaboration with product teams and business stakeholders to understand data requirements and deliver scalable solutions.
Preferred Skills
- 10+ years of experience in Data Engineering with a strong focus on data warehousing, ETL pipelines, and big data technologies.
- At least 3-5 years of hands-on experience with Snowflake data warehouse or BigQuery, including setup, configuration, optimization, and maintenance.
- Proficiency in SQL for query optimization and performance tuning.
- In-depth experience with Dataproc for running large-scale data processing workflows(e.g., Spark, Hadoop).
- Expertise with DBT or any other ELT tool for data transformation and model building.
Technical Skills
- Strong experience in cloud platforms like AWS, GCP, or Azure, with a focus on data engineering tools and services.
- Proficient in programming/scripting languages such as Python, Java, or Scala for data processing.
- Experience with CI/CD pipelines and version control (Git, Jenkins, etc.).
- Knowledge of distributed computing frameworks (e.g., Spark, Hadoop) and related data processing concepts.
Data Architecture & Design
- Experience with building and maintaining data warehouses and lakes.
- Strong understanding of data modelling concepts, data quality, and governance.
- Familiarity with Kafka, Airflow, or similar tools for orchestrating data workflows.
Key skills: GCP/AWS, Python, Terraform, Data Governance & Data Modelling.
)
-
Data Engineer Lead
2 weeks ago
Hyderabad, Telangana, India 6de69dcd-810e-48f0-b2ca-7f2997d6762e Full time ₹ 20,00,000 - ₹ 25,00,000 per yearCompany DescriptionCYTEL STATISTICAL SOFTWARE & SERVICES PRIVATE LIMITED is a professional organization based in Pune, Maharashtra, India. Operating out of the "Lohia-Jain IT Park" in Kothrud, the company is dedicated to providing innovative solutions in the statistical software and services domain. Known for its expertise and commitment to excellence, the...
-
Databricks Engineer
1 week ago
Hyderabad, Telangana, India NTT DATA Full time ₹ 12,00,000 - ₹ 36,00,000 per yearDesign, build, and maintain robust ETL/ELT data pipelines using Apache Spark on Databricks. Implement data Lakehouse architecture using Delta Lake for cost-effective data storage and analytics. Use Databricks Workflows for orchestrating batch and streaming pipelines. Develop and maintain CI/CD pipelines for data applications using tools such as Azure DevOps,...
-
Data Engineer Advisor
1 week ago
Hyderabad, Telangana, India NTT DATA Full time ₹ 1,00,00,000 - ₹ 2,00,00,000 per yearEnsure audit trail is in place for data migration and migrated data is traceable back to the cleanup / data enrichment activities and a clear line of sight to the source legacy systems Work closely with SAP S4 HANA implementation teams to ensure blueprint is effectively understood and translated into data migration requirements / data concept documents 10+...
-
Azure Data Engineer
2 weeks ago
Hyderabad, Telangana, India Enable Data Full time ₹ 6,00,000 - ₹ 18,00,000 per yearEnable Data Incorporated is currently seeking a skilled and experienced Azure Data Engineer to join our dynamic team. As a leading provider of advanced application, data, and cloud engineering services, Enable Data has developed deep expertise across various industries. We work closely with our customers to leverage modern solutions and technologies to drive...
-
ETL Lead
3 days ago
Hyderabad, Telangana, India Virtusa Full time ₹ 3,24,000 - ₹ 4,86,000 per yearETL LeadThe team is looking for a Lead ETL Developer Lead in our Enterprise Data Warehouse. In this role you will be part of a team working to develop solutions enabling the business to leverage data as an asset at the bank. As a Lead ETL Developer, you will be leading teams to develop, maintain and enhance code ensuring all IT SDLC processes are documented...
-
Data Engineer
1 week ago
Hyderabad, Telangana, India HYPR4 Cloud Tech Full time ₹ 15,00,000 - ₹ 25,00,000 per yearResponsibilities:Build and optimize data pipelines using BigQuery, and Airflow.Design efficient data models and schemas.Manage version control and workflows with GitHub.Requirements:3+ years of experience with BigQuery, Data modeling, Airflow, and GitHub.Strong SQL and Python skills.Preferred Skills:SQL Proficiency: A deep understanding of SQL, especially...
-
Hyderabad, Telangana, India NTT DATA, Inc. Full time ₹ 12,00,000 - ₹ 36,00,000 per yearJob summaryThe PeopleSoft to Workday Data Conversion Technical Lead will be responsible for the technical design, development, and execution of the data migration from PeopleSoft to Workday. This hands-on role requires deep technical expertise in both PeopleSoft and Workday data structures and tools.The lead will manage the technical conversion team,...
-
Sr Operations Data Lead
4 days ago
Hyderabad, Telangana, India Data Unveil Full time ₹ 12,00,000 - ₹ 36,00,000 per yearJOB DESCRIPTION:Position Title: Sr Operations Data LeadExperience:4 Years to 6 YearsLocation:Hyderabad, TelanganaHire Type:Full Time, On-siteStart Date:ImmediateOverview:The Operations Data Delivery Lead is responsible for managing and overseeing the efficient delivery of data within the organization. This role ensures that data operations and delivery...
-
Data Engineer Advisor
1 week ago
Hyderabad, Telangana, India NTT DATA Full time ₹ 12,00,000 - ₹ 36,00,000 per year6-8 Yrs. of overall technical experience in SAP BODS with all the SAP BODS application modules (Extract, Transform, Load) 5+ Yrs. of experience with Data Migration experience with S/4 HANA/ECC Implementations Experience in BODS Designer Components- Projects, Jobs, Workflow, Data Flow, Scripts, Data Stores and Formats Experience in BODS performance tuning...
-
Snowflake Data Lead
2 weeks ago
Hyderabad, Telangana, India Boolean Data Systems Full time ₹ 6,00,000 - ₹ 18,00,000 per yearJob Tittle: Snowflake Data LeadJob Id: JPC - 67Location: HyderabadAbout The Company :Boolean Data Systems is a system integration company focusing on SAP, Snowflake and cloud infrastructure products.We focus on helping companies implement innovative solutions combining People+ Process+ Technology to reach their maximum ROI.We are headquartered in Atlanta, GA...