Senior Data Engineer
5 days ago
Job Description
– Senior Data Engineer
Experience:
5–7 Years
Location:
Hyderabad, Telangana, India
Employment Type:
Full-Time
Joining:
Immediate Hiring
Position Overview
We are hiring a Senior Data Engineer to lead the development and optimization of scalable ETL/ELT pipelines using Azure Data Factory, Databricks, and PySpark. The role involves managing Data Lake structures, ensuring data quality, troubleshooting pipeline issues, and guiding junior engineers while delivering reliable, production-ready data solutions.
Key Responsibilities
Pipeline Construction: Develop, test, and deploy robust ETL/ELT data pipelines primarily using Azure Data Factory and Azure Databricks to ingest, transform, and load data into the Data Lake.
Data Transformation: Implement data cleansing, validation, and transformation logic using PySpark to ensure data quality and readiness for downstream consumption.
Data Lake Management: Assist in maintaining the organization and metadata of the Data Lake (ADLS Gen2) and ensuring compliance with established governance frameworks.
Monitoring and Support: Monitor deployed data pipelines, troubleshoot issues, and optimize existing processes for performance improvements under the guidance of Senior Engineers.
Documentation: Create and maintain technical documentation for data mappings, data flows, and ETL/ELT specifications.
Required Technical Skills
Strong hands-on experience with Azure Data Factory and Azure Data Lake Storage Gen2.
Proficiency in Azure Databricks and PySpark for scalable data processing.
Strong knowledge of SQL for data analysis and query optimization.
Familiarity with data warehousing concepts and data modeling principles.
Experience with one or more relational/NoSQL databases.
Working knowledge of source control tools like Git/Azure DevOps.
-
Data Engineer Senior Consultant
24 hours ago
Hyderabad, Telangana, India NTT DATA Full timeReq ID: NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer Senior Consultant to join our team in Hyderabad, Telangana (IN-TG), India (IN).Understand and execute data...
-
Senior Automation Engineer
2 weeks ago
Hyderabad, Telangana, India IC Data Full timeJob DescriptionPosition: Senior Software Development Engineer in TestReports To: Director, Software Development Engineer in TestLocation: IndiaJob OverviewAre you a talented, motivated engineer with a strong interest in testing? Join an innovative and fast-paced team-building software and infrastructure that allows litigation professionals to filter...
-
Senior Data Engineer
2 weeks ago
Hyderabad, Telangana, India Sonatype Full timeRole : Senior Data EngineerSonatype India - HybridWho We AreAt Sonatype, we help organizations build better, more secure software by enabling them to understand and control their software supply chains. Our products are trusted by thousands of engineering teams globally, providing critical insights into dependency health, license risk, and software security....
-
Senior Data Engineer
7 days ago
Hyderabad, Telangana, India Info Services Full timeJob Title: Senior Data EngineerJob SummaryWe are looking for a highly skilledSenior Data Engineerwith expertise in designing, building, and optimizing large-scale data pipelines and integration frameworks. The ideal candidate will have strong experience inbatch and near real-time data processingwithin theAWS ecosystem, with hands-on exposure toDatabricks,...
-
Senior GenAI Engineers
5 days ago
Hyderabad, Telangana, India NTT DATA North America Full timeReq ID:341017NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Senior GenAI Engineers to join our team in Hyderabad, Telangana (IN-TG), India (IN).Location:|Experience:8+ yearsRole...
-
Senior Data Engineer
1 week ago
Hyderabad, Telangana, India Aifa Labs Full timeRole : Senior Data EngineerLocation : HyderabadEmployment Type : Full-TimeJob Description:The Senior Data Engineer will build and maintain the core data infrastructure for an enterprise AI platform. This role focuses on designing scalable data pipelines, developing knowledge graphs, and preparing structured and unstructured data for AI and LLM-based...
-
Senior Data Engineer
1 day ago
Hyderabad, Telangana, India Accellor Full timeAt Accellor, we are a trusted digital transformation partner that uses best-of-breed Cloud technology to deliver superior customer engagement and business effectiveness for clients. We've created an atmosphere that encourages curiosity, constant learning, and persistence. We encourage our employees to grow and explore their interests. We cultivate...
-
Senior Associate Security Platform Engineer
7 days ago
Hyderabad, Telangana, India NTT DATA Full timeContinue to make an impact with a company that is pushing the boundaries of what is possible. At NTT DATA, we are renowned for our technical excellence, leading innovations, and making a difference for our clients and society. Our workplace embraces diversity and inclusion – it's a place where you can continue to grow, belong, and thrive.Your career here...
-
Senior Data Engineer
2 weeks ago
Hyderabad, Telangana, India Vertisystem Full timeWe are seeking a Senior Data Engineer who has experience loading databases using modern data integration tools. The ideal candidate should be proficient with creating tables, writing stored procedures, functions and building ETL/ELT jobs to load data from disparate systems. The Sr Data Engineer will be loading data to and from a variety of sources including...
-
Senior Data Engineer
3 days ago
Hyderabad, Telangana, India Cornerstone OnDemand Full timeWe're looking for a*Senior Data EngineerThis role isOffice Based, Hyderabad Office*As a Senior Data Engineer is responsible for creating effective technological solutions for work. They are also responsible for managing a team of specialists. In addition, their roles include quality control of the work performed.In this role you willClosely works with the...