Senior Data Engineer
4 days ago
Job Description
– Senior Data Engineer
Experience:
5–7 Years
Location:
Hyderabad, Telangana, India
Employment Type:
Full-Time
Joining:
Immediate Hiring
Position Overview
We are hiring a Senior Data Engineer to lead the development and optimization of scalable ETL/ELT pipelines using Azure Data Factory, Databricks, and PySpark. The role involves managing Data Lake structures, ensuring data quality, troubleshooting pipeline issues, and guiding junior engineers while delivering reliable, production-ready data solutions.
Key Responsibilities
Pipeline Construction: Develop, test, and deploy robust ETL/ELT data pipelines primarily using Azure Data Factory and Azure Databricks to ingest, transform, and load data into the Data Lake.
Data Transformation: Implement data cleansing, validation, and transformation logic using PySpark to ensure data quality and readiness for downstream consumption.
Data Lake Management: Assist in maintaining the organization and metadata of the Data Lake (ADLS Gen2) and ensuring compliance with established governance frameworks.
Monitoring and Support: Monitor deployed data pipelines, troubleshoot issues, and optimize existing processes for performance improvements under the guidance of Senior Engineers.
Documentation: Create and maintain technical documentation for data mappings, data flows, and ETL/ELT specifications.
Required Technical Skills
Strong hands-on experience with Azure Data Factory and Azure Data Lake Storage Gen2.
Proficiency in Azure Databricks and PySpark for scalable data processing.
Strong knowledge of SQL for data analysis and query optimization.
Familiarity with data warehousing concepts and data modeling principles.
Experience with one or more relational/NoSQL databases.
Working knowledge of source control tools like Git/Azure DevOps.
-
Azure Data Engineer
6 days ago
Hyderabad, Telangana, India Enable Data Full time ₹ 6,00,000 - ₹ 18,00,000 per yearEnable Data Incorporated is currently seeking a skilled and experienced Azure Data Engineer to join our dynamic team. As a leading provider of advanced application, data, and cloud engineering services, Enable Data has developed deep expertise across various industries. We work closely with our customers to leverage modern solutions and technologies to drive...
-
Senior Data Engineer
6 days ago
Hyderabad, Telangana, India WalkingTree Technologies Full time ₹ 8,00,000 - ₹ 24,00,000 per yearCompany DescriptionFounded in 2008, WalkingTree Technologies is a pioneering IT services company specializing in digital and data solutions. We collaborate with our clients to shape and execute their data and digital strategies, unlocking their full potential. Our core strengths in Product Engineering, Digital Transformation, and Modernization create a...
-
Senior Data Engineer
2 weeks ago
Hyderabad, Telangana, India Sonatype Full time ₹ 12,00,000 - ₹ 25,00,000 per yearRole : Senior Data EngineerSonatype India - HybridWho We AreAt Sonatype, we help organizations build better, more secure software by enabling them to understand and control their software supply chains. Our products are trusted by thousands of engineering teams globally, providing critical insights into dependency health, license risk, and software security....
-
Senior Data Engineer
6 days ago
Hyderabad, Telangana, India Info Services Full time ₹ 12,00,000 - ₹ 36,00,000 per yearJob Title: Senior Data EngineerJob SummaryWe are looking for a highly skilledSenior Data Engineerwith expertise in designing, building, and optimizing large-scale data pipelines and integration frameworks. The ideal candidate will have strong experience inbatch and near real-time data processingwithin theAWS ecosystem, with hands-on exposure toDatabricks,...
-
Senior Associate Security Platform Engineer
6 days ago
Hyderabad, Telangana, India NTT DATA Full time ₹ 12,00,000 - ₹ 36,00,000 per yearContinue to make an impact with a company that is pushing the boundaries of what is possible. At NTT DATA, we are renowned for our technical excellence, leading innovations, and making a difference for our clients and society. Our workplace embraces diversity and inclusion – it's a place where you can continue to grow, belong, and thrive.Your career here...
-
Senior Data Engineer
1 week ago
Hyderabad, Telangana, India Straive Full timeJob SummaryWe're looking for aSenior Data Engineerwith 5-8 years of experience to build and maintain scalable, production-grade data pipelines. The ideal candidate is a strong software engineer with hands-on experience in Spark (3.x), Scala, SQL, and Python. You'll be responsible for designing and implementing ETL/ELT solutions, collaborating with teams to...
-
Senior/Lead Data Engineer
2 weeks ago
Hyderabad, Telangana, India People Prime Worldwide Full timeSenior Azure Data EngineerJob Details:Role: Senior Azure Data EngineerExperience: 7-10 YearsLocation: HyderabadInterview Mode: F2FNotice Period Preference: Immediate to 30 DaysJob Overview:We are seeking a highly skilled Senior Data Engineer with deep expertise in Microsoft Azure data ecosystem to design, develop, and maintain scalable data pipelines...
-
Senior Data Engineers
6 days ago
Hyderabad, Telangana, India SID Information Technologies Full time ₹ 8,00,000 - ₹ 24,00,000 per yearhiring #Hiring #hyderabad #hyderabadjob #HyderabadJobs #immediatejoiner #opportunity #CareerOpportunity #Senior #TechJobs #dataengineer #DataEngineering #DataArchitect #DataEngineeringJobs #HealthcareDataCloudComputing #BigData #DataAnalytics #PlatformEngineering #Terraform #Kubernetes #SQL #Python #Scala #apachespark #pyspark #ETLpipeline #PySpark...
-
Senior Data Engineer
14 hours ago
Hyderabad, Telangana, India Accellor Full timeAt Accellor, we are a trusted digital transformation partner that uses best-of-breed Cloud technology to deliver superior customer engagement and business effectiveness for clients. We've created an atmosphere that encourages curiosity, constant learning, and persistence. We encourage our employees to grow and explore their interests. We cultivate...
-
Senior Data Engineer
13 hours ago
Hyderabad, Telangana, India Accellor Full timeAt Accellor, we are a trusted digital transformation partner that uses best-of-breed Cloud technology to deliver superior customer engagement and business effectiveness for clients. We've created an atmosphere that encourages curiosity, constant learning, and persistence. We encourage our employees to grow and explore their interests. We cultivate...