Senior Data Engineer

4 days ago


Hyderabad, Telangana, India Valzo Soft Solutions Full time

Job Description
– Senior Data Engineer

Experience:
5–7 Years

Location:
Hyderabad, Telangana, India

Employment Type:
Full-Time

Joining:
Immediate Hiring

Position Overview

We are hiring a Senior Data Engineer to lead the development and optimization of scalable ETL/ELT pipelines using Azure Data Factory, Databricks, and PySpark. The role involves managing Data Lake structures, ensuring data quality, troubleshooting pipeline issues, and guiding junior engineers while delivering reliable, production-ready data solutions.

Key Responsibilities

Pipeline Construction: Develop, test, and deploy robust ETL/ELT data pipelines primarily using Azure Data Factory and Azure Databricks to ingest, transform, and load data into the Data Lake.

Data Transformation: Implement data cleansing, validation, and transformation logic using PySpark to ensure data quality and readiness for downstream consumption.

Data Lake Management: Assist in maintaining the organization and metadata of the Data Lake (ADLS Gen2) and ensuring compliance with established governance frameworks.

Monitoring and Support: Monitor deployed data pipelines, troubleshoot issues, and optimize existing processes for performance improvements under the guidance of Senior Engineers.

Documentation: Create and maintain technical documentation for data mappings, data flows, and ETL/ELT specifications.

Required Technical Skills

Strong hands-on experience with Azure Data Factory and Azure Data Lake Storage Gen2.

Proficiency in Azure Databricks and PySpark for scalable data processing.

Strong knowledge of SQL for data analysis and query optimization.

Familiarity with data warehousing concepts and data modeling principles.

Experience with one or more relational/NoSQL databases.

Working knowledge of source control tools like Git/Azure DevOps.


  • Azure Data Engineer

    6 days ago


    Hyderabad, Telangana, India Enable Data Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    Enable Data Incorporated is currently seeking a skilled and experienced Azure Data Engineer to join our dynamic team. As a leading provider of advanced application, data, and cloud engineering services, Enable Data has developed deep expertise across various industries. We work closely with our customers to leverage modern solutions and technologies to drive...


  • Hyderabad, Telangana, India WalkingTree Technologies Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    Company DescriptionFounded in 2008, WalkingTree Technologies is a pioneering IT services company specializing in digital and data solutions. We collaborate with our clients to shape and execute their data and digital strategies, unlocking their full potential. Our core strengths in Product Engineering, Digital Transformation, and Modernization create a...

  • Senior Data Engineer

    2 weeks ago


    Hyderabad, Telangana, India Sonatype Full time ₹ 12,00,000 - ₹ 25,00,000 per year

    Role : Senior Data EngineerSonatype India - HybridWho We AreAt Sonatype, we help organizations build better, more secure software by enabling them to understand and control their software supply chains. Our products are trusted by thousands of engineering teams globally, providing critical insights into dependency health, license risk, and software security....


  • Hyderabad, Telangana, India Info Services Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Job Title: Senior Data EngineerJob SummaryWe are looking for a highly skilledSenior Data Engineerwith expertise in designing, building, and optimizing large-scale data pipelines and integration frameworks. The ideal candidate will have strong experience inbatch and near real-time data processingwithin theAWS ecosystem, with hands-on exposure toDatabricks,...


  • Hyderabad, Telangana, India NTT DATA Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Continue to make an impact with a company that is pushing the boundaries of what is possible. At NTT DATA, we are renowned for our technical excellence, leading innovations, and making a difference for our clients and society. Our workplace embraces diversity and inclusion – it's a place where you can continue to grow, belong, and thrive.Your career here...


  • Hyderabad, Telangana, India Straive Full time

    Job SummaryWe're looking for aSenior Data Engineerwith 5-8 years of experience to build and maintain scalable, production-grade data pipelines. The ideal candidate is a strong software engineer with hands-on experience in Spark (3.x), Scala, SQL, and Python. You'll be responsible for designing and implementing ETL/ELT solutions, collaborating with teams to...


  • Hyderabad, Telangana, India People Prime Worldwide Full time

    Senior Azure Data EngineerJob Details:Role: Senior Azure Data EngineerExperience: 7-10 YearsLocation: HyderabadInterview Mode: F2FNotice Period Preference: Immediate to 30 DaysJob Overview:We are seeking a highly skilled Senior Data Engineer with deep expertise in Microsoft Azure data ecosystem to design, develop, and maintain scalable data pipelines...


  • Hyderabad, Telangana, India SID Information Technologies Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    hiring #Hiring #hyderabad #hyderabadjob #HyderabadJobs #immediatejoiner #opportunity #CareerOpportunity #Senior #TechJobs #dataengineer #DataEngineering #DataArchitect #DataEngineeringJobs #HealthcareDataCloudComputing #BigData #DataAnalytics #PlatformEngineering #Terraform #Kubernetes #SQL #Python #Scala #apachespark #pyspark #ETLpipeline #PySpark...

  • Senior Data Engineer

    14 hours ago


    Hyderabad, Telangana, India Accellor Full time

    At Accellor, we are a trusted digital transformation partner that uses best-of-breed Cloud technology to deliver superior customer engagement and business effectiveness for clients. We've created an atmosphere that encourages curiosity, constant learning, and persistence. We encourage our employees to grow and explore their interests. We cultivate...

  • Senior Data Engineer

    13 hours ago


    Hyderabad, Telangana, India Accellor Full time

    At Accellor, we are a trusted digital transformation partner that uses best-of-breed Cloud technology to deliver superior customer engagement and business effectiveness for clients. We've created an atmosphere that encourages curiosity, constant learning, and persistence. We encourage our employees to grow and explore their interests. We cultivate...