Lead Data Platform Engineer – PySpark, SQL, AWS
5 days ago
Type: Permanent
Location: Hyderabad (5 Days Onsite)
Salary: 33 L Per Annum
Experience Required - Years exp 10-13 yrs
Responsibilities
• Develop and enhance data-processing, orchestration, monitoring, and more by leveraging popular open-source software, AWS, and GitLab automation.
• Collaborate with product and technology teams to design and validate the capabilities of the data platform
• Identify, design, and implement process improvements: automating manual processes, optimizing for usability, re-designing for greater scalability
• Provide technical support and usage guidance to the users of our platform's services.
• Drive the creation and refinement of metrics, monitoring, and alerting mechanisms to give us the visibility we need into our production services.
Qualifications
• Experience building and optimizing data pipelines in a distributed environment
• Experience supporting and working with cross-functional teams
• Proficiency working in Linux environment
• 4+ years of advanced working knowledge of SQL, Python, and PySpark
- PySpark queries --- MUST
 
• Knowledge on Palantir
• Experience using tools such as: Git/Bitbucket, Jenkins/CodeBuild, Code Pipeline
• Experience with platform monitoring and alerts tools
- 
					
						Date Engineer(Python, Pyspark and AWS)
8 hours ago
Hyderabad, Telangana, India Zorba AI Full time ₹ 15,00,000 - ₹ 25,00,000 per yearKey Skills Required-Minimum 6 years of working experience in Python, Pyspark, AWS and SQL.Programming & Frameworks: Python, PySparkDatabases & Querying: Strong SQL (query optimization, joins, window functions)Big Data & Processing: PySpark for distributed data processing, ETL pipelinesCloud Platform: AWS (S3, Glue, Lambda, EMR, Redshift, Athena)Data...
 - 
					
						AWS Data Engineer
5 days ago
Hyderabad, Telangana, India Zorba AI Full time ₹ 1,00,00,000 - ₹ 2,50,00,000 per yearSenior AWS Data Engineer (PySpark & Python) — On-site, IndiaIndustry & Sector:Leading IT services & cloud data engineering sector focused on end-to-end data platforms, analytics, and enterprise-scale ETL/ELT solutions. We deliver production-grade data pipelines, real-time streaming, and analytics integrations for large enterprise customers across finance,...
 - 
					
						Pyspark Data Engineer
2 weeks ago
Hyderabad, Telangana, India Enexus Global Inc. Full time ₹ 5,00,000 - ₹ 15,00,000 per yearTitle: PySpark Data EngineerExp: 6+Hyderabad, India____Required QualificationsBachelor's or Master's degree in Computer Science, Engineering, or a related field.5+ years of experience in data engineering, with a strong background in PySpark and Apache Spark .Extensive experience in building and optimizing data pipelines and ETL processes.Proficiency...
 - 
					
						Lead Data Engineer
4 days ago
Hyderabad, Telangana, India Zorba Consulting Full time ₹ 12,00,000 - ₹ 36,00,000 per yearDescription : Primary Job Title : Data Engineering Lead.About The Opportunity : We are seeking a highly skilled Lead Data Engineer with strong expertise in Python, Pandas, PySpark, AWS, and SQL to design, build, and manage scalable data solutions. The ideal candidate will lead a team of data engineers, develop robust ETL pipelines, and collaborate...
 - 
					
						AWS Data Engineer
2 weeks ago
Hyderabad, Telangana, India NextByt Innovations Full time ₹ 20,00,000 - ₹ 25,00,000 per yearJob Description – AWS Data Engineer Location: Hyderabad / Bangalore Job Type: Contract | Work from Office Experience: 5+ Years Work Mode: 5 Days Working (Mon–Fri)About the RoleWe are seeking a skilled AWS Data Engineer with hands-on expertise in AWS Glue, PySpark, SQL, and Python. This is a contract-based hybrid role requiring strong data engineering...
 - 
					
Aws Data Engineer
2 weeks ago
Hyderabad, Telangana, India Sutherland Full time ₹ 15,00,000 - ₹ 25,00,000 per yearKey ResponsibilitiesAWS Glue job development and optimizationLake Formation security and governance implementationData pipeline development and maintenancePlatform feature development and testingDocumentation and runbook creationRequired Technical SkillsAWS Glue ETL development and optimizationAWS Lake Formation security and governancePython and SQL...
 - 
					
						AWS Data Engineer
2 weeks ago
Hyderabad, Telangana, India Talent Worx Full time ₹ 8,00,000 - ₹ 24,00,000 per yearSenior AWS Data EngineerOverview:We are seeking experienced AWS Data Engineers to design, implement, and maintain robust data pipelines and analytics solutions using AWS services. The ideal candidate will have a strong background in AWS data services, big data technologies, and programming languages.Exp- 3 to 7 years Location- Bangalore, Pune, Hyderabad,...
 - 
					
						PySpark & ETL Data Engineer
2 weeks ago
Hyderabad, Telangana, India CirrusLabs Full timeWe areCirrusLabs. Our vision is to become the world's most sought-after niche digital transformation company that helps customers realize value through innovation. Our mission is to co-create success with our customers, partners and community. Our goal is to enable employees to dream, grow and make things happen. We are committed to excellence. We are a...
 - 
					
Senior / Lead - Data Engineer - AWS
7 days ago
Hyderabad, Telangana, India Blend Full time ₹ 8,00,000 - ₹ 24,00,000 per year*Company Description*Blend is a premier AI services provider, committed to co-creating meaningful impact for its clients through the power of data science, AI, technology, and people. With a mission to fuel bold visions, Blend tackles significant challenges by seamlessly aligning human expertise with artificial intelligence. The company is dedicated to...
 - 
					
						Sr. Data Engineer – AWS Databricks
5 days ago
Hyderabad, Telangana, India Gravity Infosolutions, Inc. Full time ₹ 8,00,000 - ₹ 12,00,000 per yearSr. Data Engineer – AWS Databricks / Data Tech LeadType: ContractLocation : Chennai / HydExperience: 5+ yearsDuration: 3 Months+ ExtendableKey ResponsibilitiesData Pipeline Development: Design and implement robust ETL/ELT pipelines using Databricks, PySpark, and Delta Lake to process structured and unstructured data efficiently.Manage job orchestration,...