Lead Data Platform Engineer – PySpark, SQL, AWS

5 days ago


Hyderabad, Telangana, India MatchPoint Full time ₹ 33,00,000 per year

Type: Permanent

Location: Hyderabad (5 Days Onsite)

Salary: 33 L Per Annum

Experience Required - Years exp 10-13 yrs

Responsibilities


• Develop and enhance data-processing, orchestration, monitoring, and more by leveraging popular open-source software, AWS, and GitLab automation.


• Collaborate with product and technology teams to design and validate the capabilities of the data platform


• Identify, design, and implement process improvements: automating manual processes, optimizing for usability, re-designing for greater scalability


• Provide technical support and usage guidance to the users of our platform's services.


• Drive the creation and refinement of metrics, monitoring, and alerting mechanisms to give us the visibility we need into our production services.

Qualifications


• Experience building and optimizing data pipelines in a distributed environment


• Experience supporting and working with cross-functional teams


• Proficiency working in Linux environment


• 4+ years of advanced working knowledge of SQL, Python, and PySpark

  • PySpark queries --- MUST


• Knowledge on Palantir


• Experience using tools such as: Git/Bitbucket, Jenkins/CodeBuild, Code Pipeline


• Experience with platform monitoring and alerts tools



  • Hyderabad, Telangana, India Zorba AI Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Key Skills Required-Minimum 6 years of working experience in Python, Pyspark, AWS and SQL.Programming & Frameworks: Python, PySparkDatabases & Querying: Strong SQL (query optimization, joins, window functions)Big Data & Processing: PySpark for distributed data processing, ETL pipelinesCloud Platform: AWS (S3, Glue, Lambda, EMR, Redshift, Athena)Data...

  • AWS Data Engineer

    5 days ago


    Hyderabad, Telangana, India Zorba AI Full time ₹ 1,00,00,000 - ₹ 2,50,00,000 per year

    Senior AWS Data Engineer (PySpark & Python) — On-site, IndiaIndustry & Sector:Leading IT services & cloud data engineering sector focused on end-to-end data platforms, analytics, and enterprise-scale ETL/ELT solutions. We deliver production-grade data pipelines, real-time streaming, and analytics integrations for large enterprise customers across finance,...

  • Pyspark Data Engineer

    2 weeks ago


    Hyderabad, Telangana, India Enexus Global Inc. Full time ₹ 5,00,000 - ₹ 15,00,000 per year

    Title: PySpark Data EngineerExp: 6+Hyderabad, India____Required QualificationsBachelor's or Master's degree in Computer Science, Engineering, or a related field.5+ years of experience in data engineering, with a strong background in PySpark and Apache Spark .Extensive experience in building and optimizing data pipelines and ETL processes.Proficiency...

  • Lead Data Engineer

    4 days ago


    Hyderabad, Telangana, India Zorba Consulting Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Description : Primary Job Title : Data Engineering Lead.About The Opportunity : We are seeking a highly skilled Lead Data Engineer with strong expertise in Python, Pandas, PySpark, AWS, and SQL to design, build, and manage scalable data solutions. The ideal candidate will lead a team of data engineers, develop robust ETL pipelines, and collaborate...

  • AWS Data Engineer

    2 weeks ago


    Hyderabad, Telangana, India NextByt Innovations Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Job Description – AWS Data Engineer Location: Hyderabad / Bangalore Job Type: Contract | Work from Office Experience: 5+ Years Work Mode: 5 Days Working (Mon–Fri)About the RoleWe are seeking a skilled AWS Data Engineer with hands-on expertise in AWS Glue, PySpark, SQL, and Python. This is a contract-based hybrid role requiring strong data engineering...

  • Aws Data Engineer

    2 weeks ago


    Hyderabad, Telangana, India Sutherland Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Key ResponsibilitiesAWS Glue job development and optimizationLake Formation security and governance implementationData pipeline development and maintenancePlatform feature development and testingDocumentation and runbook creationRequired Technical SkillsAWS Glue ETL development and optimizationAWS Lake Formation security and governancePython and SQL...

  • AWS Data Engineer

    2 weeks ago


    Hyderabad, Telangana, India Talent Worx Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    Senior AWS Data EngineerOverview:We are seeking experienced AWS Data Engineers to design, implement, and maintain robust data pipelines and analytics solutions using AWS services. The ideal candidate will have a strong background in AWS data services, big data technologies, and programming languages.Exp- 3 to 7 years Location- Bangalore, Pune, Hyderabad,...


  • Hyderabad, Telangana, India CirrusLabs Full time

    We areCirrusLabs. Our vision is to become the world's most sought-after niche digital transformation company that helps customers realize value through innovation. Our mission is to co-create success with our customers, partners and community. Our goal is to enable employees to dream, grow and make things happen. We are committed to excellence. We are a...


  • Hyderabad, Telangana, India Blend Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    *Company Description*Blend is a premier AI services provider, committed to co-creating meaningful impact for its clients through the power of data science, AI, technology, and people. With a mission to fuel bold visions, Blend tackles significant challenges by seamlessly aligning human expertise with artificial intelligence. The company is dedicated to...


  • Hyderabad, Telangana, India Gravity Infosolutions, Inc. Full time ₹ 8,00,000 - ₹ 12,00,000 per year

    Sr. Data Engineer – AWS Databricks / Data Tech LeadType: ContractLocation : Chennai / HydExperience: 5+ yearsDuration: 3 Months+ ExtendableKey ResponsibilitiesData Pipeline Development: Design and implement robust ETL/ELT pipelines using Databricks, PySpark, and Delta Lake to process structured and unstructured data efficiently.Manage job orchestration,...