Lead Data Platform Engineer – PySpark, SQL, AWS

2 weeks ago

Hyderabad, Telangana, India MatchPoint Full time ₹ 3,30,000 per year

Type: Permanent

Location: Hyderabad (5 Days Onsite)

Salary: 33 L Per Annum

Experience Required - Years exp 10-13 yrs

Responsibilities


• Develop and enhance data-processing, orchestration, monitoring, and more by leveraging popular open-source software, AWS, and GitLab automation.


• Collaborate with product and technology teams to design and validate the capabilities of the data platform


• Identify, design, and implement process improvements: automating manual processes, optimizing for usability, re-designing for greater scalability


• Provide technical support and usage guidance to the users of our platform's services.


• Drive the creation and refinement of metrics, monitoring, and alerting mechanisms to give us the visibility we need into our production services.

Qualifications


• Experience building and optimizing data pipelines in a distributed environment


• Experience supporting and working with cross-functional teams


• Proficiency working in Linux environment


• 4+ years of advanced working knowledge of SQL, Python, and PySpark

  • PySpark queries --- MUST


• Knowledge on Palantir


• Experience using tools such as: Git/Bitbucket, Jenkins/CodeBuild, Code Pipeline


• Experience with platform monitoring and alerts tools

  • Lead Data Platform Engineer – PySpark, SQL, AWS

    1 week ago

    Hyderabad, Telangana, India MatchPoint Full time

    Type: PermanentLocation: Hyderabad (5 Days Onsite)Salary: 33 L Per AnnumExperience Required - Years exp 10-13 yrsResponsibilities• Develop and enhance data-processing, orchestration, monitoring, and more by leveraging popular open-source software, AWS, and GitLab automation.• Collaborate with product and technology teams to design and validate the...

  • Lead Data Platform Engineer – PySpark, SQL, AWS

    1 week ago

    Hyderabad, Telangana, India MatchPoint Full time

    Type: PermanentLocation: Hyderabad (5 Days Onsite)Salary: 33 L Per AnnumExperience Required - Years exp 10-13 yrsResponsibilities• Develop and enhance data-processing, orchestration, monitoring, and more by leveraging popular open-source software, AWS, and GitLab automation.• Collaborate with product and technology teams to design and validate the...

  • Date Engineer(Python, Pyspark and AWS)

    4 days ago

    Hyderabad, Telangana, India Zorba AI Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Key Skills Required-Minimum 6 years of working experience in Python, Pyspark, AWS and SQL.Programming & Frameworks: Python, PySparkDatabases & Querying: Strong SQL (query optimization, joins, window functions)Big Data & Processing: PySpark for distributed data processing, ETL pipelinesCloud Platform: AWS (S3, Glue, Lambda, EMR, Redshift, Athena)Data...

  • AWS Data Engineer

    1 week ago

    Hyderabad, Telangana, India Zorba AI Full time ₹ 15,00,000 - ₹ 28,00,000 per year

    Senior AWS Data Engineer (PySpark & Python) — On-site, IndiaIndustry & Sector:Leading IT services & cloud data engineering sector focused on end-to-end data platforms, analytics, and enterprise-scale ETL/ELT solutions. We deliver production-grade data pipelines, real-time streaming, and analytics integrations for large enterprise customers across finance,...

  • AWS Data Engineer

    4 weeks ago

    Hyderabad, Telangana, India STANCO Solutions Pvt Ltd Full time

    Hiring for AWS Data EngineerExperience: 5+ YearsSkill Set: AWS, Python, Pyspark, Spark, ScalaLocation: Hyderabad, ChennaiSalary: 35 LPANotice Period: Immediate to 15 DaysJD:-Primary Skills: Python, Pyspark, Glue, Redshift, Lambda, DMS, RDS ,Cloud Formation and other AWS serverlessStrong exp in SQLDetailed JD:-Seeking a developer who has good Experience in...

  • AWS Data Engineer

    2 weeks ago

    Hyderabad, Telangana, India NextByt Innovations Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    Job Description – AWS Data Engineer Location: Hyderabad / Bangalore Job Type: Contract | Work from Office Experience: 5+ Years Work Mode: 5 Days Working (Mon–Fri)About the RoleWe are seeking a skilled AWS Data Engineer with hands-on expertise in AWS Glue, PySpark, SQL, and Python. This is a contract-based hybrid role requiring strong data engineering...

  • AWS Data Engineer

    3 weeks ago

    Hyderabad, Telangana, India STANCO Solutions Pvt Ltd Full time

    Hiring for AWS Data EngineerExperience: 5+ YearsSkill Set: AWS, Python, Pyspark, Spark, ScalaLocation: Hyderabad, ChennaiSalary: 35 LPANotice Period: Immediate to 15 DaysJD:-Primary Skills: Python, Pyspark, Glue, Redshift, Lambda, DMS, RDS ,Cloud Formation and other AWS serverlessStrong exp in SQLDetailed JD:-Seeking a developer who has good Experience in...

  • AWS Data Engineer

    3 weeks ago

    Hyderabad, Telangana, India STANCO Solutions Pvt Ltd Full time

    Hiring for AWS Data Engineer Experience: 5+ Years Skill Set: AWS, Python, Pyspark, Spark, Scala Location: Hyderabad, Chennai Salary: 35 LPA Notice Period: Immediate to 15 Days JD:- Primary Skills: Python, Pyspark, Glue, Redshift, Lambda, DMS, RDS ,Cloud Formation and other AWS serverless Strong exp in SQL Detailed JD:- Seeking a developer who has good...

  • AWS Data Engineer

    2 weeks ago

    Hyderabad, Telangana, India Saransh Inc Full time

    We're Growing Our Data Engineering TeamRole: AWS Data EngineerExperience: 4 to 12 years (only relevant profiles will be considered)Locations: Hyderabad | Bangalore | Pune | ChennaiWork Timing: 2:00 PM – 11:00 PMWork Mode: FTE-HybridMust-Have Skills- PySpark – advanced performance optimization- AWS Services – Redshift, Glue, Athena, Lambda, DMS, RDS,...

  • AWS Data Engineer

    2 weeks ago

    Hyderabad, Telangana, India Saransh Inc Full time

    We're Growing Our Data Engineering Team Role: AWS Data Engineer Experience: 4 to 12 years (only relevant profiles will be considered ) Locations: Hyderabad | Bangalore | Pune | Chennai Work Timing: 2:00 PM – 11:00 PM Work Mode: FTE-Hybrid Must-Have Skills PySpark – advanced performance optimization AWS Services – Redshift, Glue, Athena,...