Senior Pyspark Data Engineer

1 week ago

Hyderabad, Telangana, India DataEconomy Full time ₹ 20,00,000 - ₹ 25,00,000 per year
Job Information

Date Opened

10/13/2025

Job Type

Full time

Industry

IT Services

City

Hyderabad

State/Province

Telangana

Country

India

Zip/Postal Code

500081

About Us

About DATAECONOMY: We are a fast-growing data & analytics company headquartered in Dublin with offices inDublin, OH, Providence, RI, and an advanced technology center in Hyderabad,India. We are clearly differentiated in the data & analytics space via our suite of solutions, accelerators, frameworks, and thought leadership.

Job Description

Job Title: PySpark Data Engineer

Experience: 8+ Years

Location: Hyderabad

Employment Type: Full-Time

Job Summary:

We are looking for a skilled and experienced PySpark Data Engineer to join our growing data engineering team. The ideal candidate will have 8+ years of experience in designing and implementing data pipelines using PySpark, AWS Glue, and Apache Airflow, with strong proficiency in SQL. You will be responsible for building scalable data processing solutions, optimizing data workflows, and collaborating with cross-functional teams to deliver high-quality data assets.

Key Responsibilities:

  • Design, develop, and maintain large-scale ETL pipelines using PySpark and AWS Glue.
  • Orchestrate and schedule data workflows using Apache Airflow.
  • Optimize data processing jobs for performance and cost-efficiency.
  • Work with large datasets from various sources, ensuring data quality and consistency.
  • Collaborate with Data Scientists, Analysts, and other Engineers to understand data requirements and deliver solutions.
  • Write efficient, reusable, and well-documented code following best practices.
  • Monitor data pipeline health and performance; resolve data-related issues proactively.
  • Participate in code reviews, architecture discussions, and performance tuning.
Requirements
  • 8+ years of experience in data engineering roles.
  • Strong expertise in PySpark for distributed data processing.
  • Hands-on experience with AWS Glue and other AWS data services (S3, Athena, Lambda, etc.).
  • Experience with Apache Airflow for workflow orchestration.
  • Strong proficiency in SQL for data extraction, transformation, and analysis.
  • Familiarity with data modeling concepts and data lake/data warehouse architectures.
  • Experience with version control systems (e.g., Git) and CI/CD processes.
  • Ability to write clean, scalable, and production-grade code.
Benefits

Company Standard Benefits.

  • Senior Pyspark Data Engineer

    7 days ago

    Hyderabad, Telangana, India DATAECONOMY Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Job Title: PySpark Data EngineerExperience: 8 YearsLocation: HyderabadEmployment Type: Full-Time Job Summary: We are looking for a skilled and experienced PySpark Data Engineer to join our growing data engineering team. The ideal candidate will have 8 years of experience in designing and implementing data pipelines using PySpark, AWS Glue, and Apache...

  • PySpark & ETL Data Engineer

    1 hour ago

    Hyderabad, Telangana, India CirrusLabs Full time

    We areCirrusLabs. Our vision is to become the world's most sought-after niche digital transformation company that helps customers realize value through innovation. Our mission is to co-create success with our customers, partners and community. Our goal is to enable employees to dream, grow and make things happen. We are committed to excellence. We are a...

  • Senior Data Engineer

    2 weeks ago

    Hyderabad, Telangana, India Enable Data Incorporated Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Experience Required: 8+YearsMode of work: RemoteSkills Required: Azure DataBricks, Eventhub, Kafka, Architecture, Azure Data Factory, Pyspark, Python, SQL, SparkNotice Period : Immediate Joiners/ Permanent/Contract role (Can join within September 29th 2025)Translate business rules into technical specifications and implement scalable data solutions.Manage a...

  • Senior Data Engineer

    4 days ago

    Hyderabad, Telangana, India MatchPoint Full time ₹ 1,50,000 - ₹ 28,00,000 per year

    Role:Lead Data Engineer / Senior Data Engineer / Sr. Data platform engineer(with SQL, Python, and PySpark)Work experiance: 8 + yearsLocation: Hyderabad-(Onsite)Responsibilities:• Develop and enhance data-processing, orchestration, monitoring, and more by leveraging popular open-source software, AWS, and GitLab automation.• Collaborate with product and...

  • PySpark Developer

    5 days ago

    Hyderabad, Telangana, India algoleap Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Job SummaryWe are looking for a Senior PySpark Developer with 3 to 6 years of experience in building and optimizing data pipelines using PySpark on Databricks, within AWS cloud environments. This role focuses on the modernization of legacy domains, involving integration with systems like Kafka and collaboration across cross-functional teams.Key...

  • Databricks + Pyspark

    2 weeks ago

    Hyderabad, Telangana, India Cognizant Full time ₹ 1,00,00,000 - ₹ 3,00,00,000 per year

    Skills- Databricks+ PysparkExperience: 4 to 13 yearsLocation: AIA-PuneWe are looking for a highly skilled Data Engineer with expertise in PySpark and Databricks to design, build, and optimize scalable data pipelines for processing massive datasets.Key Responsibilities:Build & Optimize Pipelines: Develop high-throughput ETL workflows using PySpark on...

  • Date Engineer(Python, Pyspark and AWS)

    1 week ago

    Hyderabad, Telangana, India Zorba AI Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Key Skills Required-Minimum 6 years of working experience in Python, Pyspark, AWS and SQL.Programming & Frameworks: Python, PySparkDatabases & Querying: Strong SQL (query optimization, joins, window functions)Big Data & Processing: PySpark for distributed data processing, ETL pipelinesCloud Platform: AWS (S3, Glue, Lambda, EMR, Redshift, Athena)Data...

  • Data Engineer – AWS Glue, Redshift,, PySpark

    4 days ago

    Hyderabad, Telangana, India Cyepro Solutions Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    Company Overview:Cyepro Solutions is at the forefront of innovation in customer relationship management, specializing in the automotive industry. We offer a platform that empowers dealerships, manufacturers, and service providers to enhance customer experiences and streamline operations. Headquartered in Hyderabad, Telangana, with a team of employees, Cyepro...

  • Senior Data Engineer

    5 days ago

    Hyderabad, Telangana, India Saaki Argus and Averil Consulting Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    About the Client:One of thecloud and data analytics companythat empowers businesses to unlock insights and drive innovation through modern data solutions.Role:Senior Data Engineer (AWS)Experience:6 to 10 yearsLocation:Chennai & HyderabadNotice Period:Immediate Joiners / Max. 30 days / Serving Notice onlySkillsets:6 – 10 years of experience in Data...

  • Senior Data Engineer

    2 days ago

    Hyderabad, Telangana, India Tide Platform Private Limited Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Lead Data Engineer(pyspark) ABOUT TIDE At Tide, we are building a business management platform designed to save small businesses time and money. We provide our members with business accounts and related banking services, but also a comprehensive set of connected administrative solutions from invoicing to accounting. Launched in 2017, Tide is now...