Senior Pyspark Data Engineer

3 days ago


Hyderabad, Telangana, India DATAECONOMY Full time ₹ 12,00,000 - ₹ 24,00,000 per year

About Us
About DATAECONOMY: We are a fast-growing data & analytics company headquartered in Dublin with offices inDublin, OH, Providence, RI, and an advanced technology center in Hyderabad,India. We are clearly differentiated in the data & analytics space via our suite of solutions, accelerators, frameworks, and thought leadership.

Job Description
Job Title:
PySpark Data Engineer

Experience:
8+ Years

Location:
Hyderabad

Employment Type:
Full-Time

Job Summary
We are looking for a skilled and experienced
PySpark Data Engineer
to join our growing data engineering team. The ideal candidate will have 8+ years of experience in designing and implementing data pipelines using
PySpark
,
AWS Glue
, and
Apache Airflow
, with strong proficiency in
SQL
. You will be responsible for building scalable data processing solutions, optimizing data workflows, and collaborating with cross-functional teams to deliver high-quality data assets.

Responsibilities
Key Responsibilities:

  • Design, develop, and maintain large-scale ETL pipelines using PySpark and AWS Glue.
  • Orchestrate and schedule data workflows using Apache Airflow.
  • Optimize data processing jobs for performance and cost-efficiency.
  • Work with large datasets from various sources, ensuring data quality and consistency.
  • Collaborate with Data Scientists, Analysts, and other Engineers to understand data requirements and deliver solutions.
  • Write efficient, reusable, and well-documented code following best practices.
  • Monitor data pipeline health and performance; resolve data-related issues proactively.
  • Participate in code reviews, architecture discussions, and performance tuning.

Requirements

  • 8+ years of experience in data engineering roles.
  • Strong expertise in PySpark for distributed data processing.
  • Hands-on experience with AWS Glue and other AWS data services (S3, Athena, Lambda, etc.).
  • Experience with Apache Airflow for workflow orchestration.
  • Strong proficiency in SQL for data extraction, transformation, and analysis.
  • Familiarity with data modeling concepts and data lake/data warehouse architectures.
  • Experience with version control systems (e.g., Git) and CI/CD processes.
  • Ability to write clean, scalable, and production-grade code.

Benefits
Company Standard Benefits.



  • Hyderabad, Telangana, India DATAECONOMY Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Job Title: PySpark Data EngineerExperience: 8 YearsLocation: HyderabadEmployment Type: Full-Time Job Summary: We are looking for a skilled and experienced PySpark Data Engineer to join our growing data engineering team. The ideal candidate will have 8 years of experience in designing and implementing data pipelines using PySpark, AWS Glue, and Apache...


  • Hyderabad, Telangana, India DataEconomy Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Job InformationDate Opened10/13/2025Job TypeFull timeIndustryIT ServicesCityHyderabadState/ProvinceTelanganaCountryIndiaZip/Postal Code500081About UsAbout DATAECONOMY: We are a fast-growing data & analytics company headquartered in Dublin with offices inDublin, OH, Providence, RI, and an advanced technology center in Hyderabad,India. We are clearly...

  • Pyspark Developer

    3 days ago


    Hyderabad, Telangana, India NTT DATA Business Solutions Full time ₹ 8,00,000 - ₹ 12,00,000 per year

    Job SummaryWe are looking for a Senior PySpark Developer with 3 to 6 years of experience in building and optimizing data pipelines using PySpark on Databricks, within AWS cloud environments. This role focuses on the modernization of legacy domains, involving integration with systems like Kafka and collaboration across cross-functional teams.Key...


  • Hyderabad, Telangana, India CirrusLabs Full time

    We areCirrusLabs. Our vision is to become the world's most sought-after niche digital transformation company that helps customers realize value through innovation. Our mission is to co-create success with our customers, partners and community. Our goal is to enable employees to dream, grow and make things happen. We are committed to excellence. We are a...


  • Hyderabad, Telangana, India MatchPoint Full time ₹ 1,50,000 - ₹ 28,00,000 per year

    Role:Lead Data Engineer / Senior Data Engineer / Sr. Data platform engineer(with SQL, Python, and PySpark)Work experiance: 8 + yearsLocation: Hyderabad-(Onsite)Responsibilities:• Develop and enhance data-processing, orchestration, monitoring, and more by leveraging popular open-source software, AWS, and GitLab automation.• Collaborate with product and...

  • PySpark Developer

    1 week ago


    Hyderabad, Telangana, India algoleap Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Job SummaryWe are looking for a Senior PySpark Developer with 3 to 6 years of experience in building and optimizing data pipelines using PySpark on Databricks, within AWS cloud environments. This role focuses on the modernization of legacy domains, involving integration with systems like Kafka and collaboration across cross-functional teams.Key...


  • Hyderabad, Telangana, India People Prime Worldwide Full time

    Senior Azure Data EngineerJob Details:Role: Senior Azure Data EngineerExperience: 7-10 YearsLocation: HyderabadInterview Mode: F2FNotice Period Preference: Immediate to 30 DaysJob Overview:We are seeking a highly skilled Senior Data Engineer with deep expertise in Microsoft Azure data ecosystem to design, develop, and maintain scalable data pipelines...


  • Hyderabad, Telangana, India Zorba AI Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Key Skills Required-Minimum 6 years of working experience in Python, Pyspark, AWS and SQL.Programming & Frameworks: Python, PySparkDatabases & Querying: Strong SQL (query optimization, joins, window functions)Big Data & Processing: PySpark for distributed data processing, ETL pipelinesCloud Platform: AWS (S3, Glue, Lambda, EMR, Redshift, Athena)Data...

  • Pyspark

    3 days ago


    Hyderabad, Telangana, India Cirruslabs Full time

    Led the data integration efforts for enterprise-scale analytics and warehousing projects.Designed and developed PySpark scriptsboth generic frameworks and project-specific solutions—to handle complex ETL workflows.Created and managed process schedules to automate data ingestion, transformation, and loading pipelines.Developed and optimized data integration...


  • Hyderabad, Telangana, India Cyepro Solutions Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    Company Overview:Cyepro Solutions is at the forefront of innovation in customer relationship management, specializing in the automotive industry. We offer a platform that empowers dealerships, manufacturers, and service providers to enhance customer experiences and streamline operations. Headquartered in Hyderabad, Telangana, with a team of employees, Cyepro...