Date Engineer(Python, Pyspark and AWS)

5 hours ago

Hyderabad, India Zorba AI Full time

Key Skills Required-

  • Minimum 6 years of working experience in Python, Pyspark, AWS and SQL.
  • Programming & Frameworks: Python, PySpark
  • Databases & Querying: Strong SQL (query optimization, joins, window functions)
  • Big Data & Processing: PySpark for distributed data processing, ETL pipelines
  • Cloud Platform: AWS (S3, Glue, Lambda, EMR, Redshift, Athena)
  • Data Engineering: Data pipeline design, data ingestion, transformation, and integration
  • Other Nice-to-Have: Airflow (or other orchestration tools), CI/CD, Docker


Responsibilities

  • Design and develop scalable ETL pipelines using PySpark and SQL
  • Manage data ingestion & transformation on AWS cloud (S3, Glue, EMR, Redshift)
  • Optimize SQL queries for performance in large-scale datasets
  • Collaborate with data scientists and analysts for data availability & quality
  • Implement best practices in data engineering (partitioning, schema design, data governance)
  • Monitor, debug, and optimize pipeline performance

Skills: sql,python,pyspark,data engineer,aws

  • Data Engineer

    3 days ago

    Hyderabad, India Haruto Full time

    Job Title: Data EngineerLocation: Hybrid (Hyderabad)Experience: 3+ YearsJob Description:We are looking for a skilled Data Engineer to design, build, and maintain scalable data pipelines using modern cloud and data engineering tools. The ideal candidate should have hands-on experience with Databricks, AWS, and Python-based frameworks, and be capable of...

  • Python Data Engineer

    2 weeks ago

    Chennai, Hyderabad, India CULMINANT EXECUTIVE SERVICES PRIVATE LIMITED Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Dear Candidate ,We are hiring for a  "Python Data Engineer  " role for a leading MNC . Experience : 4 to 8 yearsLocation :  Chennai , HyderabadInterview Date : 23rd Aug 2025 (Saturday)Interview Mode : Face to FaceSkills: AWS, Python, Pyspark / Snowflake, Python, Pyspark / Bigdata, Python, Pyspark (experience in any 1 full combination)

  • Python Pyspark/Scala Snowflake

    2 weeks ago

    Chennai, Hyderabad, India Virtusa Full time ₹ 8,00,000 - ₹ 12,00,000 per year

    Skill Required 1 - Python AND Pyspark (OR) Scala AND SnowflakeSkill Required 2- Python AND Pyspark (OR) Scala AND AWSSkill Required 3 - Python AND Pyspark (OR) Scala AND BigData

  • AWS Data Engineer

    3 days ago

    Hyderabad, India Deqode Full time

    Key Responsibilities : - Design, develop, and maintain scalable data pipelines and architectures using AWS services.- Implement ETL/ELT processes using AWS Glue, Lambda, and Step Functions.- Work with structured and unstructured data across S3, Redshift, and other AWS data services.- Develop data integration workflows to collect, process, and store data...

  • Python/AWS Engineer

    2 weeks ago

    Hyderabad, Telangana, India Deqode Full time

    Job Summary :We are looking for a skilled and motivated Python AWS Engineer to join our team. The ideal candidate will have strong experience in backend development using Python, cloud infrastructure on AWS, and building serverless or microservices-based architectures. You will work closely with cross-functional teams to design, develop, deploy, and maintain...

  • Python Pyspark

    1 week ago

    Hyderabad, Telangana, India Cognizant Full time

    **Skill**: Python, Pyspark **Experience**: 4 to 16 years **Location**: Hyderabad **Walkin date**: 8th Feb 25 - **Proven experience as a Python Developer with expertise in PySpark.**: - **Strong knowledge of Python and its libraries (e.g., Pandas, NumPy).**: - **Experience with Apache Spark, including Spark SQL, DataFrames, and Spark Streaming.**: -...

  • Data Engineer

    3 days ago

    Hyderabad, India Hire Alpha Full time

    Primary Skills :- Strong in Python Programming, Pyspark queries, AWS, GIS, Palantir Foundry.- PySpark queries MUST.Experience : 15+ Years.Location : Hyderabad (5 days a week Work from Office).Responsibilities :- Develop and enhance data-processing, orchestration, monitoring, and more by leveraging popular open-source software, AWS, and GitLab automation.-...

  • Pyspark Solutions Architect

    2 weeks ago

    Hyderabad, Telangana, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Opportunity:We are seeking a seasoned Data Engineer Architect to join our team.About the Role:You will be responsible for designing and implementing scalable data engineering solutions using PySpark. Your expertise in AWS, Python, and cloud technologies such as Google and Azure will play a crucial role in driving business growth.Key...

  • Python,pyspark,apachespark

    5 days ago

    Hyderabad, Telangana, India NTT DATA Full time

    **Req ID**: 327070 We are currently seeking a python,pySpark,ApacheSpark to join our team in Hyderabad, Telangana (IN-TG), India (IN). NTT DATA Services currently seeks Python Developer to join our team in Hyderabad Design and build ETL solutions with experience in data engineering, data modelling in large-scale in both batch and real-time...

  • Python Pyspark

    5 days ago

    Hyderabad, Telangana, India Vega IntelliSoft Private Limited Full time

    Design and build ETL solutions with experience in data engineering, data modelling in large-scale in both batch and real-time environments. Skills required: Python, PySpark, Apache Spark, Unix Shell Scripting, GCP, Big query, MongoDB, Kafka event streaming, API development, CI/CD. Additional skills: Teradata, SQL Server, Ab Initio