Current jobs related to Senior PySpark Data Engineer - Hyderabad, Telangana - DATAECONOMY


  • Hyderabad, Telangana, India HTC Global Services Full time

    We are seeking a highly skilled Data Engineer to join our team at HTC Global Services. This role involves working on exciting projects utilizing PySpark and Azure Databricks.About the RoleAs a Data Engineer, you will be responsible for designing, building, and maintaining large-scale data processing systems. Your expertise in PySpark and Azure Databricks...


  • Hyderabad, Telangana, India HTC Global Services Full time

    We are seeking an experienced Lead PySpark Engineer to join our team at HTC Global Services. The ideal candidate will have a strong background in designing and implementing data pipelines using PySpark, as well as experience with Databricks.The successful candidate will have hands-on experience with data ingestion, transformation, and orchestration, and will...

  • Senior Data Engineer

    1 month ago


    Hyderabad, Telangana, India Alignity Solutions Full time

    Job DescriptionWe are seeking a highly skilled Data Engineering Lead to join our team at Alignity Solutions. As a Data Engineering Lead, you will be responsible for designing, building, and optimizing data pipelines and workflows throughout the development lifecycle. You will work closely with application development teams to align data engineering solutions...


  • Hyderabad, Telangana, India DATAECONOMY Full time

    Job SummaryWe are seeking a highly skilled PySpark Developer to join our dynamic team at DataEconomy. The ideal candidate will have a solid understanding of data warehousing concepts and ETL processes, as well as experience in designing and implementing robust metadata-driven data ingestion pipelines using PySpark.Key ResponsibilitiesDesign, implement, and...


  • Hyderabad, Telangana, India data Full time

    About the RoleWe are seeking an experienced Big Data Solutions Engineer to join our team in Hyderabad, India. As a key member of our engineering team, you will be responsible for designing and implementing complex data products components based on requirements with possible technical solutions.You will work closely with Data Scientists, Data Engineers,...


  • Hyderabad, Telangana, India data Full time

    Unlock the Power of Big DataWe are seeking an experienced Advanced Data Analytics Engineer to join our team in Hyderabad, India. As a key member of our engineering team, you will play a crucial role in designing and implementing innovative data products using agile methodologies and open-source technologies.About the RoleThis is an exciting opportunity to...


  • Hyderabad, Telangana, India Tata Consultancy Services Full time

    Job DescriptionAbout the Role:We are seeking an experienced Senior Big Data Engineer to join our team at Tata Consultancy Services. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining large-scale big data environments using PySpark.Key Responsibilities:Design and implement complex big data...


  • Hyderabad, Telangana, India N Consulting Ltd Full time

    **Job Title:** Senior GCP Data Engineer with ETL ExpertiseAbout N Consulting Ltd:We are a leading consulting firm specializing in data engineering and analytics. Our team of experts works closely with clients to design and implement efficient data pipelines that drive business growth.Salary Range: $140,000 - $200,000 per annumJob Description: We are seeking...


  • Hyderabad, Telangana, India Tata Consultancy Services Full time

    Job Title: Senior Big Data EngineerAbout Us: Tata Consultancy Services, a global leader in IT services and consulting, is seeking an experienced Senior Big Data Engineer to join our team.Estimated Salary: ₹1,200,000 - ₹1,500,000 per annum (dependent on location and experience).Job Description:The successful candidate will have hands-on experience with...

  • Senior Data Engineer

    3 weeks ago


    Hyderabad, Telangana, India Chiselon Technologies Pvt Ltd Full time

    Job DescriptionWe are seeking a highly skilled Senior Data Engineer - Cloud Technologies to join our team at Chiselon Technologies Pvt Ltd.About the RoleThis is a full-time position that requires immediate joiner, with a notice period of 5-7 years. As a Senior Data Engineer, you will be responsible for developing, testing, and maintaining scalable data...


  • Hyderabad, Telangana, India iVEGA Consulting Full time

    Job DescriptionWe are seeking an experienced Senior Azure Data Engineer Lead to join our team at iVEGA Consulting.Key Responsibilities:Design, build, and maintain scalable data pipelines in the Azure environment to ensure smooth operation in both batch and real-time processing.Optimize Azure data infrastructure to facilitate accurate data extraction,...


  • Hyderabad, Telangana, India Incube Consulting Full time

    Job SummaryThe ideal candidate will have experience in Pyspark, GCP-Airflow, GCP-DataProc and be proficient in SQL queries. Strong knowledge of big data technology, shell scripting, and data analysis is a plus. Responsibilities1. Interface with clients for quality assurance, issue resolution, and ensuring high customer satisfaction.2. Understand...

  • Data Engineer

    4 weeks ago


    Hyderabad, Telangana, India Overture Rede Private Limited Full time

    Data Engineering Role at Overture Rede Private LimitedAs a Senior Data Developer at Overture Rede Private Limited, you will be responsible for designing, building, and maintaining scalable data pipelines using PySpark on Azure. You will work closely with data scientists and analysts to understand data requirements and develop solutions on Azure, including...


  • Hyderabad, Telangana, India Synechron Full time

    Job OverviewA PySpark Developer with 5+ years of experience is required to work on big data projects using PySpark and GCP technologies. The ideal candidate will have strong skills in data processing, analytics, and software engineering.About UsSynechron is a global consulting firm that provides digital solutions for businesses. We believe in the power of...


  • Hyderabad, Telangana, India Aeries Technology Group Full time

    At Aeries Technology Group, we are seeking a highly skilled Senior Data Engineer to join our team. This is an exciting opportunity for someone who is passionate about designing and developing scalable data pipelines and architectures.Job Description:We are looking for a talented individual with experience in building data pipelines between source systems...


  • Hyderabad, Telangana, India Bristol Myers Squibb Full time

    About the RoleWe are seeking a highly skilled Senior Data Systems Engineer to join our team at Bristol Myers Squibb. As a key member of our data engineering group, you will be responsible for designing, building, and maintaining large-scale data systems that support our business needs.Job DescriptionThis is an exciting opportunity to work with cutting-edge...


  • Hyderabad, Telangana, India ADP Full time

    Job DescriptionWe are seeking a highly skilled Senior Data Engineer to join our team at ADP. As a key member of our engineering team, you will be responsible for designing, building, and implementing scalable data solutions using the latest DB technologies and No-sql databases.The ideal candidate will have a strong understanding of MS SQL, SSIS, PySpark, and...


  • Hyderabad, Telangana, India Accellor Full time

    We are seeking a highly skilled Data Fabric Engineer Lead to join our team at Accellor.About the RoleThis is an exceptional opportunity for a seasoned data engineering professional to take on a leadership role and drive innovation in our organization. As a Senior Data Fabric Developer, you will be responsible for designing, developing, and maintaining ETL...


  • Hyderabad, Telangana, India NTT DATA Full time

    Job Description:We are seeking a highly skilled Senior Data Engineer to join our team in Remote, Telangana (IN). This is a full-time position with 40 hours per week.About the Role:The successful candidate will design, develop, and maintain scalable data pipelines in the Python ecosystem. They will also participate in regular team ceremonies and contribute to...

  • Data Engineer Lead

    1 week ago


    Hyderabad, Telangana, India Tech Mahindra Full time

    We are looking for a skilled Data Engineer Lead to join our team at Tech Mahindra.Estimated salary for this position is ₹1,500,000 - ₹2,500,000 per annum.As a Data Engineer Lead, you will be responsible for designing and implementing data engineering solutions using ADF, PySpark, and SQL.The ideal candidate should have a minimum of 5 years' experience in...

Senior PySpark Data Engineer

1 month ago


Hyderabad, Telangana, India DATAECONOMY Full time

Data Ingestion Pipelines

We're seeking a highly skilled Senior PySpark Data Engineer to design and implement robust metadata-driven data ingestion pipelines using PySpark.

Responsibilities:

  • Collaborate with technical teams to develop innovative data solutions.
  • Work closely with business stakeholders to understand and translate requirements into technical specifications.
  • Conduct unit testing, system testing, and support during UAT.
  • Demonstrate strong analytical and problem-solving skills, as well as a commitment to excellence in software development.

Requirements

  • 4-6 years of experience in IT, with a minimum of 3 years of hands-on experience in Python and PySpark.
  • Solid understanding of data warehousing concepts and ETL processes.
  • Experience with code versioning tools like Git, AWS CodeCommit, and CI/CD pipelines (e.g., AWS CodePipeline).
  • Proven ability to build metadata-driven frameworks for data ingestion.

Benefits

  • Opportunities for professional growth and development.
  • Be part of a dynamic and collaborative team.

About DataEconomy

DataEconomy is a dynamic team driving data-driven solutions. We're seeking a skilled Big Data Developer with PySpark Expertise to join our team in Hyderabad or Pune.