Current jobs related to PySpark SQL Specialist in Cloud Data Engineering - Hyderabad, Telangana - HireIT Consultants

  • Aws Data Engineer With Pyspark

    4 weeks ago

    Hyderabad, Telangana, India Artmac Soft LLC Full time

    Who We AreArtmac Soft is a technology consulting and service-oriented IT company dedicated to providing innovative technology solutions and services to customers Job Title AWS Data Engineer with PySpark 2024 -Freshers Job Type Full TimeExperience 0-1 yearsLocation Hyderabad TelanganaResponsibilities Basic understanding of AWS cloud services S3 ...

  • SQL Developer

    2 weeks ago

    Hyderabad, Telangana, India HireIT Consultants Full time

    SQL Developer with PySpark Coding Job Description Job Title : SQL Developer with PySpark Coding Job Summary : We are seeking an experienced SQL Developer with expertise in PySpark to join our dynamic data engineering team. The ideal candidate will be proficient in SQL for querying and managing large datasets, and have hands-on experience in using PySpark to...

  • Azure Databricks/PySpark Engineer

    3 weeks ago

    Hyderabad, Telangana, India IT & Services Full time

    Job Description : Data Engineer (Azure Databricks & PySpark)Position : Data EngineerExperience : 3 to 12 yearsPrimary Skills : Azure Databricks, PySpark, SQLSecondary Skills : ADF (Azure Data Factory)Location : Bengaluru/HyderabadMode of Work : HybridNotice Period : 0 to 30 DaysKey Responsibilities :ETL Development & Data Processing :- Design, develop, and...

  • Cloud Data Engineer

    4 days ago

    Hyderabad, Telangana, India MSRcosmos LLC Full time

    Company Overview:MSTRcosmos LLC is a leading provider of data engineering and analytics solutions. We empower our clients to make informed decisions by leveraging the power of cloud-based data platforms.Job Description:We are seeking a highly skilled Sr. Azure Developer to lead our Azure Data Platform development team. As a key member of our team, you will...

  • SQL Developer

    3 weeks ago

    Hyderabad, Telangana, India HireIT Consultants Full time

    SQL Developer with PySpark Coding Job DescriptionJob Title : SQL Developer with PySpark CodingJob Summary : We are seeking an experienced SQL Developer with expertise in PySpark to join our dynamic data engineering team. The ideal candidate will be proficient in SQL for querying and managing large datasets, and have hands-on experience in using PySpark to...

  • Cloud Native Data Engineer

    4 days ago

    Hyderabad, Telangana, India Talescope Full time

    Job Description:Design and develop robust, scalable data pipelines using AWS services, Python, PySpark, and SQL that integrate seamlessly with the broader data and product ecosystem.Lead the migration of legacy data warehouses and data marts to AWS cloud-based data lake and data warehouse solutions.Optimize data processing and storage for performance and...

  • Pyspark Data Engineer

    5 days ago

    Hyderabad, Telangana, India Folks Palette LLP Full time

    Company Overview:Folks Palette LLP is a dynamic organization that requires a skilled Pyspark Data Engineer to lead our data platform. Salary and Benefits:We offer competitive compensation and benefits package, commensurate with experience.Job Description:Our ideal candidate will develop and enhance data-processing, orchestration, monitoring, and more by...

  • Data Engineer

    2 weeks ago

    Hyderabad, Telangana, India Anblicks Full time

    Job DescriptionData Engineer (Databricks) | 5+ Years ExperienceJob Location: Hyderabad / AhmedabadImmediate or Early Joiners PreferredJob Summary:We are looking for a skilled Data Engineer with 5+ years of experience in designing, building, and optimizing data pipelines and ETL workflows. The ideal candidate will have expertise in Databricks, PySpark, SQL,...

  • Azure Data Engineer

    2 weeks ago

    Hyderabad, Telangana, India WaferWire Cloud Technologies Full time

    Job Title: Jr Azure Data Engineer Job Location: Hyderabad, India Worksite: Onsite (100%) Shift: UK Shift About WCT: WaferWire Technology Solutions (WCT) specializes in delivering comprehensive Cloud, Data and AI solutions through Microsoft's technology stack. Our services include Strategic Consulting, Data/AI Estate Modernization, and Cloud Adoption...

  • Cloud Data Engineering Specialist

    4 days ago

    Hyderabad, Telangana, India Tata Consultancy Services Full time

    **Job Summary**We are seeking an experienced Cloud Data Engineering Specialist to join our team at Tata Consultancy Services. In this role, you will be responsible for designing and implementing data solutions using Azure data ingestion and transformation components.As a Cloud Data Engineering Specialist, you will work with various databases and have...

  • Cloud Solutions Engineer

    2 days ago

    Hyderabad, Telangana, India Tata Consultancy Services Full time

    Tata Consultancy Services is seeking a skilled Cloud Solutions Engineer to optimize its AWS Pyspark infrastructure. As a key member of the team, you will be responsible for fine-tuning and streamlining our cloud-based data processing systems.Role OverviewWe are looking for an experienced professional with expertise in AWS Pyspark tuning to join our team. The...

  • Technology Consolidation Specialist

    7 days ago

    Hyderabad, Telangana, India NTT DATA Full time

    Welcome to NTT DATAWe strive to hire exceptional, innovative, and passionate individuals who want to grow with us. If you're looking for an inclusive, adaptable, and forward-thinking organization, we invite you to apply.About the JobWe are currently seeking a Systems Integration Specialist to join our team in Hyderabad, Telangana, India. This role requires a...

  • Pyspark

    3 weeks ago

    Hyderabad, Telangana, India People Prime Worldwide Private Limited Full time

    Job DescriptionAbout Client:Our client is a global technology consulting and digital solutions company that enables enterprises to reimagine business models and accelerate innovation through digital technologies. Powered by more than 84,000 entrepreneurial professionals across more than 30 countries, it caters to over 700 clients with its extensive domain...

  • Data Engineer

    2 weeks ago

    Hyderabad, Telangana, India ScaleOrange Technologies Pvt Ltd Full time

    Job Description : We are seeking an experienced Data Engineer to join our team on a contractual basis for 3 months (extendable). The ideal candidate will have 4 years of hands-on experience in data engineering, with advanced proficiency in SQL, and 3 years of experience with Python and PySpark. This role requires flexibility to work in the 1 PM to 10 PM...

  • Azure Data Engineer

    2 weeks ago

    Hyderabad, Telangana, India HireIT Consultants Full time

    Job Description : We are seeking a skilled and dynamic Azure Data Engineer to join our growing data engineering team. The ideal candidate will have a strong background in building and maintaining data pipelines and working with large datasets on the Azure cloud platform. The Azure Data Engineer will be responsible for developing and implementing efficient...

  • Data Engineer

    2 weeks ago

    Hyderabad, Telangana, India Enexus Global Inc. Full time

    Job DescriptionTitle: PySpark Data EngineerExp: 6+Hyderabad, India____Required Qualifications- Bachelors or Masters degree in Computer Science, Engineering, or a related field.- 5+ years of experience in data engineering, with a strong background in PySpark and Apache Spark.- Extensive experience in building and optimizing data pipelines and ETL processes.-...

  • Azure Data Engineer

    4 weeks ago

    Hyderabad, Telangana, India N Human Resources & Management Systems Full time

    Job Description Proficiency In Python, SQL, Databricks, Snowflake Data Modelling, Data Orchestration, ETL Process, Apache Spark, Pyspark, Data Integration and workflow orchestration , real time data processing experience and frameworks, Azure cloud experience Role: Advanced Data Engineer , Job DescriptionMinimum  3  years of experience in Data...

  • Azure Data Engineer

    3 weeks ago

    Hyderabad, Telangana, India HireIT Consultants Full time

    Job Description :We are seeking a skilled and dynamic Azure Data Engineer to join our growing data engineering team. The ideal candidate will have a strong background in building and maintaining data pipelines and working with large datasets on the Azure cloud platform. The Azure Data Engineer will be responsible for developing and implementing efficient ETL...

  • Azure Data Engineer

    2 weeks ago

    Hyderabad, Telangana, India Nazztec Private Limited Full time

    Job Title : Azure Data Engineer Location : Hyderabad (Hybrid) Total Experience : 8 years Job Description : We are seeking a highly skilled and experienced Azure Data Engineer to join our dynamic team in Hyderabad. This is a hybrid role, offering flexibility with a combination of remote and on-site work. The ideal candidate will have extensive experience...

  • Cloud Data Engineer Specialist

    7 days ago

    Hyderabad, Telangana, India HireXtra Full time

    About the Role : We're seeking a highly skilled GCP Data Engineer to join our team remotely. As a key member of our data engineering team, you'll play a crucial role in designing, developing, and maintaining robust and scalable data pipelines on Google Cloud Platform (GCP). Working closely with delivery managers and other stakeholders, you'll contribute to...

PySpark SQL Specialist in Cloud Data Engineering

2 weeks ago

Hyderabad, Telangana, India HireIT Consultants Full time

Job Title

SQL Developer with PySpark Coding Job Description

About the Position

We are seeking a skilled SQL Developer to work on designing, implementing, and maintaining data pipelines and ensuring data accuracy, integrity, and performance in a cloud or on-premise environment.

Key Accountabilities

  • Design and implement data processing pipelines using PySpark to process large volumes of data
  • Develop scalable and efficient distributed data processing solutions
  • Use PySpark to extract, transform, and load (ETL) data from various sources into data lakes or warehouses
  • Work with large datasets stored in Hadoop, AWS, or Azure environments
  • Ensure high data quality and consistency across systems

Requirements

  • Strong proficiency in SQL, including advanced querying techniques, stored procedures, functions, and database design
  • Solid experience in PySpark for big data processing and familiarity with Spark's architecture (RDDs, DataFrames, Datasets)
  • Experience working with data lakes, data warehouses, and ETL pipelines
  • Hands-on experience with cloud platforms like AWS (Redshift, S3, EMR), Azure (Azure Data Lake, Azure Synapse), or GCP
  • Proficiency in Python, including the use of PySpark for parallel data processing