Pyspark Developer
2 weeks ago
Greetings from Tata Consultancy Services
Job Summary:
We are seeking a highly skilled Pyspark Developer to join our team. The ideal candidate will have strong expertise in data architecture, data integration, and data management processes, with the ability to develop transformation logic in Spark-SQL based on dataframes.
Key Responsibilities:
- Design and develop scalable data pipelines using Pyspark
- Develop and maintain complex data transformations using Spark-SQL
- Collaborate with cross-functional teams to integrate data into business applications
- Optimize data processing and storage using AWS Glue and EMR
Requirements:
- 4-7 years of experience in data and analytics concepts, including Big Data, Hadoop, Hive, Impala, Sqoop, and oozie
- Strong understanding of data architecture, data integration, and data management processes
- Proficiency in Pyspark, Scala, and Cloud concepts
- Experience with DevOps tools, such as Ansible, Consul, and Puppet
Preferred Qualifications:
- Experience with AWS-based services, such as SageMaker
- Knowledge of software development methodologies and the software delivery lifecycle
-
PySpark Developer
2 weeks ago
Hyderabad, Telangana, India Techno Wise Full timeJob Title: PySpark DeveloperJob Description:We are seeking a skilled PySpark developer to join our team at Techno Wise. As a PySpark developer, you will be responsible for designing, building, and deploying scalable data processing solutions using PySpark.Key Responsibilities:Design and develop efficient data processing pipelines using PySparkDevelop and...
-
PySpark Developer
2 weeks ago
Hyderabad, Telangana, India Synechron Full timeJob Title: PySpark DeveloperWe are seeking a highly skilled PySpark Developer to join our team at Synechron. As a PySpark Developer, you will be responsible for designing, developing, and maintaining large-scale data processing systems using PySpark and GCP.Key Responsibilities:Design and develop scalable data processing systems using PySpark and GCPDevelop...
-
PySpark Developer
2 weeks ago
Hyderabad, Telangana, India DATAECONOMY Full timeJob Title: PySpark DeveloperDATAECONOMY is seeking a highly skilled PySpark developer to join our dynamic team driving data-driven solutions. With 4-6 years of experience in IT, you will design and implement robust metadata-driven data ingestion pipelines using PySpark.Responsibilities:Collaborate with technical teams to develop innovative data...
-
PySpark Developer
2 weeks ago
Hyderabad, Telangana, India DATAECONOMY Full timeJob Title: PySpark DeveloperWe are seeking a highly skilled PySpark developer to join our dynamic team at DataEconomy in Hyderabad or Pune.Responsibilities:Design and implement robust metadata-driven data ingestion pipelines using PySpark.Collaborate with technical teams to develop innovative data solutions.Work closely with business stakeholders to...
-
PySpark Developer
2 weeks ago
Hyderabad, Telangana, India DATAECONOMY Full timeJob Title: PySpark DeveloperWe are seeking a highly skilled PySpark developer to join our dynamic team at DataEconomy. As a key member of our team, you will be responsible for designing and implementing robust metadata-driven data ingestion pipelines using PySpark.Responsibilities:Collaborate with technical teams to develop innovative data solutions.Work...
-
Pyspark Developer
2 weeks ago
Hyderabad, Telangana, India Tata Consultancy Services Full timeJob Title: Pyspark DeveloperGreetings from Tata Consultancy ServicesJob Summary:We are seeking a highly skilled Pyspark Developer to join our team. The ideal candidate will have strong knowledge of data architecture, data integration, and data management processes, as well as experience with Spark-SQL and dataframes.Key Responsibilities:Develop...
-
PySpark Developer
2 weeks ago
Hyderabad, Telangana, India DATAECONOMY Full timeUnlock Your Potential as a Data Ecosystem ArchitectAt DataEconomy, we're on a mission to revolutionize the way we harness data-driven insights. We're seeking a highly skilled PySpark developer to join our dynamic team in Hyderabad or Pune.Key Responsibilities:Design and implement robust metadata-driven data ingestion pipelines using PySpark, ensuring...
-
PySpark Developer
2 weeks ago
Hyderabad, Telangana, India DATAECONOMY Full timeJob Title: Data Ingestion SpecialistWe are seeking a highly skilled Data Ingestion Specialist to join our team at DataEconomy in Hyderabad or Pune. As a key member of our dynamic team, you will be responsible for designing and implementing robust metadata-driven data ingestion pipelines using PySpark.Key Responsibilities:Design and implement data ingestion...
-
Senior PySpark Developer
5 days ago
Hyderabad, Telangana, India Chiselon Technologies Pvt Ltd Full timeWe are seeking a highly skilled Senior PySpark Developer to join our team at Chiselon Technologies Pvt Ltd.As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining scalable data processing applications using PySpark and Big data technologies.The ideal candidate will have a strong understanding of...
-
Senior PySpark Developer
2 weeks ago
Hyderabad, Telangana, India Virtusa Full timeJob Title: Senior PySpark DeveloperWe are seeking a highly skilled Senior PySpark Developer to join our team at Virtusa.Key Responsibilities:Design, develop, and maintain large-scale data processing pipelines using PySpark.Collaborate with cross-functional teams to identify business requirements and develop solutions.Develop and maintain CI/CD pipelines to...
-
Pyspark SQL Developer
2 weeks ago
Hyderabad, Telangana, India Alignity Solutions Full timeJob Title: Pyspark SQL DeveloperWe are seeking an experienced professional with a strong background in distributed systems, data engineering, and software development. The ideal candidate will possess hands-on expertise in working with Hadoop, Spark, SQL, and PySpark, along with experience in designing optimized data pipelines.Key Responsibilities:Design and...
-
Pyspark Databricks Developer
2 weeks ago
Hyderabad, Telangana, India Risk Resources LLP Full timeAbout the RoleWe are seeking a highly skilled Pyspark Databricks developer to join our team at Risk Resources LLP. As a key member of our data engineering team, you will be responsible for designing and developing data processing pipelines using Pyspark on the Databricks platform.Key ResponsibilitiesDesign and develop efficient data processing pipelines...
-
Pyspark+SQL Developer
2 weeks ago
Hyderabad, Telangana, India Alignity Solutions Full timeJob Title: Pyspark+SQL DeveloperWe are seeking an experienced professional with a strong background in distributed systems, data engineering, and software development. The ideal candidate will possess hands-on expertise in working with Hadoop, Spark, SQL, and PySpark, along with experience in designing optimized data pipelines. This role involves working on...
-
Pyspark+SQL Developer
2 weeks ago
Hyderabad, Telangana, India Alignity Solutions Full timeJob SummaryWe are seeking an experienced professional with a strong background in distributed systems, data engineering, and software development to join our team at Alignity Solutions. The ideal candidate will possess hands-on expertise in working with Hadoop, Spark, SQL, and PySpark, along with experience in designing optimized data pipelines.Key...
-
PySpark Developer with Databricks Experience
2 weeks ago
Hyderabad, Telangana, India HTC Global Services Full timeJob Opportunity: PySpark with DataBricksWe are seeking a highly skilled PySpark developer with experience in Databricks to join our team at HTC Global Services.Key Responsibilities:Design and develop data pipelines using PySpark and DatabricksEnsure data quality and manage data life cyclesDevelop ETL processes using PySpark and DatabricksCollaborate with...
-
PySpark Developer with Databricks Experience
2 weeks ago
Hyderabad, Telangana, India HTC Global Services Full timeJob Title: PySpark with Azure DatabricksWe are seeking a highly skilled PySpark developer with experience in Azure Databricks to join our team at HTC Global Services.About the Role:We are looking for a talented individual who can design and develop data pipelines using PySpark and Databricks. The ideal candidate will have a strong understanding of data...
-
PySpark Engineer
2 weeks ago
Hyderabad, Telangana, India DATAECONOMY Full timeJob Title: PySpark DeveloperAbout the Role:DataEconomy is seeking a highly skilled PySpark developer to join our dynamic team in Hyderabad or Pune. As a key member of our team, you will design and implement robust metadata-driven data ingestion pipelines using PySpark.Key Responsibilities:Collaborate with technical teams to develop innovative data solutions...
-
Pyspark+SQL Developer
2 weeks ago
Hyderabad, Telangana, India Alignity Solutions Full timeAbout the RoleWe are seeking an experienced professional with a strong background in distributed systems, data engineering, and software development to join our team at Alignity Solutions. The ideal candidate will possess hands-on expertise in working with Hadoop, Spark, SQL, and PySpark, along with experience in designing optimized data pipelines.Key...
-
Pyspark Databricks Engineer
1 week ago
Hyderabad, Telangana, India Risk Resources LLP Full timeJob Title: Pyspark Databricks EngineerJob Summary:We are seeking a highly skilled Pyspark Databricks Engineer to join our team at Risk Resources LLP. The successful candidate will be responsible for designing and developing data processing pipelines using Pyspark and Databricks, optimizing and tuning the performance of Spark jobs and clusters, and...
-
Pyspark Databricks Engineer
2 weeks ago
Hyderabad, Telangana, India Risk Resources LLP Full timeJob SummaryWe are seeking a highly skilled Pyspark Databricks engineer to join our team at Risk Resources LLP. The successful candidate will be responsible for designing and developing data processing pipelines using Pyspark on the Databricks platform.Key ResponsibilitiesDesign and develop data processing pipelines using Pyspark and Databricks.Optimize and...