Pyspark+SQL Developer
2 weeks ago
We are seeking an experienced professional with a strong background in distributed systems, data engineering, and software development to join our team at Alignity Solutions. The ideal candidate will possess hands-on expertise in working with Hadoop, Spark, SQL, and PySpark, along with experience in designing optimized data pipelines.
Key Responsibilities- Design and develop optimized data pipelines for both batch and real-time data processing.
- Work on large-scale data processing systems and lead teams in delivering robust technical solutions.
- Develop and document technical and functional specifications, and analyze system processing flows.
- Strong SQL skills, particularly in complex programming.
- Hands-on experience in building and developing applications using PySpark.
- 5-8 years of relevant experience (3-5 years considered if the candidate demonstrates exceptional skill).
- Bachelor's degree in Engineering, Computer Science, or equivalent.
- 6+ years of software development experience, including leading engineering and scrum teams.
- 3+ years of hands-on experience with MapReduce, Hive, Spark (Core, SQL, and PySpark).
- Knowledge of cloud platforms such as GCP or AWS, and experience in building scalable solutions and microservices.
- 1+ years of experience designing and building solutions using Kafka streams or queues.
- Experience working with version control systems like GitHub/Bitbucket and leveraging CI/CD pipelines.
- This position requires at least 3+ years of hands-on experience with MapReduce, Hive, Spark (Core, SQL, and PySpark).
- Strong verbal communication skills are essential.
Alignity Solutions is an Equal Opportunity Employer, M/F/V/D.
-
Pyspark SQL Developer
2 weeks ago
Hyderabad, Telangana, India Alignity Solutions Full timeJob Title: Pyspark SQL DeveloperWe are seeking an experienced professional with a strong background in distributed systems, data engineering, and software development. The ideal candidate will possess hands-on expertise in working with Hadoop, Spark, SQL, and PySpark, along with experience in designing optimized data pipelines.Key Responsibilities:Design and...
-
Pyspark+SQL Developer
2 weeks ago
Hyderabad, Telangana, India Alignity Solutions Full timeJob Title: Pyspark+SQL DeveloperWe are seeking an experienced professional with a strong background in distributed systems, data engineering, and software development. The ideal candidate will possess hands-on expertise in working with Hadoop, Spark, SQL, and PySpark, along with experience in designing optimized data pipelines. This role involves working on...
-
Pyspark+SQL Developer
2 weeks ago
Hyderabad, Telangana, India Alignity Solutions Full timeAbout the RoleWe are seeking an experienced professional with a strong background in distributed systems, data engineering, and software development to join our team at Alignity Solutions. The ideal candidate will possess hands-on expertise in working with Hadoop, Spark, SQL, and PySpark, along with experience in designing optimized data pipelines.Key...
-
PySpark Developer
2 weeks ago
Hyderabad, Telangana, India Synechron Full timeJob Title: PySpark DeveloperWe are seeking a highly skilled PySpark Developer to join our team at Synechron. As a PySpark Developer, you will be responsible for designing, developing, and maintaining large-scale data processing systems using PySpark and GCP.Key Responsibilities:Design and develop scalable data processing systems using PySpark and GCPDevelop...
-
Pyspark Developer
2 weeks ago
Hyderabad, Telangana, India Tata Consultancy Services Full timeJob Title: Pyspark DeveloperGreetings from Tata Consultancy ServicesJob Summary:We are seeking a highly skilled Pyspark Developer to join our team. The ideal candidate will have strong expertise in data architecture, data integration, and data management processes, with the ability to develop transformation logic in Spark-SQL based on dataframes.Key...
-
Pyspark Developer
2 weeks ago
Hyderabad, Telangana, India Tata Consultancy Services Full timeJob Title: Pyspark DeveloperGreetings from Tata Consultancy ServicesJob Summary:We are seeking a highly skilled Pyspark Developer to join our team. The ideal candidate will have strong knowledge of data architecture, data integration, and data management processes, as well as experience with Spark-SQL and dataframes.Key Responsibilities:Develop...
-
Senior PySpark Developer
2 weeks ago
Hyderabad, Telangana, India Virtusa Full timeJob Title: Senior PySpark DeveloperWe are seeking a highly skilled Senior PySpark Developer to join our team at Virtusa.Key Responsibilities:Design, develop, and maintain large-scale data processing pipelines using PySpark.Collaborate with cross-functional teams to identify business requirements and develop solutions.Develop and maintain CI/CD pipelines to...
-
PySpark Developer
2 weeks ago
Hyderabad, Telangana, India Techno Wise Full timeJob Title: PySpark DeveloperJob Description:We are seeking a skilled PySpark developer to join our team at Techno Wise. As a PySpark developer, you will be responsible for designing, building, and deploying scalable data processing solutions using PySpark.Key Responsibilities:Design and develop efficient data processing pipelines using PySparkDevelop and...
-
PySpark Developer with Databricks Experience
2 weeks ago
Hyderabad, Telangana, India HTC Global Services Full timeJob Opportunity: PySpark with DataBricksWe are seeking a highly skilled PySpark developer with experience in Databricks to join our team at HTC Global Services.Key Responsibilities:Design and develop data pipelines using PySpark and DatabricksEnsure data quality and manage data life cyclesDevelop ETL processes using PySpark and DatabricksCollaborate with...
-
Pyspark Databricks Developer
2 weeks ago
Hyderabad, Telangana, India Risk Resources LLP Full timeAbout the RoleWe are seeking a highly skilled Pyspark Databricks developer to join our team at Risk Resources LLP. As a key member of our data engineering team, you will be responsible for designing and developing data processing pipelines using Pyspark on the Databricks platform.Key ResponsibilitiesDesign and develop efficient data processing pipelines...
-
PySpark Developer
2 weeks ago
Hyderabad, Telangana, India DATAECONOMY Full timeJob Title: PySpark DeveloperDATAECONOMY is seeking a highly skilled PySpark developer to join our dynamic team driving data-driven solutions. With 4-6 years of experience in IT, you will design and implement robust metadata-driven data ingestion pipelines using PySpark.Responsibilities:Collaborate with technical teams to develop innovative data...
-
PySpark Developer
2 weeks ago
Hyderabad, Telangana, India DATAECONOMY Full timeJob Title: PySpark DeveloperWe are seeking a highly skilled PySpark developer to join our dynamic team at DataEconomy in Hyderabad or Pune.Responsibilities:Design and implement robust metadata-driven data ingestion pipelines using PySpark.Collaborate with technical teams to develop innovative data solutions.Work closely with business stakeholders to...
-
PySpark Developer
2 weeks ago
Hyderabad, Telangana, India DATAECONOMY Full timeJob Title: PySpark DeveloperWe are seeking a highly skilled PySpark developer to join our dynamic team at DataEconomy. As a key member of our team, you will be responsible for designing and implementing robust metadata-driven data ingestion pipelines using PySpark.Responsibilities:Collaborate with technical teams to develop innovative data solutions.Work...
-
PySpark Developer
2 weeks ago
Hyderabad, Telangana, India DATAECONOMY Full timeUnlock Your Potential as a Data Ecosystem ArchitectAt DataEconomy, we're on a mission to revolutionize the way we harness data-driven insights. We're seeking a highly skilled PySpark developer to join our dynamic team in Hyderabad or Pune.Key Responsibilities:Design and implement robust metadata-driven data ingestion pipelines using PySpark, ensuring...
-
PySpark Developer
2 weeks ago
Hyderabad, Telangana, India DATAECONOMY Full timeJob Title: Data Ingestion SpecialistWe are seeking a highly skilled Data Ingestion Specialist to join our team at DataEconomy in Hyderabad or Pune. As a key member of our dynamic team, you will be responsible for designing and implementing robust metadata-driven data ingestion pipelines using PySpark.Key Responsibilities:Design and implement data ingestion...
-
Senior PySpark Developer
5 days ago
Hyderabad, Telangana, India Chiselon Technologies Pvt Ltd Full timeWe are seeking a highly skilled Senior PySpark Developer to join our team at Chiselon Technologies Pvt Ltd.As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining scalable data processing applications using PySpark and Big data technologies.The ideal candidate will have a strong understanding of...
-
Pyspark Databricks Engineer
1 week ago
Hyderabad, Telangana, India Risk Resources LLP Full timeJob Title: Pyspark Databricks EngineerJob Summary:We are seeking a highly skilled Pyspark Databricks Engineer to join our team at Risk Resources LLP. The successful candidate will be responsible for designing and developing data processing pipelines using Pyspark and Databricks, optimizing and tuning the performance of Spark jobs and clusters, and...
-
Pyspark Databricks Engineer
2 weeks ago
Hyderabad, Telangana, India Risk Resources LLP Full timeJob SummaryWe are seeking a highly skilled Pyspark Databricks engineer to join our team at Risk Resources LLP. The successful candidate will be responsible for designing and developing data processing pipelines using Pyspark on the Databricks platform.Key ResponsibilitiesDesign and develop data processing pipelines using Pyspark and Databricks.Optimize and...
-
Data Engineering Expert
19 hours ago
Hyderabad, Telangana, India Risk Resources LLP Full timeAbout the RoleWe are seeking a highly skilled Data Engineering Expert to join our team at Risk Resources LLP. As a Pyspark Databricks Developer, you will play a critical role in developing and implementing data processing pipelines using Pyspark on the Databricks platform.Key ResponsibilitiesDesign and Develop Data Pipelines: Utilize Pyspark and Databricks...
-
Hyderabad, Telangana, India Tata Consultancy Services Full time{"text": "Overview:Tata Consultancy Services is seeking a skilled Big Data Developer with expertise in Python Pyspark to join our team. The ideal candidate will have a strong background in data processing, manipulation, and transformation using Spark transformations and actions.Key Responsibilities:Design and develop scalable data processing pipelines using...