Current jobs related to Lead PySpark Data Engineer - Hyderabad, Telangana - Virtusa
-
Hyderabad, Telangana, India HTC Global Services Full timeWe are seeking an experienced Lead PySpark Engineer to join our team at HTC Global Services. The ideal candidate will have a strong background in designing and implementing data pipelines using PySpark, as well as experience with Databricks.The successful candidate will have hands-on experience with data ingestion, transformation, and orchestration, and will...
-
Data Engineer Lead
1 week ago
Hyderabad, Telangana, India Tech Mahindra Full timeWe are looking for a skilled Data Engineer Lead to join our team at Tech Mahindra.Estimated salary for this position is ₹1,500,000 - ₹2,500,000 per annum.As a Data Engineer Lead, you will be responsible for designing and implementing data engineering solutions using ADF, PySpark, and SQL.The ideal candidate should have a minimum of 5 years' experience in...
-
Experienced Data Engineer
2 days ago
Hyderabad, Telangana, India HTC Global Services Full timeWe are seeking a highly skilled Data Engineer to join our team at HTC Global Services. This role involves working on exciting projects utilizing PySpark and Azure Databricks.About the RoleAs a Data Engineer, you will be responsible for designing, building, and maintaining large-scale data processing systems. Your expertise in PySpark and Azure Databricks...
-
Innovative Big Data Solutions Engineer
1 week ago
Hyderabad, Telangana, India data Full timeAbout the RoleWe are seeking an experienced Big Data Solutions Engineer to join our team in Hyderabad, India. As a key member of our engineering team, you will be responsible for designing and implementing complex data products components based on requirements with possible technical solutions.You will work closely with Data Scientists, Data Engineers,...
-
Senior Data Engineer
1 month ago
Hyderabad, Telangana, India Alignity Solutions Full timeJob DescriptionWe are seeking a highly skilled Data Engineering Lead to join our team at Alignity Solutions. As a Data Engineering Lead, you will be responsible for designing, building, and optimizing data pipelines and workflows throughout the development lifecycle. You will work closely with application development teams to align data engineering solutions...
-
Hyderabad, Telangana, India data Full timeUnlock the Power of Big DataWe are seeking an experienced Advanced Data Analytics Engineer to join our team in Hyderabad, India. As a key member of our engineering team, you will play a crucial role in designing and implementing innovative data products using agile methodologies and open-source technologies.About the RoleThis is an exciting opportunity to...
-
Data Engineering Lead
2 weeks ago
Hyderabad, Telangana, India Twinpacs Sdn Bhd Full timeLead a team of data engineers to design, develop, and maintain scalable ETL pipelines using PySpark Notebooks and Microsoft Fabric.Twinpacs Sdn Bhd is seeking an experienced data engineering leader to join our team. The successful candidate will have 10+ years of experience in data engineering with a strong focus on ETL development using PySpark or other...
-
Senior Big Data Engineer
4 weeks ago
Hyderabad, Telangana, India DATAECONOMY Full timeJob SummaryWe are seeking a highly skilled PySpark Developer to join our dynamic team at DataEconomy. The ideal candidate will have a solid understanding of data warehousing concepts and ETL processes, as well as experience in designing and implementing robust metadata-driven data ingestion pipelines using PySpark.Key ResponsibilitiesDesign, implement, and...
-
Data Engineering Team Lead
1 week ago
Hyderabad, Telangana, India Accellor Full timeWe are seeking a highly skilled Data Fabric Engineer Lead to join our team at Accellor.About the RoleThis is an exceptional opportunity for a seasoned data engineering professional to take on a leadership role and drive innovation in our organization. As a Senior Data Fabric Developer, you will be responsible for designing, developing, and maintaining ETL...
-
Lead Data Fabric Engineer
4 weeks ago
Hyderabad, Telangana, India Accellor Full timeJob Title: Lead Data Fabric EngineerJob Summary: We are seeking an experienced Lead Data Fabric Engineer to join our team at Accellor. The successful candidate will have extensive experience in developing ETL processes using PySpark Notebooks and Microsoft Fabric, as well as supporting existing legacy SQL Server environments.Key Responsibilities:Design,...
-
Data Architect Lead
10 hours ago
Hyderabad, Telangana, India TravelOperations Full timeAbout the RoleWe are looking for a skilled Data Architect Lead to join our team at TravelOperations. This role is responsible for leading data management and analytics initiatives within the Microsoft D365 ecosystem, with a focus on Delta Lake architecture.Key ResponsibilitiesLead the design and implementation of data pipelines, ensuring seamless integration...
-
Azure Databricks Data Engineer Lead
4 weeks ago
Hyderabad, Telangana, India Alignity Solutions Full timeAbout the RoleWe are seeking a skilled Azure Databricks Data Engineer to join our team at Alignity Solutions. The ideal candidate will have experience in designing, developing, and maintaining data pipelines and data streams using Databricks, SQL, PySpark, Spark, Python, and Azure Data Factory (ADF).The successful candidate will be responsible for designing...
-
Senior Azure Data Engineer Lead
10 hours ago
Hyderabad, Telangana, India iVEGA Consulting Full timeJob DescriptionWe are seeking an experienced Senior Azure Data Engineer Lead to join our team at iVEGA Consulting.Key Responsibilities:Design, build, and maintain scalable data pipelines in the Azure environment to ensure smooth operation in both batch and real-time processing.Optimize Azure data infrastructure to facilitate accurate data extraction,...
-
Hyderabad, Telangana, India Vaco Binary Semantics LLP Full timeAbout Vaco Binary Semantics LLPWe are a leading technology consulting firm, and we're seeking a highly skilled Senior Data Engineer to lead our data engineering team. With 7–10 years of experience in data engineering, people management, and hands-on expertise in Python, Databricks, DataSphere, Azure (MS Stack), and PySpark, you will be responsible for...
-
Cloud Data Engineering Team Lead
1 week ago
Hyderabad, Telangana, India Experian Full timeJob SummaryWe are seeking a highly skilled and experienced Cloud Data Engineering Team Lead to lead and manage our big data and cloud-based solutions team. As an Engineering Manager, you will be responsible for designing, developing, and optimizing large-scale Batch data processing applications, while also leading a team of talented engineers.Key...
-
Data Engineer Lead Consultant
3 weeks ago
Hyderabad, Telangana, India Genpact Full timeAt Genpact, we're committed to delivering outcomes that shape the future. With a global presence and over 125,000 professionals across 30+ countries, we serve leading enterprises with our deep business and industry knowledge, digital operations services, and expertise in data, technology, and AI.We're seeking an experienced Data Engineer Lead Consultant to...
-
Senior PySpark Developer
7 days ago
Hyderabad, Telangana, India Incube Consulting Full timeJob SummaryThe ideal candidate will have experience in Pyspark, GCP-Airflow, GCP-DataProc and be proficient in SQL queries. Strong knowledge of big data technology, shell scripting, and data analysis is a plus. Responsibilities1. Interface with clients for quality assurance, issue resolution, and ensuring high customer satisfaction.2. Understand...
-
Chief Data Engineer
2 weeks ago
Hyderabad, Telangana, India Accellor Full timeJob OverviewWe are seeking a highly skilled Data Fabric Engineer Lead to join our team at Accellor.About the RoleThe ideal candidate will possess extensive experience in developing ETL processes using PySpark Notebooks and Microsoft Fabric, with a strong background in Spark-based development and proficiency in SQL. They should be comfortable working...
-
Lead Data Analyst
1 week ago
Hyderabad, Telangana, India Grid Dynamics Full timeAbout the JobWe are seeking a highly skilled Lead Data Analyst to join our team at Grid Dynamics. As a Lead Data Analyst, you will be responsible for developing and implementing data analysis and forecasting algorithms using Python and PySpark.Key Responsibilities:Develop and implement data analysis and forecasting algorithms using Python and...
-
Senior Data Engineering Lead
1 week ago
Hyderabad, Telangana, India UnitedHealth Group Full timeUnitedHealth Group OpportunityOverview of the Role:The Principal Data Engineer will lead a team of engineers, driving design and development of scalable data pipelines using Java, PySpark, Azure, and Databricks.Key Responsibilities:Lead a team of engineers in building fault-tolerant batch and real-time data ingestion pipelines, data transformation, and...
Lead PySpark Data Engineer
1 month ago
Job Title: Lead PySpark Data Engineer
Job Summary:
We are seeking a highly skilled Lead PySpark Data Engineer to join our team at Virtusa. The successful candidate will be responsible for developing, enhancing, and maintaining large-scale data processing systems using PySpark.
Key Responsibilities:
- Design, develop, and deploy PySpark applications to process large datasets
- Collaborate with cross-functional teams to identify business requirements and develop data-driven solutions
- Develop and maintain CI/CD pipelines to ensure efficient and reliable deployment of data processing systems
- Troubleshoot and resolve complex issues related to data processing and system performance
- Stay up-to-date with the latest developments in PySpark and Big Data technologies
Requirements:
6-9 years of experience in developing large-scale data processing systems using PySpark
Hands-on experience in building CI/CD pipelines and deploying data processing systems
Strong understanding of Big Data technologies, including Hadoop, HDFS, Spark-SQL, and MapReduce
Excellent problem-solving skills and ability to work in a fast-paced environment
What We Offer:
Virtusa is a leading provider of digital transformation services, and we offer a competitive salary and benefits package, as well as opportunities for professional growth and development.
